Incentive Design for Direct Load Control Programs
Abstract
We study the problem of optimal incentive design for voluntary participation of electricity customers in a Direct Load Scheduling (DLS) program, a new form of Direct Load Control (DLC) based on a three way communication protocol between customers, embedded controls in flexible appliances, and the central entity in charge of the program. Participation decisions are made in realtime on an eventbased basis, with every customer that needs to use a flexible appliance considering whether to join the program given current incentives. Customers have different interpretations of the level of risk associated with committing to pass over the control over the consumption schedule of their devices to an operator, and these risk levels are only privately known. The operator maximizes his expected profit of operating the DLS program by posting the right participation incentives for different appliance types, in a publicly available and dynamically updated table. Customers are then faced with the dynamic decision making problem of whether to take the incentives and participate or not. We define an optimization framework to determine the profitmaximizing incentives for the operator. In doing so, we also investigate the utility that the operator expects to gain from recruiting different types of devices. These utilities also provide an upperbound on the benefits that can be attained from any type of demand response program.
I Introduction
With the lack of utilityscale storage options in the power grid, the need to make electricity demand active is becoming more pressing each day. In the research community, the most favored option to make this vision happen is realtime pricing (RTP). Optimal realtime prices, if calculated correctly, would maximize the social surplus. However, there are several barriers that currently hinder the realization of this vision: 1) Enduse customers need to have certainty in prices for a certain lookahead horizon to plan consumption. With a widespread integration of renewables, calculating reliable clearing prices hours ahead of operation is challenging; 2) the lack of concrete models for the consumption flexibility of electricity consumers in today’s market, specifically with the granularity needed to allow high penetration of renewables, and the timeinhomogeneity of these models due to variable appliance arrival and flexibility patterns; 3) the strict reliability requirements of power grid operations, allowing small error margins in price design. A line of iterative methods that actively ask for the customers’ collective response to price signals are being proposed to address these problems [1, 2].
One the opposite side of the spectrum, Direct Load Control (DLC) has proven to be a popular type of demand control for grid operators, mostly due to the reliable and predictable nature of the demand’s response to control signals. Currently, customers providing DLC services to the power grid sign longterm contracts that allow the provider to cut off the supply of electricity to some of their appliances (e.g., air conditioners and pumps) during occasional contingencies. Commonly, DLC strategies take customer participation as a given, assuming small fixed exante monetary payments for all participants, regardless of the level of service they provide or the discomfort they experience. However, participation in a DLC program presents risks for the customers and a rational intelligent customer would not provide this service extensively without appropriate financial incentives. In this work, we take a first step in addressing these inherent economic problems for designing daytoday DLC incentives.
To avoid confusion with currently employed DLC programs, in which the individual consumption of appliances are not observable, and feedback control strategies are used [3], we will refer to our proposed program as Direct Load Scheduling (DLS). DLS does not merely cut off the electricity supply of appliances. Rather, a control center can optimally plan the consumption within consumerspecified laxity limits, e.g., scheduling the charge of an Electric Vehicle (EV) by a deadline. Contrary to common DLC practice, customers provide the DLS authority with an explicit expression of the service they need in an online fashion, leaving no uncertainty in how the demand responds to control signals. Appliances are recruited only on an eventbased basis, i.e., every time they have to perform a task. Previous works have proposed various costminimizing scheduling algorithms for DLS, specifically for EVs, e.g. [4, 5, 6, 7, 8, 9]. The possibility of using VehicletoGrid (V2G) services for regulation and grid support has also been studied, e.g. [10, 11]. However, charge interruption and V2G could decrease EV battery life, delay full charge and present risks to the customer, and violate customer privacy. Thus, proper economic incentives for participation should be studied.
We assume that the DLS program is run by the same entity that provides electricity to customers, hereafter referred to as the aggregator. The aggregator is essentially an energy trader. Following current practice, we assume that the aggregator buys electricity at timevarying wholesale prices from the energy market and on sells this energy to enduse customers at flat rates, without being able to deny any electricity service requests. Thus, it essentially acts as intermediary node that shields the enduse customers from wholesale price fluctuations. With no demand flexibility, the aggregator has no control over the profitability of his venture in the short run. Rather, his profit is determined by 1) wholesale prices; 2) the predetermined billing tariffs, which are flat, regulated, and change very slowly; 3) the consumption behavior of customers, which is out of control of the aggregator. To overcome this issue, the aggregator runs a DLS program and pays customers in return for directly scheduling their appliances, i.e., it effectively buys flexibility from customers while keeping them on flat rates. This paper focuses on the design of a market for trading flexibility between a single aggregator and a population of randomly arriving appliances. We model this market as a monopoly, in the sense that each customer has access to only one aggregator and is a pricetaker. Competition between aggregators is left to future work.
Ii Model
We consider a community with a large population of customers owning controllable appliances, and one aggregator. The basic observation of this work is that directly controlling various types of appliances has different utilities for the aggregator. This utility is a function of how flexible and how high the electricity consumption of the device is, and of the dynamic state of the grid at the time the appliance is used. Thus, it is best if the incentive that the aggregator pays to customers to recruit their appliances can vary dynamically with time and appliance type^{1}^{1}1 While, in theory, the incentive could vary across different customers offering the same service, here we assume that we want the incentives to be perceived as fair and not violate consumer privacy limits.. To allow for this ,we assume that these incentive are posted by the aggregator in dynamically updated and publicly available tables for all customers, which can be thought of as menus listing the different incentives customers can receive. Customers planning to use controllable appliances would then respond to these posted incentives by deciding whether they want to participate or not, and how much laxity they wish to offer the aggregator.
We would like to point out that having dynamically changing menus does not necessarily mean that the incentives have to be redesigned every hour of every day. In fact, incentives will exhibit similar daily or weekly cycles as market prices.
We define this market under the following assumptions:
Assumption 1: The aggregator’s revenue from recruiting each appliance is additive and independent of other appliances’ participation;
Assumption 2: A customer’s initial choice to use an appliance is perfectly inelastic and not affected by incentives;
Assumption 3: The aggregator’s load does not affect the wholesale market clearing prices;
Assumption 4: The aggregator has access to exante forecasts of expected wholesale prices.
Assumptions 3 and 4 simplify the expression of the aggregator’s utility when recruiting appliances in the DLS program. Next, we look at how customers respond to incentives.
Iia Individual Appliance DLS Commitment Problem
We model the electricity consumption of customers using tasks that dynamically arrive, receive service, and depart at discrete time epochs indexed by . An arrival event corresponds to the earliest time at which it is possible for an appliance to start its job. Each task, indexed by , has a socalled characteristic vector . The elements of fully describe the nature of the task, which could simply be the charge duration and rate for an EV, the desired temperature for a thermostatically controlled load (TCL). We further assume that can only be chosen from a finite codebook , designed to achieve a bounded and controllable load modeling error. This allows us to cluster similar energy requests in a finite number of classes, indexed by
which will help to highly reduce the computational effort of our algorithm. Thus, the consumption characteristics of task are uniquely defined by its cluster index .
The strategy set is defined by the laxity limits the customer commits to provide to the DLS program when recruited, described by the index
and referred to as the appliance’s mode. Mode corresponds to no laxity, i.e., the customer will not participate in the program. These laxity limits could, for example, correspond to the slack for an EV charge, or the width of the comfort band for a TCL. The appliance embedded controller is queried by the customer application, which maps the physical state of the appliance onto the set of modes that are available for the customer to choose from and, possibly, an indication of what is the flat rate cost with no laxity.
The customer then chooses the mode after observing the incentive menu. We denote by the incentive the customer could receive for releasing the control of an appliance in cluster in mode at time , with . We denote the vector containing all (nontrivial) incentives available to appliances in cluster under modes as
We expect the customers in charge of making commitment decisions to be only boundedly rational, i.e., they are likely to only spend a limited amount of effort in considering the economic utility of participation in the program or updating their home energy management system’s parameters. However, in the rest of this section, we introduce an analytical model which is valid for rational customers. We do so with the disclaimer that this model is not a necessary element of our design and we present it solely to provide some intuition into the nature of this decision making problem.
Design constraint 1 (Diminishing Payoffs): Note that if an appliance does not join the DLS program right after its arrival time, it will lose some laxity. However, if consumers have reasons to believe that taking some risk and waiting to participate in the DLS program later could increase their expected payoff, even though the amount of laxity they can offer decreases, they will do so. To avoid this situation, we assume that the incentives will be designed such that the customer’s payoff for the same level of risk (e.g., same deadline) will be monotonically nonincreasing in time. For example, if we assign a separate mode every time the laxity offered by a deferrable load is increased by one unit, we require that
A Rational Customer Model: The utility gained by the customer from operating task at time in each mode is defined as a function
which includes three terms: 1) The incentive available for mode ; 2) The commitment risk (disutility) associated with agreeing to receive service under mode , modeled through a privately known function
with , i.e., there is no risk when the customer decides not to participate in the DLS program. Without loss of generality, we order the modes from low to high risk. This would result in monotonically nondecreasing individual risk functions ; 3) the utility of receiving the standard service of using electricity and finishing a job. This term is a constant, since we assume it will eventually happen for every request, either through the DLS program under some mode , or through the standard service model of the power grid (). The disutility of not receiving this standard service in case of an emergency departure is captured through the risk term. Thus, we eliminate this term from the customer’s decision making model.
Consequently, assuming that the risk function are chosen such that they have the same unit as the monetary incentive, the customer’s utility is quasilinear and is given by
Upon receiving the incentive information from the aggregator, the customer would solve the following optimization to determine the best operating mode of appliance :
(1) 
The customer will not participate in the DLS program () if none of the ’s for are at least marginally higher than the risk . Otherwise, the customer would pick the mode such that the margin between and is highest (highest residual worth). Ties are broken uniformly at random.
Even if we assume that this model perfectly describes the decision making procedure of all customers, since is only privately known, the aggregator cannot predict the outcome of (1) deterministically. Thus, to determine the incentives , the aggregator is faced with an optimization problem with incomplete information. The goal of the aggregator would be to maximize its expected profit, given aggregate statistics about the population’s response to incentives.
IiB The Aggregator Problem
In order to recruit directly controllable appliances, the aggregator needs to design appropriate incentives for every possible mode in all possible clusters, i.e., . The LSE participates in the electricity wholesale market run on an hourly basis, where it buys energy to serve its load, directly controllable or not. We will elaborate more on the nature of this market interaction later. For now, we take the the expected profit that the aggregator can make, through wholesale market transactions, by directly controlling an individual appliance from cluster in mode as known. For a recruitment of cluster in mode at time , we denote this utility by . The utility of not recruiting an appliance is zero, i.e., . As per Assumption 1, we define this recruitment utility as additive and independent, rendering the incentive design problem separable for individual appliances.
Since recruiting an appliance from cluster in mode at time comes at a cost equal to , the net revenue of the aggregator from this recruitment, denoted by , is
(2) 
However, note that the mode is chosen by the customer after seeing the incentives , through (1). Since only statistical information on the customers response strategy is available to the aggregator, only the expected net revenue can be maximized. Denote the event that any customer in cluster picks mode as . This event happens if:

Individual rationality constraint (IR):

Incentive compatibility constraints (IC):
Consequently, the expected net revenue of recruiting an appliance of cluster , simply denoted by , is given by
(3) 
which the aggregator would like to maximize; i.e. the aggregator would want to design the incentives as follows:
(4) 
The summation over time is required to find the optimal incentives in the presence of the diminishing payoff design constraint. The reader could envision that for a realtime implementation, the optimization (4) could be solved over a receding horizon.
In order to solve (4), it is essential to have an understanding of how changes with the incentives . Next, we propose two different views for approaching this problem.
IiB1 Bayesian Approach
Here we assume that the aggregator has access to statistically learned prior knowledge on the risk levels of customers in different clusters. With this view, the incentive design problem would be similar in nature to optimal Bayesian unitdemand pricing, given that the customers’ risk levels (valuations) for different modes (items) cannot be assumed to be drawn from independent distributions. The risk levels that a customer perceives for committing to the program with a single appliance under different modes are correlated. For example, in the case of EVs or any other deferrable loads, the mode corresponds to the amount of laxity that accompanies the request. Clearly, offering a higher consumption laxity entails an additional risk over that of offering a lower laxity, and these variables cannot be considered independent.
We assume that the aggregator parameterizes the risk function of each appliance in cluster according to:
(5) 
where is a taskspecific nonnegative continuous random variable and represents the type of an individual task , and the variables are deterministic and shared by all appliances in the same cluster , with , and can model the average attitude of population towards risk. To ensure that this is a realistic parameterization of the risk function, the aggregator could suggest this specific structure as default to consumers when they pick their risk functions.
We assume that the aggregator has access to statistical priors for the type , and we denote by the cumulative distribution of for appliances in cluster . With this new notation, for all is the probability of the following event:
(6)  
(7)  
(8) 
so we should have , with
(9)  
(10) 
which gives,
(11) 
However, due to the absence of any natural ordering, these constraints will render the optimization problem (4) rather complex. Thus, next, we will impose a design constaint that ensures that local incentive compaibility is sufficient for decision making, i.e., if the customer prefers mode over adjacent modes and , he/she will also prefer mode over all modes and .
Design constraint 2 (SingleCrossing Incentive Profile): we will design the incentive profile such that , the ratio is nonincreasing, i.e., incentives grow slower than risks for higher modes .
Proposition II.1
We acknowledge that the singlecrossing condition restricts the values that the incentive profile can take into a region that may be suboptimal for the aggregator. However, it considerably lowers the numerical effort to solve (4).
To illustrate the next steps required to solve the problem, specifically required for our numerical experiments, we assume that the types for cluster are drawn from a uniform distribution over . We design the incentives such that all of the ratios fall in the probability space of . This happens if the incentives are positive and nondecreasing with , and that the ratio is not above , i.e., someone might pick mode . Consequently, imposing the diminishing payoff constraints for deferrable loads, (4) is written as,
(13) 
for which the objective function is quadratic in , and the constraints are all affine.
The statistics on the risk functions can be obtained by conducting market surveys or using learning techniques. The details are out of the scope of this work.
IiB2 Modelfree Learning Approach
If there is no single underlying model that characterizes how costumers respond to participation incentives, or no information is available on the private risk functions of customers, modelfree online learning techniques can be used to directly learn the probabilities . These approaches explore different alternatives for the incentive signals , observe the response of the population, an update their estimate of accordingly. This requires that the event of a customer considering to join the program be observable to the aggregator, which is not the case in our current design. This issue can be addressed by asking the customers to make an anonymous query every time they need to look at the incentive menus for a specific cluster.
Next, we study the recruitment utility of different devices for the aggregator.
Iii The Recruitment Utility Functions
There are several options for an aggregator to profit from recruiting flexible appliances. Here we only study the possibility of load shifting based on the recruitment of longduration non interruptible deferrable appliances (e.g., EVs, washer/dryers ) or preheating and precooling of TCLs.
In order to solve (4), the aggregator needs to know beforehand how much utility it could expect from recruiting an appliance in cluster in mode at time . We denoted this value by . In this Section, we specifically focus on calculating this payoff for the case of load shifting with noninterruptible deferrable loads and Thermostatically Controlled Loads (TCL), with the numerical results focusing specifically on Plugin Hybrid Electric Vehicles (PHEV). Due to limited space, we leave the discussion of interruptible and sheddable loads to future work.
Energy is traded on an hourly basis, and the demand is modeled as constant in hourly intervals in the energy market. The task of ensuring the subhourly balance of demand and supply is left to ancillary service providers, which are procured and dispatched by the grid operator to respond quickly (in a matter of minutes or seconds) to variations of the demand. Traditionally, ancillary services are offered by fast ramping generators.
In order to serve its’ load, the aggregator needs to purchase a certain amount of energy for every hour from the wholesale energy market, which we denote by , and refer to as the base load. We assume that the aggregator has access to exante forecasts of the wholesale energy market clearing prices, and we denote the expected value of the price for hour as . We assume the aggregator’s load is small enough to not affect the price. The aggregator can save money in the wholesale energy market if it recruits flexible appliances and shifts their load to hours at which energy is cheaper.
Denote the set of all feasible hourly load traces of an individual task in cluster under mode recruited at time as . To obtain an hourly load profile for an appliance with subhourly consumption variations, we simply average out the total consumption of the device within each hour. We denote as the consumption profile of the appliance if it is not recruited by the DLS program and starts its consumption at time . Serving this power to the consumer through buying energy from the wholesale market presents a cost for the aggregator. By having direct control over this appliance, the aggregator can expect to gain the following payoff by shifting the load away from peak hours:
Remark III.1
The consumption profile of flexible appliances that do not choose to join the DLS program, i.e., , is a function of the tariff that the customers are billed on. On a flat tariff, the customers do not need to spend any effort to find the best time at which they should consume electricity, and simply plug in an appliance at the request arrival time.
Design constraint 3: Here we assume that for all deferrable loads, the mode index is directly equivalent to the amount of laxity (slack time) that accompanies the request.
Iiia Deferrable Noninterruptible Appliances
Here we look at appliances whose consumption profile can merely be shifted in time, but cannot be modified in any way once started. A classic example is that of a washing machine cycle. In this case, the control variable is the activation time of the task, denoted by (See Fig. 1). The set of possible values of depends on the initial time at which the request arrives, and the laxity that accompanies the request, i.e., .
Once activated, the appliance consumes a predetermined amount of power, denoted by the timeshifted pulse for appliances in cluster , with a length of epochs. This pulse varies on a subhourly basis as a function of the time epochs . To relate this with the variables required to solve the optimization (III), we need to map this subhourly varying load to an hourly load profile, resulting in
Notice the summations required to calculate the average hourly consumption of the device from the subhourly load. To avoid the inconvenience of going from to hourly consumption values when solving (III), we simply expand the expected wholesale energy price vector to define virtual subhourly wholesale prices ,
where denotes the unit pulse function between . With this new definition, we have
(15)  
Consequently, the expected utility of recruiting an appliance in cluster under mode at time is
s.t.  (16) 
where the first term refers to the cost incurred by the aggregator if no demand control is exercised, whereas the second term mirrors the lowest possible cost with which the appliance can be served, considering a demand laxity of time units.
IiiB Thermostatically Controlled Loads
Another category of appliances that can help the aggregator save money in the energy market are TCLs, which can use the inherent energy storage property of building thermal mass to shift their load to cheaper hours. A substantial potential for intrahourly load shifting with heating and cooling devices is through preheating and precooling of the airconditioned space. To preheat a space, the temperature is increased above the comfort band of the user at offpeak hours, before residents/employees arrive at home/work. The preheating should be scheduled such that by the time the residents arrive, the temperature is close to the highest acceptable temperature in the comfort band. While some commercial building utility managers currently exercise this option during night hours to save on energy, with the integration of renewable resources, the best time and amount of preheating would be variable on a daily basis and needs coordination with the aggregator.
We assume that each TCL is equipped with a thermostat that keeps the temperature in a certain comfort band , with and representing the lower and upper thresholds chosen by the customers in cluster . Here, we adopt a simple firstorder model proposed in [12] to explain the state dynamics of temperature. Let (a representative temperature) characterize the state of the th heating device; evolves according to the linear stochastic difference equation
(17) 
where we denote by

the average loss rate for buildings in cluster ;

the ambient temperature;

the average rate of heat gain supplied by devices in cluster ;

the operating state of the device at time (1 for ”on” or 0 for ”off”);

a zero mean Wiener noise process.
We assume that, once on, the unit consumes a constant power approximately equal to for cluster . Thus, the only variable that needs to be chosen and can affect the aggregator’s cost is the times at which to run the unit for preheating. Due to the constant power of the device, the amount of preheating is a direct consequence of this choice. However, we would like to point out that more sophisticated methods for determining the trajectory of the temperature for precooling/preheating exists in the literature, both based on optimal control theory [13, 14, 15, 16], or learning and simulation [17]. The calculations in the section could be updated to account for any of these techniques.
In order for the temperature to be around at the time that the building occupants arrive, we must have previously increased it enough in the preheating period. This preheating process can be done over multiple disjoint time intervals, whenever it is deemed as a costeffective action.
For appliances recruited at time , preheating can start right away and can continue to the time at which building occupants arrive, which is equal to , with the mode index directly mirroring the time laxity offered for preheating by the customer. Thus, the optimization that needs to be solved to minimize the expected cost for this is
s.t.  (18)  
where should be picked such that at least one number in the set lies within the controllability subspace of the dynamics that govern . To write these dynamics in closed form, we assume that , i.e., we assume that the unit stays off long enough when the building is vacant, and the temperature has already reached the ambient temperature when preheatig starts. Then, we can write the temporal evolution of the expected value of as
(19) 
with . The ’s are the decision variables.
In order to see how much benefit direct scheduling can provide to the aggregator, we need to compare the cost to the case when no preheating is exercised. In that case, heating starts at , and it will take the TCL units of time to continuously work and get the temperature to , where
(20) 
This assumes that the dynamics of the ambient temperature is much slower than that of the TCL. The first heating cycle right after turning on in the morning will have an expected cost equal to
for the aggaregator. Thus, the utility of recruting a TCL in cluster in mode at time is given by:
Note that providing any DLS service requires that the appliance is submetered. Here this is essential since the overall consumption of the device could be fairly increased and the consumer should not be billed accordingly.
Iv Numerical Case Study Using EV Data
We simulate the interactions of one aggregator with a population of Plugin Hybrid EVs arriving at random to receive level1 battery charge (1.1 kW instantaneous rate). The arrival time, charge duration, and laxity data are taken from real PHEV charge events recorded and studied in [18]. This database includes 620 charge events that happen over the length of several months. However, we ignore the dates and treat the plugin events as if they happened on the same day. The aggregator interacts with the wholesale energy market. Hourly LMPs for the one day of operation simulated here are taken from ISO New England’s Maine load zone on September 1st, 2013 to noon of September 2nd.
We translate the absolute charge laxity values in [18] into risk functions by tuning the type in (5) such that it would not be individually rational for the customer to offer laxities that exceed their real departure time, given one sample of the daily incentive profile. For lack of any meaningful alternative, we take . Denote the mode corresponding to the maximum laxity that could be offered while allowing a timely departure for the customer by . Then we assume that for each charging event in cluster at time , given sample incentives , the risk type of the user is such that
Next, in order to solve the optimization (13), we fit a uniform distribution on the customer types, resulting in
One can use the Gershgorin circle theorem to show that the optimization problem (13) is concave (with a negative semidefinite quadratic term). Incentives are designed for halfhour intervals, i.e., for one full day. Remember that the solution to this optimization is suboptimal due to the singlecrossing condition and the uniform prior assumed for the customer risk types .
Iva Comparison of Aggregator Payoff for Different Incentive Design Schemes
The average payoff () that the aggregator receives at different times of the day when interacting with the abovedescribed customers under the singlecrossing incentives is shown in Fig. 1 (dashed red curve). To study the level of suboptimality imposed by the singlecrossing design constraint, we compare the outcome of the modelbased incentive design technique to a bruteforced learning method, where several scenarios are generated for the daily incentive profile and tested on the population to observe the response. With more trials, the aggregator would find better incentive profiles. Fig. 1 compares the aggregator’s profit with the singlecrossing profile with that of the bruteforce learning method after 30 and 1000 days. The reader can see that the learning method is performing better than the singlecrossing profile after 1000 days, but not in 30 days.
IvB Welfare Effects
We define the consumer savings through a DSM technique as the expected change in the monetary value of maximum utility across different alternatives for receiving electricity service. As explained before, since the basic service that is being received/provided through any demand management program is always the same as the normal operation mode of the grid today, i.e., there is no change in overall consumption and only the timing of consumption changes, we ignore the utility of receiving the standard service of electricity consumption in these calculations. The consumer savings by participating in the DLS program (under bruteforce optimized incentives after 1000 days) is equal to . Saving impacts are individually calculated for each charge request, and the sum of this value over the 620 charging events is shown in Fig. 2 as a function of time of plugin.
Now assume that, instead of going through a intermediary node like the aggregator, the customer could have, through a hypothetical demand management scheme, directly interacted with the electricity grid. Hence, customers could submit their consumption flexibility as bids to the Independent System Operator (ISO) that runs the market, and are billed based on optimal market clearing prices. This is the ultimate goal of dynamic pricing schemes and could realize the most efficient outcome of the market. Alternatively, one could imagine any scheme that uses the full potential of customers for load shifting, and relays all the wholesale market savings to them. For now, assume that today’s regulated flat tariffs are designed such that customers are billed at the averaged wholesale cost of the electricity they consume (ignoring aggregator mark up). Then, the consumer savings through the implementation of such dynamic pricing program would have been equal to the recruitment utility, i.e., , assuming that customers would use their maximum possible laxity with no reservation when making individual scheduling decisions in response to a price (no commitment risk function). The value of this quantity is summed up across the population and is compared to customer savings gained from the DLS scheme in Fig. 2.
The considerable difference in consumer savings between the DLS program and that of optimal pricing is due to two factors: 1) the presence of an intermediary forprofit node, i.e., the aggregator; 2) the commitment risk function , preventing the customers from realizing all their load shifting potentials. To observe the welfare effects of the second phenomena, we show the sum of the aggregator and consumer savings under DLS in Fig. 2. The reader can observe that the overall decrease in the community’s (aggregator + consumers) welfare is minimal. Remember that this decrease in welfare comes with the promise of reliability and controllability, which are the essential attributes that drive electricity market design problems and are required for safe grid operation.
V Conclusions and Future Work
Due to the popularity of direct control mechanisms in the power grid, designing appropriate incentives for customer participation in these programs seems like an inevitable issue. Here we approached this issue as a market design problem to trade flexibility with an aggregator of electricity services. Extension of this work to look at the possibility of providing ancillary services through collective effort of several appliances, and to study competition between several aggregators that can serve the same population, is left to future work.
References
 [1] C. Chen, S. Kishore, and L. V. Snyder, “An innovative rtpbased residential power scheduling scheme for smart grids,” in Acoustics, Speech and Signal Processing (ICASSP), 2011 IEEE International Conference on. IEEE, 2011, pp. 5956–5959.
 [2] K. Shaloudegi, N. Madinehi, S. Hosseinian, and H. Abyaneh, “A novel policy for locational marginal price calculation in distribution systems based on loss reduction allocation using game theory,” Power Systems, IEEE Transactions on, vol. 27, no. 2, pp. 811–820, 2012.
 [3] D.C. Wei and N. Chen, “Air conditioner direct load control by multipass dynamic programming,” Power Systems, IEEE Transactions on, vol. 10, no. 1, pp. 307–313, 1995.
 [4] P. SanchezMartin, G. Sanchez, and G. MoralesEspana, “Direct load control decision model for aggregated ev charging points,” Power Systems, IEEE Transactions on, vol. 27, no. 3, pp. 1577–1584, 2012.
 [5] W. Su and M.Y. Chow, “Performance evaluation of an edabased largescale plugin hybrid electric vehicle charging algorithm,” Smart Grid, IEEE Transactions on, vol. 3, no. 1, pp. 308–315, 2012.
 [6] M. Caramanis and J. Foster, “Management of electric vehicle charging to mitigate renewable generation intermittency and distribution network congestion,” in Decision and Control, Proceedings of the 48th IEEE Conference on, 2009, pp. 4717–4722.
 [7] Y. He, B. Venkatesh, and L. Guan, “Optimal scheduling for charging and discharging of electric vehicles,” Smart Grid, IEEE Transactions on, vol. 3, no. 3, pp. 1095–1105, 2012.
 [8] D. Wu, D. Aliprantis, and L. Ying, “Load scheduling and dispatch for aggregators of plugin electric vehicles,” Smart Grid, IEEE Transactions on, vol. 3, no. 1, pp. 368–376, 2012.
 [9] S. Chen, Y. Ji, and L. Tong, “Large scale charging of electric vehicles,” in Power and Energy Society General Meeting, 2012 IEEE, 2012, pp. 1–9.
 [10] J. TomiÄ and W. Kempton, “Using fleets of electricdrive vehicles for grid support,” Journal of Power Sources, vol. 168, no. 2, pp. 459 – 468, 2007. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0378775307005575
 [11] M. G. Vaya and G. Andersson, “Combined smartcharging and frequency regulation for fleets of plugin electric vehicles,” in Power and Energy Society General Meeting, 2013 IEEE, 2013.
 [12] C. Alvarez, R. Malhame, and A. Gabaldon, “A class of models for load management application and evaluation revisited,” Power Systems, IEEE Transactions on, vol. 7, no. 4, pp. 1435–1443, 1992.
 [13] J. Ma, J. Qin, T. Salsbury, and P. Xu, “Demand reduction in building energy systems based on economic model predictive control,” Chemical Engineering Science, vol. 67, no. 1, pp. 92 – 100, 2012, dynamics, Control and Optimization of Energy Systems. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0009250911005240
 [14] K. ho Lee and J. E. Braun, “Development of methods for determining demandlimiting setpoint trajectories in buildings using shortterm measurements,” Building and Environment, vol. 43, no. 10, pp. 1755 – 1768, 2008. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0360132307002168
 [15] Y. Ma, F. Borrelli, B. Hencey, A. Packard, and S. Bortoff, “Model predictive control of thermal energy storage in building cooling systems,” in Decision and Control, 2009 held jointly with the 2009 28th Chinese Control Conference. CDC/CCC 2009. Proceedings of the 48th IEEE Conference on, 2009, pp. 392–397.
 [16] M. Hasan, “Aggregatorassisted residential participation in demand response program,” Master’s thesis, Virginia Polytechnic Institute and State University, 2012.
 [17] R. Yin, P. Xu, M. A. Piette, and S. Kiliccote, “Study on autodr and precooling of commercial buildings with thermal mass in california,” Energy and Buildings, vol. 42, no. 7, pp. 967–975, 2010.
 [18] K. Kurani et al., “Learning from consumers: Plugin hybrid electric vehicle (phev) demonstration and consumer education, outreach, market research program, volumes i and ii,” Institute of Transportation Studies, UC Davis, Research Report UCDITSRR1021, 2010.