# Optimal Boundary Control of Linear Hyperbolic PDEs\thanksreffootnoteinfo

###### Abstract:

The present paper develops an optimal linear quadratic boundary controller for linear hyperbolic partial differential equations (PDEs) with actuation on only one end of the domain. First-order necessary conditions for optimality is derived via weak variations and an optimal controller in state-feedback form is presented. The linear quadratic regulator (LQR) controller is calculated from differential algebraic Riccati equations. Numerical examples are performed to show the use of the proposed method.

First]Agus Hasan, First]Lars Imsland, Second]Ivan Ivanov, Third]Snezhana Kostova, and, Second]Boryana Bogdanova

Department of Engineering Cybernetics

Norwegian University of Science and Technology

Trondheim, Norway

Department of Statistics and Econometrics

Sofia University - St. Kliment Ohridski

Sofia, Bulgaria

Institute of System Engineering and Robotics

Bulgarian Academy of Sciences

Sofia, Bulgaria

Keywords: Optimal control, Linear quadratic regulator, Weak variations, Partial differential equations.

^{1}^{1}footnotetext: The present research paper was supported in a part by the EEA Scholarship Program BG09 Project Grant D03-91 under the European Economic Area Financial Mechanism. This support is greatly appreciated.

Research in control of linear hyperbolic partial differential equations (PDEs) have attracted great attention in recent years, since they can be used to model many physical systems such as road traffic (Goatin, 2006), gas flow in pipeline (Gugat and Dick, 2011), flow of fluids in transmission lines (White, 2007; Hasan and Imsland, 2014) and in open channels (Coron et al., 1999), and mud flow in oil well drilling (Kaasa et al., 2012; Landet et al., 2013; Hauge et al., 2013; Hasan et al., 2016).

Recent control approaches include backstepping method, where a Volterra integral transformation is used to transform the original system into a stable target system. It turns out that the control law is calculated after solving a Goursat-type PDEs. This type of PDEs can be solved explicitly in terms of Marcum Q-function (Vazquez and Krstic, 2014). Further investigation involved parameter estimations and disturbance rejections have been presented by Hasan (2014a, 2015, b) and Aamo (2013). The backstepping method has been successfully used for control design of many PDEs such as the Schrodinger equation (Krstic et al., 2011), the Ginzburg-Landau equation (Aamo et al., 2005), the Navier-Stokes equation (Vazquez and Krstic, 2007), the surface wave equation (Hasan et al., 2011), and the KdV equation (Marx and Cerpa, 2014). Different with other approaches that require the solution of operator Riccati equations, backstepping yields control gain formulas which can be computed using symbolic computation and, in some cases, can even be given explicitly (Krstic and Smyshlyaev, 2008).

Another control method for the linear hyperbolic systems of conservative laws has been studied recently by Pham et al. (2013) using receding horizon optimal control approach. Optimal control is a mature concept with numerous applications in science and engineering, e.g., Hasan et al. (2013). Numerical methods for solving optimal control problems can be divided into two classes of methods. The first method is called the indirect methods, where the calculus of variations is used to determine the first-order optimality conditions of the original optimal control problem (Teo et al., 1991). The second method is called the direct methods. Here, the state and control variables for the optimal control problem are discretized and the problem is transcribed into nonlinear optimization problems or nonlinear programming problems which can be solved using well-known optimization techniques (Hasan and Foss, 2015).

In this paper, we are concerned with the problem of linear quadratic optimal control of linear hyperbolic PDEs using an indirect method. This problem has been previously considered for linear parabolic diffusion-reaction PDEs by Moura and Fathy (2013). Optimal control of these type of PDEs is challenging since in many cases actuation and sensing are often limited to the boundary and the dynamics are notably more complex than ordinary differential equation (ODE) systems. Classical approach usually relies on operator Riccati equation and semi-group theory, which limit the practicality of the method. Thus, by introduce weak variations concept directly to the PDEs, it has been shown by Moura and Fathy (2011) that we can bypass semigroup theory and the associated issues with solving operator Riccati equations.

This paper is organized as follow. In section 2, we introduced some definitions and notations used throughout this paper. We stated the problem in section 3. The main result is presented in section 4. Numerical examples are presented in section 5. In this section, we compare the linear quadratic controller with the backstepping controller. Both methods bypass the requirement of solving the operator Riccati equations. The last section contains conclusions.

To simplify the presentation of this paper, we introduce the following notations (Moura and Fathy, 2011). For a linear operator applied to a real-valued function , we define

where . The inner product of two functions is defined as

The subscripts and denote partial derivatives with respect to and , respectively.

We consider the following boundary control problem of the 22 linear hyperbolic PDEs

(1) | |||||

(2) | |||||

(3) | |||||

(4) | |||||

(5) | |||||

(6) |

where , , with . We assume and . The initial condition and are assumed to belong to .

The objective is to design the state-feedback controller that minimize the following quadratic function over a finite-time horizon

(7) | |||||

Here , , , , and are weighting kernels that respectively weight the states and , the control , and the terminal states of the system. It is important that is strictly positive to ensure bounded control signals.

In the first part of this section, we derive necessary conditions for optimality of the open-loop linear quadratic control problem using weak variations method. Furthermore, we derive the differential algebraic Riccati equations associated with the state-feedback control law.

The necessary conditions for optimality are utilized using weak variations method presented in Bernstein and Tsiotras (2009). This method has been used for reaction-diffusion PDEs by Moura and Fathy (2011).

###### Theorem 1

Consider the linear hyperbolic PDEs describes by (1)-(6) defined on the finite-time horizon with quadratic cost function (7). Let , , , , and respectively denote the optimal states, control, and co-states that minimize the quadratic cost. Then the first-order necessary conditions for optimality are given by

(8) | |||||

(9) | |||||

(10) | |||||

(11) |

with boundary conditions

(12) | |||||

(13) | |||||

(14) | |||||

(15) |

and initial/final conditions

(16) | |||||

(17) | |||||

(18) | |||||

(19) |

where the optimal control input is given by

(20) |

###### Proof 1

Suppose , , and are the optimal states and control input. We introduce the perturbation from the optimal solution as follow

Substituting these equations into the objective function (7), yields

Next, we define a Lagrange functional

where and denote the Lagrange multipliers (co-states). Computing the first derivative of the Lagrange functional with respect to , yield

(21) |

The inner product from the last two terms at the right hand side can be simplified as follow

Furthermore, we compute

Substituting these equations into (21), yields

If we evaluate the above equation at , we have

The necessary conditions for optimality is when

Thus, we have the following first-order optimality conditions

This concludes the proof.

Utilizing the results by Moura and Fathy (2013), for the state-feedback problem, first we postulate the co-states and are related with the states and , respectively, according to the following transformation

(22) | |||||

(23) |

The superscript on suggest the linear operator is time dependent. For the linear hyperbolic PDEs, we have the following result.

###### Theorem 2

The optimal control in state-feedback form is given by

(24) |

where the time varying transformation is the solution to the following differential algebraic Riccati equations

(25) | |||||

(26) | |||||

(27) |

with boundary conditions

(28) | |||||

(29) | |||||

(30) | |||||

(31) | |||||

(32) | |||||

(33) |

and final conditions

(34) | |||||

(35) |

###### Proof 2

Evaluating every term in (10)-(11) using the definitions (22)-(23) and integration by parts, we have the first terms

the second terms are given by

the third terms are given by

and the last terms are given by

Plugging these terms into (10)-(11), we have (25)-(33). The last two conditions are obtained from (18)-(19). This concludes the proof.

Note that for the infinite-time horizon, the LQR controller is given by the following steady-state solution of the differential algebraic Riccati equations

with boundary conditions (28)-(33). The time-invariant steady-feedback controller is given by

Unfortunately, we cannot prove the existence of the solution satisfy (25)-(35). For the example in the following section, we use parameters and weighting kernels such that the solution exists. Thus, the well-posedness problem of the differential algebraic Riccati equations remains open.

In this section, we perform two cases. In the first case, we show the LQR controller solve the optimal control problem in finite time. In the second case, the LQR controller is compared with the backstepping controller. In both cases, we use the following parameters

Simulation parameters | |
---|---|

Symbol | Value |

1 | |

1 | |

10 | |

20 | |

q | 1 |

T | 1 |

In the first case, we choose the following weighting kernels

Simulation kernels | |
---|---|

Symbol | Value |

R | 1 |

The algebraic Riccati equation is given by

The above equation is solved numerically. The solution is used to calculate the optimal state-feedback controller (24) and the result can be seen in the following figure.

It can be observed from figure 1 that the LQR controller (24) regulates the linear hyperbolic system into its equilibrium.

We compare the controller (24) with the controller obtained from the backstepping method by Vazquez et al. (2011). The controller from the backstepping method is given by

where the backstepping kernels and are obtained from

on a triangular domain with the following boundary conditions

The solutions of the backstepping kernels are given by

where and denote modified Bessel function defined as

We calculate the control signal and the tracking error function . In figure 2, we can observe that the LQR controller performs better compared to the backstepping controller. However, while the gains in the backstepping controller can be computed analytically, the existence of the solution for the algebraic Riccati equation remains an open question.

In this paper, we derived LQR results for boundary controlled linear hyperbolic PDEs. The necessary conditions for optimality for the open-loop system are obtained via weak variations, while the explicit state-feedback is derived from the co-state systems. In the given examples, the state-feedback laws are calculated after solving the differential algebraic Riccati equations for special cases. For general cases, the existence of solution remains an open question. This will be considered in the future work.

## References

- Aamo (2013) Aamo, O. (2013). Disturbance rejection in 22 linear hyperbolic systems. IEEE Transaction on Automatic Control, 58(5), 1095–1106.
- Aamo et al. (2005) Aamo, O., Smyshlyaev, A., and Krstic, M. (2005). Boundary control of the linearized ginzburg-landau model of vortex shedding. SIAM Journal of Control and Optimization, 43, 1953–1971.
- Bernstein and Tsiotras (2009) Bernstein, D. and Tsiotras, P. (2009). A Course in Classical Optimal Control. Pre-print, NY.
- Coron et al. (1999) Coron, J., Andrea-Novel, B., and Bastin, G. (1999). A lyapunov approach to control irrigation canals modeled by saint-venant equations. In Proceedings of the European Control Conference. Karlsruhe, Germany.
- Goatin (2006) Goatin, P. (2006). The aw-rascle vehicular traffic flow model with phase transitions. Mathematical and Computer Modelling, 44, 287–303.
- Gugat and Dick (2011) Gugat, M. and Dick, M. (2011). Time-delayed boundary feedback stabilization of the isothermal euler equations with friction. Mathematical Control and Related Fields, 1, 469–491.
- Hasan (2014a) Hasan, A. (2014a). Adaptive boundary control and observer of linear hyperbolic systems with application to managed pressure drilling. In Proceedings of ASME Dynamic Systems and Control Conference. San Antonio, USA.
- Hasan (2014b) Hasan, A. (2014b). Disturbance attenuation of n+ 1 coupled hyperbolic pdes. In Conference on Decision and Control. Los Angeles, USA.
- Hasan (2015) Hasan, A. (2015). Adaptive boundary observer for nonlinear hyperbolic systems: Design and field testing in managed pressure drilling. In American Control Conference. Chicago, USA.
- Hasan et al. (2016) Hasan, A., Aamo, O., and Krstic, M. (2016). Boundary observer design for hyperbolic pde-ode cascade systems. Automatica, 68, 75–86.
- Hasan and Foss (2015) Hasan, A. and Foss, B. (2015). Optimal switching time control of petroleum reservoirs. Journal of Petroleum Science and Engineering, 131, 131–137.
- Hasan et al. (2011) Hasan, A., Foss, B., and Aamo, O. (2011). Boundary control of long waves in nonlinear dispersive systems. In Australian Control Conference. Melbourne, Australia.
- Hasan et al. (2013) Hasan, A., Foss, B., Krogstad, S., Gunnerud, V., and Teixeira, A. (2013). Decision analysis for long-term and short-term production optimization applied to the voador field. In SPE Reservoir Characterisation and Simulation Conference and Exhibition. Abu Dhabi, United Arab Emirates.
- Hasan and Imsland (2014) Hasan, A. and Imsland, L. (2014). Moving horizon estimation in managed pressure drilling using distributed models. In IEEE Conference on Control Applications (CCA). Nice, France.
- Hauge et al. (2013) Hauge, E., Aamo, O., and Godhavn, J. (2013). Application of an infinite-dimensional observer for drilling systems incorporating kick and loss detection. In Proceedings of the European Control Conference. Zurich, Switzerland.
- Kaasa et al. (2012) Kaasa, G., Stamnes, O., Aamo, O., and Imsland, L. (2012). Simplified hydraulics model used for intelligent estimation of downhole pressure for a managed-pressure-drilling control system. SPE Drilling Completion, 27(1), 127–138.
- Krstic et al. (2011) Krstic, M., Guo, B., and Smyshlyaev, A. (2011). Boundary controllers and observers for the linearized schrodinger equation. SIAM Journal of Control and Optimization, 49, 1479–1497.
- Krstic and Smyshlyaev (2008) Krstic, M. and Smyshlyaev, A. (2008). Boundary Control of PDEs. SIAM, Philadelphia, PA.
- Landet et al. (2013) Landet, I., Pavlov, A., and Aamo, O.M. (2013). Modeling and control of heave-induced pressure ï¬uctuations in managed pressure drilling. IEEE Transaction on Control System Technology, 21(4), 1340–1351.
- Marx and Cerpa (2014) Marx, S. and Cerpa, E. (2014). Output feedback control of the linear korteweg-de vries equation. In IEEE Conference on Decision and Control. Los Angeles, USA.
- Moura and Fathy (2013) Moura, S. and Fathy, H. (2013). Optimal boundary control of reactionâdiffusion partial differential equations via weak variations. Journal of Dynamic Systems, Measurement, and Control, 135(3).
- Moura and Fathy (2011) Moura, S. and Fathy, K. (2011). Optimal boundary control & estimation of diffusion-reaction pdes. In American Control Conference. San Francisco, USA.
- Pham et al. (2013) Pham, V., Georges, D., and Besancon, G. (2013). Receding horizon observer and control for linear hyperbolic systems of conservation laws. In European Control Conference. Zurich, Switzerland.
- Teo et al. (1991) Teo, K., Goh, C., and Wong, K. (1991). A unified computational approach to optimal control problem. Longman Scientific, NY.
- Vazquez and Krstic (2007) Vazquez, R. and Krstic, M. (2007). A closed-form feedback controller for stabilization of the linearized 2-d navier-stokes poiseuille flow. IEEE Transactions on Automatic Control, 52, 2298–2312.
- Vazquez and Krstic (2014) Vazquez, R. and Krstic, M. (2014). Marcum q-functions and explicit kernels for stabilization of 2x2 linear hyperbolic systems with constant coefficients. Systems & Control Letters, 68, 33–42.
- Vazquez et al. (2011) Vazquez, R., Krstic, M., and Coron, J. (2011). Backstepping boundary stabilization and state estimation of a 22 linear hyperbolic system. In 50th IEEE Conference on Decision and Control. Orlando, USA.
- White (2007) White, F. (2007). Fluid Mechanics. McGraw-Hill, NY.