Robust Nonlinear Filtering of Uncertain Lipschitz Systems via Pareto Optimization
A new approach for robust filtering for a class of Lipschitz nonlinear systems with time-varying uncertainties both in the linear and nonlinear parts of the system is proposed in an LMI framework. The admissible Lipschitz constant of the system and the disturbance attenuation level are maximized simultaneously through convex multiobjective optimization. The resulting filter guarantees asymptotic stability of the estimation error dynamics with exponential convergence and is robust against nonlinear additive uncertainty and time-varying parametric uncertainties. Explicit bounds on the nonlinear uncertainty are derived based on norm-wise and element-wise robustness analysis.
Department of Electrical and Computer Engineering, University of Alberta, Edmonton, Alberta, Canada, T6G 2V4
Department of Research and Development, Maplesoft, Waterloo, Ontario, Canada, N2V 1K8
Keywords: Nonlinear Uncertain Systems, Robust Observers, Nonlinear Filtering, Convex Optimization
The problem of observer design for nonlinear continuous-time uncertain systems has been tackled in various approaches. Early studies in this area go back to the works of de Souza et. al. where they considered a class of continuous-time Lipschitz nonlinear systems with time-varying parametric uncertainties and obtained Riccati-based sufficient conditions for the stability of the proposed observer with guaranteed disturbance attenuation level, when the Lipschitz constant is assumed to be known and fixed, , . In an observer, the -induced gain from the norm-bounded exogenous disturbance signals to the observer error is guaranteed to be below a prescribed level. They also derived matrix inequalities helpful in solving this type of problems. Since then, various methods have been reported in the literature to design robust observers for nonlinear systems [17, 16, 8, 23, 1, 3, 2, 4, 5, 18, 22, 14]. On the other hand, the restrictive regularity assumptions in the Riccati approach can be relaxed using linear matrix inequalities (LMIs). An LMI solution for nonlinear filtering is proposed for Lipschitz nonlinear systems with a given and fixed Lipschitz constant [22, 14]. The resulting observer is robust against time-varying parametric uncertainties with guaranteed disturbance attenuation level.
In a recent paper the authors considered the nonlinear observer design problem and presented a solution that has the following features :
(Stability) In the absence of external disturbances the observer error converges to zero exponentially with a guaranteed convergence rate. Moreover, our design is such that it can maximize the size of the Lipschitz constant that can be tolerated in the system.
(Robustness) The design is robust with respect to uncertainties in the nonlinear plant model.
(Filtering) The effect of exogenous disturbances on the observer error can be minimized.
In this article we consider a similar problem but consider the important extension to the case where there exist parametric uncertainties in the state space model of the plant. The extension is significant because uncertainty in the state space model of the plant is always encountered in a any actual application. Ignoring this form of uncertainty requires lumping all model uncertainty on the nonlinear (Lipschitz) term, thus resulting in excessively conservative results. This extension, is though obtained through a completely different solution from that given in . The price of robustness against parametric uncertainties is an stability requirement of the plant model which makes the solution, different and yet a non-trivial extension to that of . We will see this in detail in Section 3. Our solution is based on the use of linear matrix inequalities and has the property that the Lipschitz constant is one the LMI variables. This property allows us to obtain a solution in which the maximum admissible Lipschitz constant is maximized through convex optimization. As we will see, this maximization adds an extra important feature to the observer, making it robust against nonlinear uncertainties. The result is an observer with a prespecified disturbance attenuation level which guarantees asymptotic stability of the estimation error dynamics with guaranteed speed of convergence and is robust against Lipschitz nonlinear uncertainties as well as time-varying parametric uncertainties, simultaneously. Explicit bound on the nonlinear uncertainty are derived through a norm-wise analysis. Some related results were recently presented by the authors in references  and  for continues-time and for discrete-time systems, respectively. The rest of the paper is organized as follows. In Section 2, the problem statement and some preliminaries are mentioned. In Section 3, we propose a new method for robust observer design for nonlinear uncertain systems. Section 4, is devoted to robustness analysis in which explicit bounds on the tolerable nonlinear uncertainty are derived. In Section 5, a combined observer performance is optimized using multiobjective optimization followed by a design example.
2 Problem Statement
Consider the following class of continuous-time uncertain nonlinear systems:
where is the induced 2-norm, is any admissible control signal and is called the Lipschitz constant. If the nonlinear function satisfies the Lipschitz continuity condition globally in , then the results will be valid globally. is an unknown exogenous disturbance, and and are unknown matrices representing time-varying parameter uncertainties, and are assumed to be of the form
where , , are are known real constant matrices and is an unknown real-valued time-varying matrix satisfying
The parameter uncertainty in the linear terms can be regarded as the variation of the operating point of the nonlinear system. It is also worth noting that the structure of parameter uncertainties in (5)-(6) has been widely used in the problems of robust control and robust filtering for both continuous-time and discrete-time systems and can capture the uncertainty in a number of practical situations , , .
2.1 Disturbance Attenuation Level
Considering observer of the following form
the observer error dynamics is given by
stands for the controlled output for error state where is a known matrix. Our purpose is to design the observer parameter such that the observer error dynamics is asymptotically stable with maximum admissible Lipschitz constant and the following specified norm upper bound is simultaneously guaranteed.
Furthermore we want the observer to a have a guaranteed decay rate.
2.2 Guaranteed Decay Rate
Consider the nominal system with and . Then, the decay rate of the system (10) is defined to be the largest such that
holds for all trajectories . We can use the quadratic Lyapunov function to establish a lower bound on the decay rate of the (10). If for all trajectories, then , so that for all trajectories, where is the condition number of P and therefore the decay rate of the (10) is at least , . In fact, decay rate is a measure of observer speed of convergence.
3 Observer Synthesis
In this section, an observer with guaranteed decay rate
and disturbance attenuation level is proposed. The
admissible Lipschitz constant is maximized through LMI optimization.
Theorem 1, introduces a design method for such an observer but first
we mention a lemma used in the proof of our result. It worths
mentioning that unlike the Riccati approach of , in
the LMI approach no regularity assumption is needed.
Lemma 1.  Let , and be real matrices of appropriate dimensions and satisfying . Then for any scalar and vectors , we have
Note. As an standard notation in LMI context, the
symbol “” represents the element which makes the
corresponding matrix symmetric.
Theorem 1. Consider the Lipschitz nonlinear system
along with the observer (8). The
observer error dynamics is (globally) asymptotically stable with
maximum admissible Lipschitz constant, , decay rate
and gain, , if
there exists a fixed scalar , scalars and
, and matrices , and , such
that the following LMI optimization problem has a solution.
Once the problem is solved
Proof: From (10), the observer error dynamics is
Let for simplicity
Consider the Lyapunov function candidate
where . For the nominal system, we have then
To have it suffices (28) to be less than zero, where:
The above can be written as
Defining the new variable
Now, consider the systems with uncertainties and disturbance. The derivative of along the trajectories of is
Using Lemma 1, it can be written
So, when , a sufficient condition for the stability with guaranteed decay rate is that
where . Therefore
so a sufficient condition for is that
So a sufficient condition for is that the right hand side of the above inequity be less than zero which by means of Schur complements is equivalent to (15). Note that (42) and (43) are already included in (15). Then,
Remark 1. The proposed LMIs are linear in both and
. Thus, either can be a fixed constant or an
optimization variable. If one wants to design an observer for a
given system with known Lipschitz constant, then the LMI
optimization problem can be reduced to an LMI feasibility problem
(just satisfying the constraints) which is easier
Remark 2. This observer is robust against two type of uncertainties. Lipschitz nonlinear uncertainty in and time-varying parametric uncertainty in the pair while the disturbance attenuation level is guaranteed, simultaneously.
4 Robustness Against Nonlinear Uncertainty
As mentioned earlier, the maximization of Lipschitz constant makes the proposed observer robust against some Lipschitz nonlinear uncertainty. In this section this robustness feature is studied and both norm-wise and element-wise bounds on the nonlinear uncertainty are derived. The norm-wise analysis provides an upper bound on the Lipschitz constant of the nonlinear uncertainty and the norm of the Jacobian matrix of the corresponding nonlinear function. Furthermore, we will find upper and lower bounds on the elements of the Jacobian matrix through and element-wise analysis.
4.1 Norm-Wise Analysis
Assume a nonlinear uncertainty as follows
Proposition 1. Suppose that the actual
Lipschitz constant of the system is and the maximum
admissible Lipschitz constant achieved by Theorem 1, is
. Then, the observer designed based on Theorem 1, can
tolerate any additive Lipschitz nonlinear uncertainty with Lipschitz
constant less than or
Proof: Based on Schwartz inequality, we have
According to the Theorem 1, can be any Lipschitz nonlinear function with Lipschitz constant less than or equal to ,
so, there must be
In addition, we know that for any continuously differentiable function ,
where is the Jacobian matrix . So can be any additive uncertainty with .
4.2 Element-Wise Analysis
Assume that there exists a matrix such that
can be considered as a matrix-type Lipschitz constant. Suppose that the nonlinear uncertainty is as in (49) and
based the proposition 1, can be any matrix with . In the following, we will look at the problem from a different angle. It is clear that is a perturbed version of due to . The question is that how much perturbation can be tolerated on the element of without loosing the observer features stated in Theorem 1. This is important in the sense that in gives us an insight about the amount of uncertainty that can be tolerated in different directions of the nonlinear function. Here, we propose a novel approach to optimize the elements and provide specific upper and lower bounds on tolerable perturbations. Before stating the result of this section, we need to recall some matrix notations.
For matrices , ,
means . For square A, is a vector containing the
elements on the main diagonal and where is a vector is
a diagonal matrix with the elements of on the main diagonal.
is the element-wise absolute value of , i.e. .
stands for the element-wise product (Hadamard product) of and .
Corollary 1. Consider Lipschitz nonlinear system satisfying (55), along with the observer (8). The observer error dynamics is (globally) asymptotically stable with the matrix-type Lipschitz constant with maximized admissible elements, decay rate and gain, , if there exist fixed scalars and , scalars and , and matrices , , and , such that the following LMI optimization problem has a solution.
where , , and are as in Theorem 1 replacing by . Once the problem is solved
Proof: The proof is similar to the proof of Theorem 1 with
replacing by .
Remark 3. By appropriate selection of the weights
, it is possible to put more emphasis on the directions in
which the tolerance against nonlinear uncertainty is more important.
To this goal, one can take advantage of the knowledge
about the structure of the nonlinear function .
According to the norm-wise analysis, it is clear that
in (57) can be any matrix with . We will now
proceed by deriving bounds on the elements of .
Lemma 2. For any and
, if , then .
Proof: Assume any , then, it is easy to show that . Therefore,
Now we are ready to state the element-wise robustness result. Assume additive uncertainty in the form of (49), where
It is clear that is
a perturbed version of .
Proposition 2. Suppose that the actual
matrix-type Lipschitz constant of the system is and the
maximized admissible matrix-type Lipschitz constant achieved by
Corollary 1, is . Then, can be any additive
nonlinear uncertainty such that .
Proof: According to the Proposition 1, it suffices to show that . Using Lemma 2, we have
The first inequality follows from Lemma 2 and the symmetry of
diag(diag(, . The last two
inequalities are due to the relation between the induced infinity
and 2 norms  and the fact that the spectral norm is
submultiplicative with respect to the Hadamard product ,
respectively. Since the singular values are nonnegative, we can
Therefore, denoting the elements of as , the following bound on the element-wise perturbations is obtained
In addition, can be any continuously differentiable additive uncertainty which makes . It is worth mentioning that the results of Lemma 2 and Proposition 2 have intrinsic importance from the matrix analysis point of view regardless of our specific application in the robustness analysis.
5 Combined Performance using Multiobjective Optimization
The LMIs proposed in Theorem 1 are linear in both admissible
Lipschitz constant and disturbance attenuation level. So, as
mentioned earlier, each can be optimized. A more realistic problem
is to choose the observer gain matrix by combining these two
performance measures. This leads to a Pareto multiobjective
optimization in which the optimal point is a trade-off between two
or more linearly combined optimality criterions. Having a fixed
decay rate, the optimization is over (maximization) and
(minimization), simultaneously. The following theorem is in
fact a generalization of the results of  and 
(for the systems in class of ) in which the Lipschitz constant
is known and fixed, in one point of view; and the results of
 in which a special class of sector nonlinearities
is considered and there is no uncertainty in pair (A,C), in another.
Theorem 2. Consider Lipschitz nonlinear system
along with the observer (8). The
observer error dynamics is (globally) asymptotically stable with
decay rate and simultaneously maximized admissible Lipschitz
constant, and minimized gain, , if there exists fixed scalars and
, scalars and , and matrices
, and , such
that the following LMI optimization problem has a solution.
where , , and are as in Theorem 1. Once the problem is solved
Proof: The above is a scalarization of a multiobjective
optimization with two optimality criterions. Since each of these
optimization problems is convex, the scalarized problem is also
convex . The rest of the proof is the
same as the proof of Theorem 1.
Remark 4. The matrix-type Lipschitz constant may
also be considered in place of in Theorem 2.
Since the observer gain directly amplifies the measurement noise,
sometimes, it is better to have an observer gain with smaller
elements. There might also be practical difficulties in implementing
high gains. We can control the Frobenius norm of either by
changing the feasibility radius of the LMI solver or by decreasing
which is , to
decrease as in (23). The latter
can be done by replacing with in which
can be either a fixed scalar or an LMI variable.
Considering as another performance index, note
that it is even possible to have a triply combined cost function in
the LMI optimization problem of Theorem 2. Now, we show the
usefulness of this
Theorem through a design example.
Example: Consider a system of the form of where
Figure 1, shows the true and estimated values of states.
The values of , and , and the optimal trade-off curve between and over the range of when the decay rate is fixed () are shown in figure 2.
The optimal surfaces of , and over the range of when the decay rate is variable are shown in figures 3, 4 and 5, respectively. The maximum value of is 0.34 obtained when . In the range of and , the norm of is almost constant. As increases over 0.8, rapidly increases and for , the LMIs are infeasible.
A new nonlinear observer design method for a class of Lipschitz nonlinear uncertain systems is proposed through LMI optimization. The developed LMIs are linear both in the admissible Lipschitz constant and the disturbance attenuation level allowing both two be an LMI optimization variable. The combined performance of the two optimality criterions is optimized using Pareto optimization. The achieved observer guarantees asymptotic stability of the error dynamics with a prespecified decay rate (exponential convergence) and is robust against Lipschitz additive nonlinear uncertainty as well as time-varying parametric uncertainty. Explicit bounds on the nonlinear uncertainty are derived through norm-wise and element-wise analysis.
-  Masoud Abbaszadeh and Horacio J. Marquez. Robust observer design for a class of continuous-time Lipschitz nonlinear systems. Proceedings of the 45th IEEE Conference on Decision and Control, San Diego, U.S.A., pages 3895–3900, 2006.
-  Masoud Abbaszadeh and Horacio J Marquez. LMI optimization approach to robust filtering for discrete-time nonlinear uncertain systems. In American Control Conference, 2008, pages 1905–1910, 2008.
-  Masoud Abbaszadeh and Horacio J. Marquez. Robust observer design for sampled-data Lipschitz nonlinear systems with exact and Euler approximate models. Automatica, 44(3):799–806, 2008.
-  Masoud Abbaszadeh and Horacio J Marquez. Robust filtering for lipschitz nonlinear systems via multiobjective optimization. Journal of Signal & Information Processing, 1(1):24–34, 2010.
-  Masoud Abbaszadeh and Horacio J Marquez. A generalized framework for robust nonlinear filtering of lipschitz descriptor systems with parametric and nonlinear uncertainties. Automatica, 48(5):894–900, 2012.
-  S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan. Linear matrix inequalities in system and control theory. SIAM, PA, 1994.
-  S. Boyd and L. Vandenberghe. Convex Optimization. Cambrige University Press, 2004.
-  X. Chen, T. Fukuda, and K. D. Young. A new nonlinear robust disturbance observer. Systems and Control Letters, 41(3):189–199, 2000.
-  Carlos E. de Souza, Lihua Xie, and Youyi Wang. filtering for a class of uncertain nonlinear systems. Systems and Control Letters, 20(6):419–426, 1993.
-  R. A. Horn and C. R. Johnson. Matrix Analysis. Cambrige University Press, 1985.
-  R. A. Horn and C. R. Johnson. Topics in Matrix Analysis. Cambrige University Press, 1991.
-  A. Howell and J. K. Hedrick. Nonlinear observer design via convex optimization. Proceedings of the American Control Conference, 3:2088–2093, 2002.
-  Pramod P. Khargonekar, Ian R. Petersen, and Kemin Zhou. Robust stabilization of uncertain linear systems: Quadratic stabilizability and control theory. IEEE Transactions on Automatic Control, 35(3):356–361, 1990.
-  G. Lu and D. W. C. Ho. Robust observer for nonlinear discrete systems with time delay and parameter uncertainties. IEE Proceedings: Control Theory and Applications, 151(4):439–444, 2004.
-  H. J. Marquez. Nonlinear Control Systems: Analysis and Design. Wiley, NY, 2003.
-  W. M. McEneaney. Robust filtering for nonlinear systems. Systems and Control Letters, 33(5):315–325, 1998.
-  S. K. Nguang and M. Fu. Robust nonlinear filtering. Automatica, 32(8):1195–1199, 1996.
-  A. M. Pertew, H. J. Marquez, and Q. Zhao. observer design for Lipschitz nonlinear systems. IEEE Transactions on Automatic Control, 51(7):1211–1216, 2006.
-  Youyi Wang, Lihua Xie, and Carlos E. de Souza. Robust control of a class of uncertain nonlinear systems. Systems and Control Letters, 19(2):139–149, 1992.
-  S. Xu and J. Lam. On filtering for a class of uncertain nonlinear neutral systems. Circuits, Systems, and Signal Processing, 23(3):215–230, 2004.
-  Shengyuan Xu. Robust filtering for a class of discrete-time uncertain nonlinear systems with state delay. IEEE Transactions on Circuits and Systems I: Fundamental Theory and Applications, 49(12):1853 – 1859, 2002.
-  Shengyuan Xu and Paul Van Dooren. Robust filtering for a class of non-linear systems with state delay and parameter uncertainty. International Journal of Control, 75(10):766–774, 2002.
-  C. Yung, Y. Li, and H. Sheu. filtering and solution bound for non-linear systems. International Journal of Control, 74(6):565–570, 2001.