Global Consensus of Multi-Agent Systems with
Lipschitz Nonlinear Dynamics
Zhongkui Li, Xiangdong Liu, Mengyin Fu, Lihua Xie
Abstract: This paper addresses the global consensus problems of a class of nonlinear multi-agent systems with Lipschitz nonlinearity and directed communication graphs, by using a distributed consensus protocol based on the relative states of neighboring agents. A two-step algorithm is presented to construct a protocol, under which a Lipschitz multi-agent system without disturbances can reach global consensus for a strongly connected directed communication graph. Another algorithm is then given to design a protocol which can achieve global consensus with a guaranteed performance for a Lipschitz multi-agent system subject to external disturbances. The case with a leader-follower communication graph is also discussed. Finally, the effectiveness of the theoretical results is demonstrated through a network of single-link manipulators.
Keywords: Multi-agent system, global consensus, Lipschitz nonlinearity, control.
In recent years, consensus control of multi-agent systems has been an emerging topic in the systems and control community and has been extensively studied by numerous researchers from various perspectives, due to its potential applications in such broad areas as satellite formation flying, sensor networks, surveillance and reconnaissance [1, 2]. A theoretical explanation is provided in  for the behavior observed in the Vicsek Model  by using graph theory. A general framework of the consensus problem for networks of dynamic agents with fixed and switching topologies is addressed in . The conditions given by [3, 5] are further relaxed in . The controlled agreement problem for multi-agent networks is considered from a graph-theoretic perspective in . Distributed consensus and control problems are investigated in [8, 9] for networks of agents subject to external disturbances. Sampled-data control protocols are proposed to achieve consensus for fixed and switching agent networks in [10, 11]. The consensus problem of networks of second- and high-order integrator agents is studied in [12, 13, 14]. Different static and dynamic consensus protocols are proposed in [15, 16, 17, 18] for multi-agent systems with general linear dynamics. In the aforementioned works, the agent dynamics are restricted to be linear, where in some cases are simple integrators.
Recently, the consensus problems in networks with nonlinear dynamics have been studied in [19, 20, 21, 22, 23]. Specifically, a passivity-based design framework is proposed in  to deal with the group coordination problem with undirected communication graphs.  studies the global leader-follower consensus of coupled Lur’e systems with certain sector-bound nonlinearity, where the subgraph associated with the followers is required to be undirected. Neural adaptive tracking control of first-order nonlinear systems with unknown dynamics is investigated in . The global consensus problems with and without a leader are addressed in [21, 22] for second-order multi-agent systems with Lipschitz nonlinearity.
In this paper, we extend to consider the global consensus problems of high-order multi-agent systems with Lipschitz nonlinearity and directed communication graphs. A distributed consensus protocol is proposed, based on the relative states of neighboring agents. A two-step algorithm is presented to construct a protocol, under which a Lipschitz multi-agent system without disturbances can reach global consensus for a strongly connected directed communication graph. For the case where the agents are subject to external disturbances, another algorithm is then given to design a protocol which achieves global consensus with a guaranteed performance for a strongly connected balanced communication graph. It is worth mentioning that in these two algorithms the feedback gain design of the consensus protocol is decoupled from the communication graph. Finally, we further extend the results to the case with a leader-follower communication graph which contains a directed spanning tree with the leader as the root. Compared to , the requirement for the communication graph is much relaxed in this paper. Contrary to [21, 22] where the agent dynamics are restricted to be second-order, the results derived in the current paper are applicable to any high-order Lipschitz nonlinear multi-agent system and the global consensus problem is also studied here.
The rest of this paper is organized as follows. Some basic notation and useful results of the graph theory are reviewed in Section 2. The global consensus problem of multi-agent systems without disturbances is considered in Section 3. The global consensus problem for agents subject to external disturbances is investigated in Section 4. Extensions to the case with a leader-follower graph are discussed in Section 5. A network of single-link manipulators is utilized in Section 6 to illustrate the analytical results. Conclusions are drawn in Section 7.
2 Concepts and Notation
Let be the set of real matrices. The superscript means the transpose for real matrices. represents the identity matrix of dimension . Matrices, if not explicitly stated, are assumed to have compatible dimensions. Denote by a column vector with all entries equal to one. refers to the Euclidean norm for vectors. represents a block-diagonal matrix with matrices on its diagonal. The matrix inequality (respectively, ) means that is positive definite (respectively, positive semidefinite). denotes the Kronecker product of matrices and . Denote by the space of square integrable functions over .
A directed graph is a pair , where is a nonempty finite set of nodes and is a set of edges, in which an edge is represented by an ordered pair of distinct nodes. For an edge , node is called the parent node, node the child node, and is a neighbor of . A graph with the property that implies is said to be undirected. A directed path from node to node is a sequence of ordered edges of the form , . A directed graph contains a directed spanning tree if there exists a node called the root, which has no parent node, such that the node has a directed path to every other node in the graph. A directed graph is strongly connected if there is a directed path from every node to every other node. A directed graph has a directed spanning tree if it is strongly connected, but not vice versa.
The adjacency matrix associated with the directed graph is defined by , if and otherwise. A directed graph is balanced if for all . The Laplacian matrix is defined as and , . For an undirected graph, both and are symmetric.
Lemma 1 [5, 6]. Zero is an eigenvalue of with as a right eigenvector and all other eigenvalues have positive real parts. Furthermore, zero is a simple eigenvalue of if and only if the graph has a directed spanning tree.
Lemma 3 . For a strongly connected graph with Laplacian matrix , define its generalized algebraic connectivity as , where and are defined as in Lemma 2. Then, . For balanced graphs, , where denotes the smallest nonzero eigenvalue of .
3 Global Consensus without Disturbances
Consider a group of identical nonlinear agents, described by
where , are the state and the control input of the -th agent, respectively, , , , are constant matrices with compatible dimensions, and the nonlinear function is assumed to satisfy the Lipschitz condition with a Lipschitz constant , i.e.,
The communication graph among the agents is represented by a directed graph . It is supposed that each agent has access to the relative states with respect to its neighbors. In order to achieve consensus, the following distributed consensus protocol is proposed:
where denotes the coupling strength, is the feedback gain matrix, and is the adjacency matrix associated with .
Let be the left eigenvector of associated with the zero eigenvalue, satisfying and , . Define and . Then, we get
where . Clearly, satisfies , i.e., .
By the definition of , it is easy to see that is a simple eigenvalue of with as a right eigenvector, and 1 is the other eigenvalue with multiplicity . Then, it follows from (4) that if and only if . Therefore, the consensus problem under the protocol (3) can be reduced to the asymptotical stability of . Using (3) for (1), it can be verified that satisfies the following dynamics:
where is the Laplacian matrix associated with .
Next, an algorithm is presented to select the control parameters in (3).
Solve the following LMI:
to get a matrix and a scalar . Then, choose .
Select the coupling strength , where is the generalized algebraic connectivity of , defined as in Lemma 3.
The following presents a sufficient condition for the global consensus of (5).
Theorem 1. Assume that the directed graph is strongly connected and there exists a solution to (6). Then, the agents in (1) can reach global consensus under the protocol (3) constructed by Algorithm 1.
Proof. Consider the Lyapunov function candidate
Using the Lipschitz condition (2) gives
Since , we have
Since , i.e., , we can get from Lemma 3 that
By steps 1) and 2) in Algorithm 1, we can obtain that
where the last inequality follows from (6) by using the Schur complement lemma . Therefore, it follows from (12) that , implying that , as . That is, the global consensus of network (5) is achieved.
Remark 1. Theorem 1 converts the global consensus of the Lipschitz agents in (1) under the protocol (3) to the feasibility of a low-dimensional linear matrix inequality. The effects of the communication topology on the stability of consensus are characterized by the generalized algebraic connectivity of the corresponding Laplacian matrix . It is worth mentioning that global consensus problems of multi-agent systems with Lipschitz nonlinearity were also considered in [21, 22]. However, the agent dynamics are restricted to be second-order there. By contrast, The results given in this section are applicable to any high-order Lipschitz nonlinear multi-agent system.
Remark 2. By using Finsler’s Lemma , it is not difficult to get that there exist a and a such that (6) holds if and only if there exists a such that , which with is dual to the observer design problem for a single Lipschitz system in . Hence, the sufficient condition for the existence of the observer for a Lipschitz system in [27, 28] can be used to check the solvability of the LMI (6).
Remark 3. It is worth noting that Algorithm 1 has a favorable decoupling feature. Specifically, the first step deals only with the agent dynamics in (1) while the second step tackles the communication graph by adjusting the coupling strength . The generalized algebraic connectivity for a given graph can be obtained by using Lemma 8 in . For a large-scale graph, for which might be not easy to compute, we can simply choose the coupling strength to be large enough. According to Lemma 3, can be replaced by in step 2), if the directed graph is balanced and strongly connected.
4 Global Consensus with Disturbances
This section continues to consider a network of identical nonlinear agents subject to external disturbances, described by
where is the state of the -th agent, is the control input, is the external disturbance, and is a nonlinear function satisfying (2). The communication graph is assumed to balanced and strongly connected in this section.
The objective in this section is to design a protocol (3) for the agents in (14) to reach global consensus and meanwhile maintain a desirable disturbance rejection performance. To this end, define the performance variable , , as the average of the weighted relative states of the agents:
where and is a constant matrix.
The network (16) with can reach global consensus in the sense of .
Under the zero-initial condition, the performance variable satisfies
Next, an algorithm for the protocol (3) is presented.
Solve the following LMI:
to get a matrix and a scalar . Then, choose .
Select the coupling strength , where denotes the smallest nonzero eigenvalue of .
Theorem 2. Assume that is balanced and strongly connected, and there exists a solution to (18). Then, the protocol (3) constructed by Algorithm 2 can achieve global consensus with a guaranteed performance for the agents in (14).
Proof. Let , and . As shown in the last section, we know that if and only if . From (16), it is easy to get that satisfies the following dynamics:
Consider the Lyapunov function candidate
By following similar steps to those in Theorem 1, we can obtain the time derivative of along the trajectory of (19) as
where , , and
Next, for any nonzero , we have
By noting that and are the right and left eigenvectors of associated with the zero eigenvalue, respectively, we have
Thus there exists a unitary matrix such that and are both diagonal . Since and have the same right and left eigenvectors corresponding to the zero eigenvalue, namely, and , we can choose , with , , satisfying
where , , are the nonzero eigenvalues of . Let . Clearly, . By using (22), we can obtain that
In light of steps 1) and 2) in Algorithm 2, we have
By comparing Algorithm 2 with Algorithm 1, it follows from Theorem 1 that the first condition in Definition 1 holds. Since , it is clear that . Considering (23) and (24), we can obtain from (21) that . Therefore, the global consensus problem is solved.
Remark 4. Theorem 2 and Algorithm 2 extend Theorem 1 and Algorithm 1 to evaluate the performance of a multi-agent network subject to external disturbances. The decoupling property of Algorithm 1 as stated in Remark 3 still holds for Algorithm 2.
In the above sections, the communication graph is assumed to be strongly connected, where the final consensus value reached by the agents is generally not explicitly known. In many practical cases, it is desirable that the agents’ states asymptotically approach a reference state. In this section, we extend to consider the case where a network of agents in (1) maintains a leader-follower communication graph . An agent is called a leader if the agent has no neighbor, i.e., it does not receive any information. An agent is called a follower if the agent has at least one neighbor. Without loss of generality, assume that the agent indexed by 1 is the leader and the rest agents are followers. The following distributed consensus protocol is proposed for each follower:
where , , are the same as defined in (3).
The objective in this section is to solve the leader-follower global consensus problem, i.e., to design a consensus protocol (25) under which the states of the followers asymptotically approach the state of the leader in the sense of , .
In the sequel, we make the following assumption.
Assumption 1. The communication graph contains a directed spanning tree with the leader as the root.
Because the leader has no neighbors, the Laplacian matrix associated with can be partitioned as
where and . Under Assumption 1, it follows from Lemma 1 that all the eigenvalues of have positive real parts.
Solve the following LMI:
to get a matrix and a scalar . Then, choose .
Select the coupling strength , with being the the smallest eigenvalue of , where and are defined in (27).
Remark 5. For the case where the subgraph associated with the followers is balanced and strongly connected, . Then, by letting , step 2) can be simplified to .
Theorem 3. Suppose that Assumption 1 holds and there exists a solution to (6). Then, the consensus protocol (25) given by Algorithm 3 solves the leader-follower global consensus problem for the agents described by (1).
Clearly, the leader-follower global consensus problem can be reduced to the asymptotical stability of (28).
Consider the Lyapunov function candidate
Since and are positive definite, we can get that if , which is true in light of step 2) in Algorithm 3. Thus, . Then, it follows from (13) and (29) that , implying that (28) is asymptotically stable. This completes the proof.
The global consensus for the agents in (14) with a leader-follower communication graph can be discussed similarly, thereby is omitted here for brevity.
6 Simulation Examples
In this section, a simulation example is provided to validate the effectiveness of the theoretical results.
Clearly, here satisfies (2) with a Lipschitz constant . The external disturbance here is , where is a one-period square wave starting at with width 2 and height 1.
Choose the performance index . Solving the LMI (18) by using the LMI toolbox of Matlab gives a feasible solution:
Thus, by Algorithm 2, the feedback gain matrix of (3) is chosen as
For illustration, let the communication graph be given as in Fig. 1. It is easy to verify that is balanced and strongly connected. The corresponding Laplacian matrix is
The smallest nonzero eigenvalue of is equal to 0.8139. By Theorem 2 and Algorithm 2, the protocol (3) with chosen as above achieves global consensus with a performance , if the coupling strength . For the case without disturbances, the state trajectories of the six manipulators under the protocol (3) with given as above and are depicted in Fig. 2, from which it can be observed that the global consensus is indeed achieved. With the zero-initial condition and external disturbances , the trajectories of the performance variables , , are shown in Fig. 3.
This paper has considered the global consensus problems of a class of nonlinear multi-agent systems with Lipschitz nonlinearity and directed communication graphs. A two-step algorithm has been presented to construct a relative-state consensus protocol, under which a Lipschitz multi-agent system without disturbances can reach global consensus for a strongly connected directed communication graph. Another algorithm has been then given to design a protocol which can achieve global consensus with a guaranteed performance for a Lipschitz multi-agent system subject to external disturbances. An interesting topic for future research is to investigate the cooperative control problems of other types of nonlinear multi-agent systems.
- Zhongkui Li, Xiangdong Liu and Mengyin Fu are with the School of Automation, Beijing Institute of Technology, Beijing 100081, P. R. China (e-mail: firstname.lastname@example.org). Lihua Xie is with the School of Electrical and Electronic Engineering, Nanyang Technological University, 639798, Singapore (e-mail: email@example.com).
- R. Olfati-Saber, J. Fax, and R. Murray, “Consensus and cooperation in networked multi-agent systems,” Proceedings of the IEEE, vol. 95, no. 1, pp. 215–233, 2007.
- W. Ren, R. Beard, and E. Atkins, “Information consensus in multivehicle cooperative control,” IEEE Control Systems Magazine, vol. 27, no. 2, pp. 71–82, 2007.
- A. Jadbabaie, J. Lin, and A. Morse, “Coordination of groups of mobile autonomous agents using nearest neighbor rules,” IEEE Transactions on Automatic Control, vol. 48, no. 6, pp. 988–1001, 2003.
- T. Vicsek, A. Czirók, E. Ben-Jacob, I. Cohen, and O. Shochet, “Novel type of phase transition in a system of self-driven particles,” Physical Review Letters, vol. 75, no. 6, pp. 1226–1229, 1995.
- R. Olfati-Saber and R. Murray, “Consensus problems in networks of agents with switching topology and time-delays,” IEEE Transactions on Automatic Control, vol. 49, no. 9, pp. 1520–1533, 2004.
- W. Ren and R. Beard, “Consensus seeking in multiagent systems under dynamically changing interaction topologies,” IEEE Transactions on Automatic Control, vol. 50, no. 5, pp. 655–661, 2005.
- A. Rahmani, M. Ji, M. Mesbahi, and M. Egerstedt, “Controllability of multi-agent systems from a graph-theoretic perspective,” SIAM Journal on Control and Optimization, vol. 48, no. 1, pp. 162–186, 2009.
- P. Lin and Y. Jia, “Distributed robust consensus control in directed networks of agents with time-delay,” Systems and Control Letters, vol. 57, no. 8, pp. 643–653, 2008.
- Z. Li, Z. Duan, and G. Chen, “On and performance regions of multi-agent systems,” Automatica, vol. 47, no. 4, pp. 797–803, 2011.
- Y. Cao and W. Ren, “Sampled-data discrete-time coordination algorithms for double-integrator dynamics under dynamic directed interaction,” International Journal of Control, vol. 83, no. 3, pp. 506–515, 2010.
- Y. Gao, L. Wang, G. Xie, and B. Wu, “Consensus of multi-agent systems based on sampled-data control,” International Journal of Control, vol. 82, no. 12, pp. 2193–2205, 2009.
- W. Ren, “On consensus algorithms for double-integrator dynamics,” IEEE Transactions on Automatic Control, vol. 53, no. 6, pp. 1503–1509, 2008.
- P. Lin and Y. Jia, “Further results on decentralised coordination in networks of agents with second-order dynamics,” IET Control Theory and Applications, vol. 3, no. 7, pp. 957–970, 2009.
- W. Ren, K. Moore, and Y. Chen, “High-order and model reference consensus algorithms in cooperative control of multivehicle systems,” ASME Journal of Dynamic Systems, Measurement, and Control, vol. 129, no. 5, pp. 678–688, 2007.
- Z. Li, Z. Duan, G. Chen, and L. Huang, “Consensus of multiagent systems and synchronization of complex networks: A unified viewpoint,” IEEE Transactions on Circuits and Systems I: Regular Papers, vol. 57, no. 1, pp. 213–224, 2010.
- Z. Li, Z. Duan, and G. Chen, “Dynamic consensus of linear multi-agent systems,” IET Control Theory and Applications, vol. 5, no. 1, pp. 19–28, 2011.
- L. Scardovi and R. Sepulchre, “Synchronization in networks of identical linear systems,” Automatica, vol. 45, no. 11, pp. 2557–2562, 2009.
- J. Seo, H. Shim, and J. Back, “Consensus of high-order linear systems using dynamic output feedback compensator: Low gain approach,” Automatica, vol. 45, no. 11, pp. 2659–2664, 2009.
- M. Arcak, “Passivity as a design tool for group coordination,” IEEE Transactions on Automatic Control, vol. 52, no. 8, pp. 1380–1390, 2007.
- A. Das and F. Lewis, “Distributed adaptive control for synchronization of unknown nonlinear networked systems,” Automatica, vol. 46, no. 12, pp. 2014–2021, 2010.
- W. Yu, G. Chen, M. Cao, and J. Kurths, “Second-order consensus for multiagent systems with directed topologies and nonlinear dynamics,” IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics, vol. 40, no. 3, pp. 881–891, 2010.
- Q. Song, J. Cao, and W. Yu, “Second-order leader-following consensus of nonlinear multi-agent systems via pinning control,” Systems and Control Letters, vol. 59, no. 9, pp. 553–562, 2010.
- Z. Li, Z. Duan, and G. Chen, “Global synchronised regions of linearly coupled lur’e systems,” Internatinal Journal of Control, vol. 84, no. 2, pp. 216–227, 2011.
- Z. Qu, Cooperative Control of Dynamical Systems: Applications to Autonomous Vehicles. London, UK: Spinger-Verlag, 2009.
- S. Boyd, L. El Ghaoui, E. Feron, and V. Balakrishnan, Linear Matrix Inequalities in System and Control Theory. Philadelphia, PA: SIAM, 1994.
- T. Iwasaki and R. Skelton, “All controllers for the general control problem: LMI existence conditions and state space formulas,” Automatica, vol. 30, no. 8, pp. 1307–1317, 1994.
- R. Rajamani, “Observers for Lipschitz nonlinear systems,” IEEE Transactions on Automatic Control, vol. 43, no. 3, pp. 397–401, 1998.
- R. Rajamani and Y. Cho, “Existence and design of observers for nonlinear systems: relation to distance to unobservability,” International Journal of Control, vol. 69, no. 5, pp. 717–731, 1998.
- R. Horn and C. Johnson, Matrix Analysis. New York, NY: Cambridge University Press, 1990.
- F. Zhu and Z. Han, “A note on observers for Lipschitz nonlinear systems,” IEEE Transactions on Automatic Control, vol. 47, no. 10, pp. 1751–1754, 2002.