Proof of Control of a UAV and a UGV Cooperating to Manipulate an Object
Abstract
This paper focuses on the control of a system composed of an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV) which cooperate to manipulate an object. The two units are subject to actuator saturations and cooperate to move the object to a desired pose, characterized by its position and inclination. The paper proposes a control strategy where the ground vehicle is tasked to deploy the object to a certain position, whereas the aerial vehicle adjusts its inclination. The ground vehicle is governed by a saturated proportionalderivative control law. The aerial vehicle is regulated by means of a cascade control specifically designed for this problem that is able to exploit the mechanical interconnection. The stability of the overall system is proved through InputtoState Stability and Small Gain theorem arguments. To solve the problem of constraints satisfaction, a nonlinear Reference Governor scheme is implemented. Numerical simulations are provided to demonstrate the effectiveness of the proposed method.
I Introduction
The use of Unmanned Aerial Vehicles (UAVs) as aerial manipulators has recently drawn the attention of several researchers around the world [1, 2, 3, 4, 5, 6, 7, 8, 9]. Early experiments conducted in controlled lab environments have demonstrated the transportation (control of the position) [1, 2, 3, 4] and manipulation (control of the position and orientation) [5, 7, 6, 8, 9] of objects through UAVs.
Most of the works on this subject concern the transportation of objects, through single and multiple UAVs, including grasping [1], hovering capture, load stability [2], and cooperative transportation [3, 4]. For what concerns the manipulation of objects through UAVs, only a few preliminary works have been proposed. These works include the manipulation of objects through a team of UAVs [5] or through a single UAV equipped with robotic arms [7]. In [6], a triangular object suspended by cables is manipulated through three UAVs.
The physical interaction between UAVs and Unmanned Ground Vehicles (UGVs) has recently attracted some interest and represents a relatively young research topic. Early works on the subject include the pulling of a cart through one or two quadrotors [10], the cooperative pose stabilization of a UAV through a team of ground robots [11], and the modeling [12] and control [13, 14] of tethered UAVs.
This paper proposes a control framework for the manipulation of an object through a heterogeneous team consisting of a UAV cooperating with a UGV. Both vehicles are subject to actuator saturations. The idea of manipulating objects using a team of autonomous aerial and ground vehicles is, at the best of the authors’ knowledge, new, and has potential applications in the world of Autonomous Robotic Construction (ARC) [15, 16, 17, 18, 19] as it could allow UAVs to collaborate with ground vehicles to build structures in humandenied environments by helping them positioning beams and bars.
The paper is organized as follows. First, the equations of motion of the UGVobjectUAV system are derived using the EulerLagrange approach. Then, the attainable configurations of equilibrium of the system are discussed taking into account the saturations of the actuators. Afterwards, a decentralized control architecture is proposed, where the stability of the system is proved through InputtoState Stability and Small Gain arguments. In order to ensure constraints satisfaction, the control law is augmented with a nonlinear Reference Governor [20, 21]. Numerical simulations are provided to demonstrate the effectiveness of the proposed solution.
Ii Notations
Definition 1.
The saturation function is defined as
(1) 
where .
Definition 2.
The positive saturation function is defined as
(2) 
where .
Iii Problem Statement
Consider the planar model of a UGV and of a quadrotor UAV manipulating a rigid body as depicted in Fig. 1. It is assumed that the joints between the bodies are ideal and the center of mass of the UAV coincides with the joint position.
The UAV has mass and moment of inertia . The UGV has mass . The object has mass , moment of inertia , and length . Its center of mass is at distance from the UGV. Let the position of the cart , the inclination of the object , and the attitude of the UAV be the generalized coordinates of the system. All the angles are defined with respect to the horizon.
The bodies are subject to the gravity acceleration . The UAV propellers generate a total thrust and a resultant torque . The UGV motors produce a force . The signs of , and are defined positive with respect to the oriented vectors depicted in Fig. 1. The saturations of , and are
(3) 
where .
To derive the equations of motion, the EulerLagrange method is used. To this end, consider the kinetic and potential energies of the system and , respectively, which are
Assuming friction forces negligible, the principle of the least action can be used, where is the Langrangian, are the generalized coordinates, and the external forces acting on the system. The equations of motion of the system are
(4) 
where is the total mass of the system, the apparent mass of the UAV and the object, and the moment of inertia of the system divided by the length of the object . For the sake of simplicity, it is assumed that and so that the effect of the UAV dynamics on the UGV can be neglected. Consequently, the system becomes
(5) 
The objective of this paper is to control the pose of the object to a desired angle and position . To this end, the first step is to analyze the attainable configurations of equilibrium considering the saturations of the actuators.
Iv Attainable Configurations of Equilibrium
In this section, the attainable configurations of equilibrium and the associated steady state input vector are discussed taking into account the saturations of the UAV. Setting all the time derivatives of (5) to zero, it follows that the configurations of equilibrium must satisfy the system of equations
(6) 
Clearly, the first two equations of (6) give and as the only input associated to an equilibrium. Moreover, any is an attainable point of equilibrium since does not appear in (6). For what concerns the last equation of (6), due to the saturation (3) of , the magnitude of is maximal when
(7) 
Accordingly, there are two possible cases.

If , any is an attainable angle of equilibrium for the object.

If , the attainable angles of equilibrium are restricted to the interval , the boundaries of which are
(8)
Finally note that, for a given steadystate angle , the attainable equilibria for the attitude are restricted to the interval . The boundaries of this interval can be computed solving (6) with and are
(9) 
V Control Architecture
The proposed control architecture consists of two separate control units in charge of governing the UGV and the UAV. The UGV control loop generates a control input such that asymptotically tends to . The UAV control loop is tasked to regulate the inclination of the transported object. The proposed UAV controller uses a cascade control approach, where the inner loop controls the UAV attitude and the outer loop controls the inclination of the object. The overall asymptotic stability of the system is proved assuming a ProportionalDerivative (PD) controller for the UAV attitude.
For constraints satisfaction, a nonlinear Reference Governor (RG) is added to the scheme. Whenever necessary, the RG modifies the references to ensure the nonviolation of the constraints. The complete control architecture is depicted in Fig. 2. The design of the controllers are detailed in the next sections.
Vi UGV Control
The objective of the UGV control loop is to steer the UGV to a desired position . To this end, the nested saturated PD control law
(10) 
is proposed, where are the parameters to be tuned and are the saturation functions (cf. Definition 1). The choice of ensures the satisfaction of the saturation constraint on . The following Lemma summarizes the main properties of this control law.
Lemma 1.
Consider the UGV in (5) controlled by the saturated PD (10).

The closed loop system is Globally Asymptotically Stable (GAS) for any desired point of equilibrium and for any , , and

The acceleration is bounded by and, for a constant desired point of equilibrium , vanishing in time, i.e. .
Proof.
The proof can be found in Lemma 1 of [22]. ∎
Vii UAV Control
The objective of the UAV control loop is to ensure that . To this end, a cascade strategy approach is proposed, where the outer loop controller (see Fig. 2) is firstly designed, assuming the inner loop ideal. Then, the stability of the system is proved using a PD for the inner control loop.
Viia Ideal Attitude Dynamics
Given a desired UAV attitude , assume for the moment that the attitude dynamics is ideal, and therefore at each instant . As a consequence, the second equation of (5) becomes
(11) 
where is the desired relative attitude of the UAV and the external disturbance induced by the UGV. Define the tangential force induced by the UAV
(12) 
Eq. (11) becomes
(13) 
can be used as an input to control the dynamics of . The proposed control law is a PD with gravity compensation
(14) 
where are the parameters to be tuned. Eq. (13) controlled by (14) is
which is a linear system and is therefore InputtoState Stable (ISS) with respect to the disturbance for any and . Since is bounded and asymptotically tending to zero (Lemma 1), in absence of attitude dynamics.
At this point, it remains to determine a couple and which produces the tangential force . In line of principle, Eq. (12) admits an infinite number of solutions. Rewriting (12) in the form
(15) 
the following continuous mapping is proposed in this paper
(16) 
where is the saturation function limiting the variable to , and are parameters to be chosen such that thrust constraints are satisfied. Note that this mapping always guarantees the positiveness of . In fact, both and are odd and monotonically increasing functions. In view of (15), the quotient of two odd and monotonically increasing functions is always positive. Remark also that, with the mapping (16), does not present any singularities since .
To choose the parameter , the saturation (3) on must be satisfied when . It follows from (15) that, in this case, must be equal to . As a result, following from (16), must satisfy
(17) 
For what concerns the choice of , as clarified in the following Lemma, steadystate constraints are always ensured for any and therefore, can be freely chosen as a tuning parameter.
Lemma 2.
Proof.
Consider first . In view of (14), the control input at equilibrium must be
where . Define the minimum relative UAV attitude . Following from (9), is
Because of the third equation of (6), to ensure for all points of equilibrium, the inequality must be satisfied for . Choosing as in (17), the inequality
holds true for since, if restricted to , is convex and is concave (see Fig. 3). The same arguments hold true for , where with , concluding the proof.
∎
Remark 1.
For design purposes, the mapping of can be modified with to tune the response of the UAV with respect to a change of .
ViiB Presence of Attitude Dynamics
In this subsection, the system dynamics seen in the previous subsection is analyzed in the case of a nonideal attitude dynamics controlled by a PD. Define the attitude error Clearly, the error on the attitude is equal to the error on
(18) 
where . Therefore, in the presence of an attitude error, Eq. (11) becomes
(19) 
Developing the sine term, (19) becomes
(20) 
Expressing by the mapping (15), Eq.(20) becomes
(21) 
Using the control law (14) in (21), it follows that
(22) 
where
(23) 
which is the disturbance induced by the attitude error . The following Lemma states that this disturbance is bounded for any .
Lemma 3.
The disturbance is bounded and satisfies for any and any .
Proof.
The proof can be found in Appendix A. ∎
Remark 2.
It is clear that the disturbance vanishes when .
Eq. (22) is the outer loop in the presence of an attitude error, where the states are affected by the exogenous inputs and . For this system, the following result holds true.
Proposition 1.
Consider the outer loop (22) for any and and for where .

The system is ISS with restriction with respect to .

The system is ISS with restriction with respect to .

The asymptotic gain between and is finite.
Proof.
The proof can be found in Appendix B. ∎
At this point, consider the inner attitude dynamics described by the third equation of (5). To control the inner loop, a PD control law is chosen:
(24) 
where are control parameters to be tuned. The attitude error dynamics becomes
(25) 
System (25) is the inner loop, where the states are affected by the exogenous input . The following result can be proved.
Proposition 2.
The inner loop system (25) is ISS with respect to for any and . The asymptotic gain between the disturbance and the output is finite and can be made arbitrarily small for sufficiently large and
Proof.
The proof can be found in Appendix C. ∎
Using ISS and Small Gain arguments, it is possible to prove the asymptotic stability of the overall system.
Proposition 3.
Consider (5) controlled by (10), (14)(16) and (24). Given a desired position a desired inclination and the resulting steadystate attitude , the point of equilibrium is asymptotically stable for suitably large and in absence of the saturations (3) for any initial condition satisfying
(26) 
Proof.
From Propositions 1 and 2, and are proven to be finite. Since can be made arbitrarily small with sufficiently large and , the product can be made smaller than one at all times if the initial condition satisfies (26) since, in this case, the supremum norm of satisfies . Therefore, the Small Gain Theorem applies and the closed loop system is ISS with respect to the UGV acceleration . Since for a constant reference this acceleration tends to zero, asymptotic stability follows. ∎
The previous Proposition proves that the system is asymptotically stable in absence of the saturations (3) for all the points of equilibrium, i.e. for any and . In the presence of the saturations (3), it can be proved that all the previous stability results remain valid for , where is arbitrarily small.
Corollary 1.
Interestingly enough, it is possible to improve this control law by substituting (15) with
(27) 
where is the positive saturation function limiting the thrust to (cf. Definition 2). The following Proposition proves that the new control law (27) improves (15) and that the system is still asymptotically stable.
Proposition 4.
Consider (5) controlled by (10),(14),(16),(24) and (27). For and , the point of equilibrium is asymptotically stable, where the initial condition satisfies (26). Moreover, the control law (27) is equivalent to a feedforward that reduces the gain of the inner loop by delivering a smaller attitude error to the outer loop, i.e. an attitude error that satisfies .
Proof.
The proof can be found in Appendix D. ∎
In the next section, the control scheme will be improved by making use of the nonlinear Reference Governor (RG). In fact, the system can be made asymptotically stable for a larger set of initial conditions by enforcing the constraints with the RG.
Viii Constraints Enforcement
In this section, the control law studied in the previous section will be augmented with the nonlinear RG introduced in [20] to avoid constraints violation. The RG can be summarized as follows. Let the desired position and angle references be given, where and an arbitrary (small) positive scalar. If needed, the RG substitutes the desired setpoint with a sequence of applied waypoints which do not make the system violate the constraints. This sequence is computed online as follows. Assume that at time , the applied reference , if maintained constant, would not violate the constraints. The RG computes (at fixed time intervals) the next applied reference
(28) 
by maximizing the scalar under the condition that if is kept constant, the system would not violate constraints at any future time instant. The optimization of can be performed using bisection [20] and online simulations over a sufficiently long prediction horizon. The convexity of the steadystate admissible equilibria ensures that the waypoint sequence converges to .
Ix Simulations
Consider a UAV of mass and of inertia , cooperating with a UGV of mass to manipulate an object of mass and of inertia . The saturations of the actuators are , and . The system is controlled using (10), (14)(16) and (24), with , , , , , , and . The initial condition of the system is and the desired references for the object are and . Fig. 4 depicts the evolution of the states and of the inputs , and . It is seen that the states are converging to the desired references and that the UAV thrust input does not violate the constraint on the thrust positiveness.
Finally, consider the evolution of the system for the desired reference . For the initial condition , the system is unstable because the overshoot of violates the constraints (see first subplot of Fig. 5 (reddashed lines)). In fact, the object goes beyond the constraints and falls down to since the system cannot recover anymore. This is why, to enforce the constraints and make the system asymptotically stable, the RG (28) is implemented with a sampling time of [s] (see Fig. 5 (blue continuous line)).
X Conclusions
The paper introduces a control strategy where a UAV and a UGV collaborate to manipulate an object. In particular, a scheme is proposed where the UGV is in charge of the position of the object and the UAV of its inclination. The stability of this scheme is proved through InputtoState Stability and Small Gain theorem arguments. To ensure constraints satisfaction, a nonlinear Reference Governor is added to the control scheme. Numerical simulations show the effectiveness of the proposed control strategy. Future works will aim at extending the results of this paper to the threedimensional case.
References
 [1] P. E. Pounds, D. R. Bersak, and A. M. Dollar, “The yale aerial manipulator: grasping in flight,” in Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 2011, pp. 2974–2975.
 [2] M. M. Nicotra, E. Garone, R. Naldi, and L. Marconi, “Nested saturation control of an uav carrying a suspended load,” in American Control Conference (ACC), 2014. IEEE, 2014, pp. 3585–3590.
 [3] I. Maza, K. Kondak, M. Bernard, and A. Ollero, “Multiuav cooperation and control for load transportation and deployment,” Journal of Intelligent and Robotic Systems, vol. 57, no. 14, pp. 417–449, 2010.
 [4] D. Mellinger, M. Shomin, N. Michael, and V. Kumar, “Cooperative grasping and transport using multiple quadrotors,” in Distributed autonomous robotic systems. Springer, 2013, pp. 545–558.
 [5] G. Gioioso, A. Franchi, G. Salvietti, S. Scheggi, and D. Prattichizzo, “The flying hand: a formation of uavs for cooperative aerial telemanipulation,” in Robotics and Automation (ICRA), 2014 IEEE International Conference on. IEEE, 2014, pp. 4335–4341.
 [6] N. Michael, J. Fink, and V. Kumar, “Cooperative manipulation and transportation with aerial robots,” Autonomous Robots, vol. 30, no. 1, pp. 73–86, 2011.
 [7] C. M. Korpela, T. W. Danko, and P. Y. Oh, “Mmuav: Mobile manipulating unmanned aerial vehicle,” Journal of Intelligent & Robotic Systems, vol. 65, no. 14, pp. 93–101, 2012.
 [8] V. Lippiello and F. Ruggiero, “Exploiting redundancy in cartesian impedance control of uavs equipped with a robotic arm,” in Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on. IEEE, 2012, pp. 3768–3773.
 [9] G. Arleo, F. Caccavale, G. Muscio, and F. Pierri, “Control of quadrotor aerial vehicles equipped with a robotic arm,” in Control & Automation (MED), 2013 21st Mediterranean Conference on. IEEE, 2013, pp. 1174–1180.
 [10] M. B. Srikanth, A. Soto, A. Annaswamy, E. Lavretsky, and J.J. Slotine, “Controlled manipulation with multiple quadrotors,” in AIAA Conf. on Guidance, Navigation and Control, 2011.
 [11] R. Naldi, A. Gasparri, and E. Garone, “Cooperative pose stabilization of an aerial vehicle through physical interaction with a team of ground robots,” in Control Applications (CCA), 2012 IEEE International Conference on. IEEE, 2012, pp. 415–420.
 [12] F. Muttin, “Umbilical deployment modeling for tethered uav detecting oil pollution from ship,” Applied Ocean Research, vol. 33, no. 4, pp. 332–343, 2011.
 [13] M. M. Nicotra, R. Naldi, E. Garone, and A. M. Studiorum, “Taut cable control of a tethered uav,” in 19th IFAC World Congress, Cape Town, South Africa, 2014, pp. 3190–3195.
 [14] M. Tognon and A. Franchi, “Nonlinear observerbased tracking control of link stress and elevation for a tethered aerial robot using inertialonly measurements,” in 2015 IEEE Int. Conf. on Robotics & Automation.
 [15] J. Willmann, F. Augugliaro, T. Cadalbert, R. D’Andrea, F. Gramazio, and M. Kohler, “Aerial robotic construction towards a new field of architectural research,” International journal of architectural computing, vol. 10, no. 3, pp. 439–460, 2012.
 [16] F. Augugliaro, S. Lupashin, M. Hamer, C. Male, M. Hehn, M. W. Mueller, J. S. Willmann, F. Gramazio, M. Kohler, and R. D’Andrea, “The flight assembled architecture installation: Cooperative construction with flying machines,” Control Systems, IEEE, vol. 34, no. 4, pp. 46–64, 2014.
 [17] F. Augugliaro, A. Mirjan, F. Gramazio, M. Kohler, and R. D’Andrea, “Building tensile structures with flying machines,” in Intelligent Robots and Systems (IROS), 2013 IEEE/RSJ International Conference on. IEEE, 2013, pp. 3487–3492.
 [18] A. Mirjan, F. Gramazio, M. Kohler, F. Augugliaro, and R. DâAndrea, “Architectural fabrication of tensile structures with flying machines,” Green Design, Materials and Manufacturing Processes, 2013.
 [19] Q. Lindsey, D. Mellinger, and V. Kumar, “Construction of cubic structures with quadrotor teams,” Proc. Robotics: Science & Systems VII, 2011.
 [20] A. Bemporad, “Reference governor for constrained nonlinear systems,” Automatic Control, IEEE Transactions on, vol. 43, no. 3, pp. 415–419, 1998.
 [21] I. Kolmanovsky, E. Garone, and S. Di Cairano, “Reference and command governors: A tutorial on their theory and automotive applications,” in American Control Conference (ACC), 2014. IEEE, 2014, pp. 226–241.
 [22] L. Marconi and A. Isidori, “Robust global stabilization of a class of uncertain feedforward nonlinear systems,” Systems & control letters, vol. 41, no. 4, pp. 281–290, 2000.
Appendix A Proof of Lemma 3
Following from the Triangular Inequality, Eq. (23) is bounded by
(29) 
First, note that the term is clearly bounded by . For what concerns the term in (29), following from (15) and (16), is
(30) 
For , due to the saturation , since . As for restricted to , it is easy to see that (30) is continuous as the only potential singularity admits a finite limit, which is
(31) 
Since is continuous and differentiable in the closed interval , the possible extrema of (30) can be found at the boundaries and at the stationary points, where . In fact, the only point where is . Therefore, since and , (30) reaches its maximum when . In particular, since is strictly decreasing for , the maximum of is . Consequently, for any and for any .
Appendix B Proof of Proposition 1
Definition 3.
A function is of class if it is continuous, positive definite, strictly increasing, and unbounded.
Define the object inclination error and the state . Consider
(32) 
where , , and ). Define as a Lyapunov function
(33) 
where . The square matrix in (33) is clearly positive definite and, by substituting (32) in (33), the derivative of is
(34)  
where . can be bounded by
(35) 
where and . To ensure that is positive definite, the inequality
(36) 
must be imposed. To simplify the computations, let us denote and . Substituting for in (36), the inequality becomes
(37) 
In view of (35) and (37), given , there exists and such that the Lyapunov function is strictly decreasing for . To prove ISS, it is sufficient to note that
(38) 
where
and is the lowest eigenvalue of the positive defiô°nite matrix Q. As a result,
(39) 
implies , thus proving ISS with restriction with respect to . Since the system is ISS with restriction with respect to , it follows ISS with restriction with respect to and .
To prove that the system is ISS with restriction with respect to , it is enough to find a gain between and that is a function of class . In fact, following from Lemma 3, the disturbance is bounded by
(40) 
The second member of the inequality is bounded by
(41) 
where is a function of class . As a consequence, since the gain between and is a function of class and the system is ISS with restriction with respect to , the system is also ISS with restriction with respect to (cf. Eq. (18)).
It remains to prove that the gain between and exists and is finite. The derivative of is
(42) 
Since System (22) is ISS with restriction with respect to , it follows that and , where is a function of class . Consequently, the acceleration of the object in (22) is also bounded and thus
(43) 
where is a function of class . The derivative of (16) is
Since , the inequality
holds true. Expressing the time derivative of , it can be said that
(44) 
where . Therefore, is bounded with respect to in view of (42), (43) and (44). Consequently, there exists a finite asymptotic gain between the disturbance and the output .
Appendix C Proof of Proposition 2
Since (25) is linear and asymptotically stable for any and it is also ISS and the asymptotic gain is the norm between and To prove that this gain can be made arbitrarily small, consider the parameter choice and with It results that the impulsive response between and is
By the definition of the norm, the gain