We present a comparison of different numerical techniques for the integration of variational equations. The methods presented can be applied to any autonomous Hamiltonian system whose kinetic energy is quadratic in the generalized momenta, and whose potential is a function of the generalized positions. We apply the various techniques to the well-known Hénon-Heiles system, and use the Smaller Alignment Index (SALI) method of chaos detection to evaluate the percentage of its chaotic orbits. The accuracy and the speed of the integration schemes in evaluating this percentage are used to investigate the numerical efficiency of the various techniques.
Integration of variational equations] Comparing the efficiency of numerical techniques for the integration of variational equations Enrico Gerlach and Charalampos Skokos] \subjclassPrimary: 37M25, 65P10; Secondary: 70H07, 37J99, 65P20. ††thanks: The first author is supported by the DFG research unit FOR584–P3.
Lohrmann Observatory, Technical University Dresden, D-01062 Dresden, Germany
Max Planck Institute for the Physics of Complex Systems
Nöthnitzer Str. 38, D-01187 Dresden, Germany
(Communicated by the associate editor name)
The determination of the stability of motion is of great importance when investigating nonlinear dynamical systems. To distinguish correctly between regular and chaotic motion, several different methods have been developed during the years. Most of these techniques, such as the maximal Lyapunov exponent , the fast Lyapunov indicator  or the Smaller Alignment Index (SALI) , rely on the study of the time evolution of deviation vectors from a given orbit to discriminate between the two regimes. The time evolution of these vectors is governed by the so-called variational equations.
Besides the correct determination of the regular or chaotic nature of individual orbits, in many cases, statistical statements over a large region of the phase space are also needed. For example, in order to determine the percentage of regular and chaotic orbits in a given system, the characterization of many orbits is required. In addition to the accurate computation of chaos indicators also for such tasks the CPU time needed to perform these computations becomes very important. In this work we compare different numerical techniques for the integration of the variational equations, concentrating on their accuracy and computational speed.
The paper is organized as follows: in section 2 we describe the general layout of our investigation. We concentrate our study on a simple two degrees of freedom Hamiltonian system: the well-known Hénon-Heiles system , which is presented in section 2.1. In our study we use the SALI method of chaos detection, which is presented in section 2.2. To solve the equations of motion of the Hénon-Heiles system and the associated variational equations one has to employ numerical methods. Any non-symplectic general-purpose integrator can be used for this task. In sections 2.3.1 and 2.3.2 we present two such techniques, which we use in our study. In  it was shown that it is also possible to use methods based on symplectic integration techniques to solve these equations. In section 2.3.3 we describe shortly the most efficient of these techniques: the so-called tangent map (TM) method. A numerical procedure to obtain relatively fast information on the nature of orbits for a large set of initial conditions is then given in section 2.4. In section 3 we present our numerical results for individual orbits, as well as global results for the whole system. The summary and the conclusions of our study are found in section 4.
2 Numerical integration of variational equations
2.1 Hénon-Heiles system
The Hamiltonian function of the Hénon-Heiles system  is
with , being the generalized coordinates and , the conjugate momenta. The orbit evolution is given by the standard Hamilton equations of motion
where the dot denotes derivation with respect to time . The time evolution of the variations (which can be considered as coordinates of a deviation vector) is governed by the variational equations, given by
Eqs. (2) and (3) form a coupled system of ordinary differential equations. It should be noted that the solution of (3) depends explicitly on the solution of (2), i. e. on the reference orbit , and thus Eq. (3) cannot be solved independently from Eq. (2).
2.2 SALI method
The evaluation of the SALI is an efficient and simple method to determine the regular or chaotic nature of orbits in dynamical systems. The SALI was proposed in  has since been successfully applied in order to distinguish between regular and chaotic motion both in symplectic maps and Hamiltonian flows [17, 18, 13, 12, 3, 11, 19]. For the computation of the SALI of a given orbit, one has to follow the time evolution of the orbit itself and also of two deviation vectors , which initially point in two different directions. Then, according to  the SALI is defined as
where denotes the usual Euclidean norm and , are normalized vectors with norm equal to 1.
The SALI has a completely different behavior for regular and chaotic orbits, and this allows us to clearly distinguish between them. In particular, the SALI fluctuates around a non-zero value for regular orbits, while it tends exponentially to zero for chaotic orbits [14, 17], following a rate which depends on the difference of the two largest Lyapunov exponents .
2.3 Used numerical methods
The DOP853 111Freely available from http://www.unige.ch/~hairer/software.html. integration method belongs to the big class of explicit Runge-Kutta methods. This non-symplectic scheme of order 8 is based on the method of Dormand and Price (see [5, Sect. II.5]). We use this integrator to solve the set of differential equations composed of Eqs. (2) and (3). Two free parameters, and , are used to control its numerical performance. The first one defines the time span between two successive outputs of the computed solution. After each step of length the deviation vectors are renormalized and the value of SALI is computed. For the duration of each step , the integrator adjusts its own internal time step in order to keep the local one-step error smaller than a user-defined threshold value . For the DOP853 integrator the estimation of this local error and the step size control is based on embedded formulas of orders 5 and 3.
2.3.2 Taylor methods
The basic idea of the so-called Taylor series methods (for details see for example [5, Sect. I.8] and references therein) is to approximate the solution at time of a given -dimensional initial value problem
from the th degree Taylor series of at as
The computation of the derivatives is commonly done using automatic differentiation (see for example ).
In our study we use two different public available implementations of the Taylor method: TIDES 222Freely available from http://gme.unizar.es/software/tides.  and TAYLOR 333Freely available from http://www.maia.ub.es/~angel/taylor/software/. . Both methods have internal automatic order and step size computation to ensure the user-defined local one-step error . Also here the parameter defines the step size, after which the renormalization of the deviation vectors and the computation of SALI is done.
The whole testbed of our work is written using the FORTRAN programming language exploiting extended double precision444Corresponding to 18 significant digits or equivalently to a machine accuracy of .. While TIDES offers directly a FORTRAN integration routine, a wrapper to include the routine written in C had to be used for TAYLOR. Therefore for the latter only 16 significant digits were available for the integration.
2.3.3 TM method
Besides general-purpose integrators, it is also possible to use techniques based on symplectic methods to integrate the Hamilton equations of motion and the corresponding variational equations. This was shown in , where a thorough discussion of possible methods can be found. The most effective of these techniques, the TM method, is used in this work. Let us outline its basic idea, which is founded on a general result stated for example in : Symplectic integrators can be applied to first order differential systems , that can be written in the form , where are differential operators defined as and for which the two systems and are integrable. Here are Poisson brackets of functions , defined as:
The set of Eqs. (2) and (3) is one example of such a system, because Hamiltonian (1) can be divided into two integrable parts and with . A symplectic integrator splits the equations of motion (2) into several parts, applying either the operator or . These are the equations of motion of the Hamiltonians and , which can be solved analytically, giving explicit mappings over the time step , where the constants are chosen to optimize the accuracy of the integrator. These mappings can then be combined to approximate the solution after time step . In  it was shown that the derivative of these mappings - with respect to the coordinates and momenta of the system (the so-called tangent maps) - can be used for the time evolution of deviation vectors or, in other words, for solving the variational equations (3). We note that the TM method is called the ‘global symplectic integrator method’ in .
In  a family of symplectic integrators called SABA and SBAB was introduced, with being the number of applications of operators and . These integrators have only positive intermediate steps and can be used with an additional corrector step at the beginning and the end of each step to increase their accuracy. An integrator of order 4 of this family, namely the SBABC integrator which includes corrector steps, is used in our investigation. A detailed description of the application of the SBABC integrator for the TM method to the Hénon-Heiles system can be found in .
2.4 Fast PSS method
Besides information on the chaotic or regular character of individual orbits, a more global description of dynamical systems is also of interest. For example, such a study could include the computation of the percentage of regular/chaotic orbits for a given set of initial conditions (ICs). This information requires the integration of the equations of motion/variational equations, and the computation of a chaos indicator for the whole set of ICs, which can become a very hard computational task. In order to address this problem, we implement a method proposed in , which exploits the Poincaré surface of section (PSS) of the system in order to speed up this computation.
For a fixed value of Hamiltonian (1) (throughout our study we use always ) we define the PSS of the system as the plane given by and . Each point in this plane defines a set of values (). To evaluate the percentage of regular orbits, one normally computes for each point the value of some chaos indicator using a dense set of points on the PSS as ICs. In Fig. 1 we consider a grid of ICs and color each one according to its SALI value at .
Each orbit starting from any IC intersects the PSS in many points, and so, its SALI value can be attributed to all orbits having these intersection points as ICs. Therefore all these ICs do not have to be integrated separately. This procedure decreases drastically the CPU time needed for the global description of the system’s chaoticity. We refer to this approach as the fast PSS method.
3 Numerical results
3.1 Individual orbits
Let us first investigate, how well the different methods described in section 2.3 can determine the nature of individual orbits. We use these methods to integrate Eqs. (2) and (3), and then we compute the evolution of the SALI in order to determine the nature of the orbit. Unless otherwise stated, we always renormalize the deviation vectors after each time step of length . For the non-symplectic routines we adopt a one-step accuracy of .
As representative examples we consider 3 orbits of the Hénon-Heiles system with different dynamical behaviors. The evolution of the SALI for a regular orbit (R1) is presented in Fig. 2, while in Fig. 3 we have similar results for a chaotic orbit (C1). Finally, in Fig. 4 the SALI of a sticky chaotic orbit (C2) is shown.
From Fig. 2 we see that the results obtained for orbit R1 by the different integration methods are nearly identical. As theory predicts a constant SALI for regular motion, such behavior is correctly identified for orbit R1. Information concerning the numerical performance of various techniques for orbit R1 is given in Table 1 (throughout this paper the reported CPU times refer to an Intel Xeon X5660, 2.80 GHz computer). From the results reported in this table, we see that differences between the applied methods appear in their energy conservation properties, as is indicated by the relative energy error , shown in Fig. 5. For the symplectic algorithm (TM method) shows fluctuations around , while it grows with time for the other methods as expected (see for example [6, Sect. IX.8]). The TAYLOR method has the worst performance since it is able to conserve the energy only up to an error level of for . This is probably due to the 2 digits less in accuracy that are available for this method (see section 2.3). The best method with respect to the energy conservation is the TIDES algorithm for which the relative error is () and () at . The price paid for the excellent accuracy of the algorithm is that TIDES requires, in general, the largest CPU times and the highest orders among the tested methods.
|integrator||method||CPU time||Relative energy error||order|
Orbit C1 is also correctly identified as chaotic by all methods in less than 1000 time units, within which SALI goes to zero (Fig. 3). A difference is found in the results for the sticky chaotic orbit C2 (Fig. 4). Up to all methods indicate a regular behavior. It is only afterwards that SALI goes to zero for the TM, the DOP853 and the TIDES methods, correctly identifying C2 as a sticky chaotic orbit. For the used values of and the TAYLOR method does not succeed to show the decrease of SALI to zero, at least up to .
3.2 Global results
In order to find the percentage of regular and chaotic orbits of the Hénon-Heiles system (1), we compute for a grid of ICs on the PSS the SALI value for different final times . One could argue that due to the finite resolution with which the grid of ICs is taken on the PSS, the fast PSS method (Sec. 2.4) would not be as accurate as the individual computation of SALI for each IC. The percentages (over the total number of ICs compatible with Hamiltonian (1)) of regular (), chaotic (), and sticky chaotic orbits () obtained by both approaches using the TM method, are shown in Fig. 6(a), while the required CPU times are reported in Fig. 6(b). From the results of Fig. 6 we see that both approaches obtain practically the same values, while the CPU time needed by the fast PSS method remains considerably smaller with respect to the full integration of individual orbits. For this reason we apply the fast PSS method for computing the percentages of regular, chaotic and sticky chaotic orbits for different values of the time step and the final time . The obtained results can be found in Table 2.
|method||% regular||% sticky chaotic||% chaotic||CPU time|
|0.50||TM||40.89||0.38||58.73||0 h 02 min|
|DOP853||40.18||0.79||59.02||0 h 04 min|
|TIDES||40.18||0.79||59.02||0 h 04 min|
|TAYLOR||40.18||0.79||59.02||0 h 05 min|
|0.50||TM||40.05||0.07||59.88||0 h 09 min|
|DOP853||39.71||0.37||59.92||0 h 14 min|
|TIDES||39.22||0.49||60.29||0 h 17 min|
|TAYLOR||40.19||0.47||59.34||0 h 15 min|
|0.50||TM||40.00||0.00||60.00||1 h 21 min|
|DOP853||36.94||2.59||60.47||1 h 29 min|
|TIDES||35.78||3.71||60.51||2 h 06 min|
|TAYLOR||34.01||6.23||59.76||1 h 15 min|
|0.01||TM||40.38||0.72||58.90||0 h 19 min|
|DOP853||40.22||0.70||59.08||0 h 38 min|
|TIDES||40.22||0.70||59.08||1 h 05 min|
|TAYLOR||40.23||0.84||58.93||0 h 59 min|
|0.01||TM||39.39||0.57||60.04||2 h 02 min|
|DOP853||39.84||0.22||59.95||4 h 12 min|
|TIDES||39.84||0.22||59.95||7 h 20 min|
|TAYLOR||39.83||0.28||59.89||6 h 43 min|
|0.01||TM||40.01||0.00||59.99||19 h 26 min|
|DOP853||40.02||0.28||59.70||39 h 42 min|
|TIDES||40.02||0.28||59.70||68 h 08 min|
|TAYLOR||39.95||0.21||59.84||62 h 32 min|
From the results of Table 2 we see that for large values of and ( and ) the non-symplectic methods find less regular orbits than the TM method. In order to understand this discrepancy we computed for orbit R1 the evolution of the SALI by the DOP853, the TIDES and the TAYLOR methods with and (Fig. 7). From Fig. 7 we see that all non-symplectic methods fail to detect correctly the regular character of the orbit because SALI drops to zero after . Such behaviors lead to the increase of the percentage of sticky chaotic orbits in Table 2, since some regular orbits are wrongly characterized as sticky or chaotic. Decreasing to values solves the problem, as it leads to a correct identification of the orbit’s nature, but also increases the required CPU time (see Fig. 7).
For smaller values of the results obtained from different techniques are more consistent. For large integration times all methods give a similar percentage of regular orbits of . TM, DOP853 and TIDES agree here within . For and the TM method clearly discriminates between regular and chaotic orbits, while all other methods still find of sticky chaotic orbits. But since the SALI of those orbits will eventually go to zero as well, it can be expected that also the non-symplectic methods will give the same results as the TM method when the integration time is increased.
4 Summary and conclusions
We considered the problem of fast and accurate integration of the variational equations of a conservative Hamiltonian system. We compared different numerical techniques for this task, and applied them to the Hénon-Heiles system. We considered non-symplectic methods of high accuracy; particularly the DOP853 scheme, as well as the TIDES and TAYLOR packages, which are based on Taylor expansion techniques. We also applied the TM method, which exploits symplectic integrators, using in particular the SBABC integrator.
The variational equations govern the evolution of small deviations from a given orbit. Using the SALI chaos indicator, which is defined through the time evolution of deviation vectors, we determined the chaotic or regular nature of individual orbits. In addition, applying an efficient numerical approach, the so-called fast PSS method, we were able to rapidly identify regions of order and chaos in the phase space of the system.
Our numerical results show that the TM method had the best numerical performance both in accuracy and in speed, especially for large integration steps, when the other non-symplectic schemes failed to compute accurately the fraction of regular and chaotic motion. For moderate integration steps all applied methods gave practically the same results, with the TM method being always faster.
Among the non-symplectic algorithms the TIDES was the most accurate one producing similar results as the DOP853 integrator. In many cases the results of the TAYLOR method were found to be less accurate than the ones obtained by the other methods, probably due to some implementation peculiarities of the algorithm.
-  Ch. Antonopoulos, A. Manos and Ch. Skokos, SALI: an efficient indicator of chaos with application to 2 and 3 degrees of freedom Hamiltonian systems, in “Proc.of the 1st International Conference: From Scientific Computing to Computational Engineering” (ed. D.T. Tsahalis), Patras Univ. Press, (2005), 1292–1298.
-  (MR2121808) R. Barrio, Performance of the Taylor series method for ODEs/DAEs Appl. Math. Comput., 163 (2005), 525–545.
-  T. C. Bountis and Ch. Skokos, Application of the SALI chaos detection method to accelerator mappings, Nucl. Inst. Meth. Phys. Res. A, 561 (2006), 173–179.
-  (MR1472597) C. Froeschlé, and E. Lega and R. Gonczi, Fast Lyapunov Indicators. Application to Asteroidal Motion Cel. Mech. Dyn. Astron., 67 (1997), 41–62.
-  (MR1227985) E. Hairer, S. P. Nørsett and G. Wanner, “Solving Ordinary Differential Equations. Nonstiff Problems”, 2 edition, Springer Series in Comput. Math., 1993.
-  (MR2221614) E. Hairer, C. Lubich and G. Wanner, “Geometric Numerical Integration. Structure-Preserving Algorithms for Ordinary Differential Equations”, Springer Series in Comput. Math., 2002.
-  (MR0158746) M. Hénon and C. Heiles, The applicability of the third integral of motion: some numerical experiments Astron. J., 69 (1964), 73–79.
-  (MR2146523) A. Jorba and M. Zou, A Software Package for the Numerical Integration of ODEs by Means of High-Order Taylor Methods, Experimental Mathematics, 14 (2005), 99–117.
-  (MR1864262) J. Laskar and P. Robutel, High order symplectic integrators for perturbed Hamiltonian systems, Cel. Mech. Dyn. Astr., 80 (2001), 39–62.
-  A.-S. Libert, C. Habaux and T. Carletti, Symplectic integration of deviation vectors and chaos determination. Application to the Hénon-Heiles model and to the restricted three-body problem., MNRAS, 414 (2011), 659–667.
-  (MR2479522) T. Manos, Ch. Skokos, E. Athanassoula and T. Bountis, Studying the global dynamics of conservative dynamical systems using the SALI chaos detection method Nonlin. Phenom. Complex Syst., 11 (2008), 171–176.
-  P. Panagopoulos, T. C. Bountis and Ch. Skokos, Existence and stability of localized oscillations in 1-dimensional lattices with soft spring and hard spring potentials J. Vib. & Acoust., 126 (2004), 520–527.
-  A. Széll, B. Érdi, Zs. Sándor and B. Steves, Chaotic and stable behavior in the Caledonian Symmetric Four-Body problem, MNRAS, 347 (2004), 380–388.
-  (MR1871759) Ch. Skokos, Alignment indices: A new, simple method for determining the ordered or chaotic nature of orbits, J. Phys. A, 34 (2001), 10029–10043.
-  Ch. Skokos, The Lyapunov Characteristic Exponents and their computation, in Lect. Notes Phys., 790 (2010), 63–135.
-  Ch. Skokos and E. Gerlach, Numerical integration of variational equations, Phys. Rev. E, 82 (2010), 036704.
-  Ch. Skokos, Ch. Antonopoulos, T.C. Bountis and M.N. Vrahatis, How does the Smaller Alignment Index (SALI) distinguish order from chaos?, Prog. Theor. Phys. Supp., 150 (2003), 439-443.
-  (MR2073606) Ch. Skokos, Ch. Antonopoulos, T.C. Bountis and M.N. Vrahatis, Detecting order and chaos in Hamiltonian systems by the SALI method, J. Phys. A, 37 (2004), 6269–6284.
-  P. Stránský, P. Hruška and P. Cejnar, Quantum chaos in the nuclear collective model: Classical-quantum correspondence, Phys. Rev. E, 79 (2009), 046202.
Received xxxx 20xx; revised xxxx 20xx.