We investigate the stability of synchronization in networks of dynamical systems with strongly delayed connections. We obtain strict conditions for synchronization of periodic and equilibrium solutions. In particular, we show the existence of a critical coupling strength , depending only on the network structure, isolated dynamics and coupling function, such that for large delay and coupling strength , the network possesses stable synchronization. The critical coupling can be chosen independently of the delay for the case of equilibria, while for the periodic solution, depends essentially on the delay and vanishes as the delay increases. We observe that, for random networks, the synchronization interval is maximal when the network is close to the connectivity threshold. We also derive scaling of the coupling parameter that allows for a synchronization of large networks for different network topologies.
Synchronization in Networks with Strongly Delayed Couplings]Synchronization in Networks with Strongly Delayed Couplings Daniel M. N. Maia et al.] \subjclass34D06, 34K08, 34K13.
Daniel M. N. Maia111Current address: Department of Mathematics and Statistics, State University of Rio Grande do Norte – UERN, Mossoró-RN, 59610-210 Brazil., Elbert E. N. Macau
Associate Laboratory of Applied Computing and Mathematics - LAC
National Institute for Space Research - INPE
Av. dos Astronautas, 1758, São José dos Campos-SP, 12227-010, Brazil
Institute of Mathematics and Computer Sciences - ICMC
University of São Paulo - USP
Av. do Trabalhador São-Carlense 400, São Carlos-SP, 13566-590, Brazil
Institute of Mathematics, Technical University of Berlin
Strasse des 17. Juni 136, 10623 Berlin, Germany
(Communicated by the associate editor name)
Coupled systems and networks with time-delayed interactions emerge in different fields including laser dynamics [21, 32, 11, 10, 36, 40], neural networks [39, 15, 20, 7], traffic systems , and others. Time delays in these systems are caused by finite signal propagation or finite reaction times. In many cases, especially in optoelectronics, delays are larger than the other time scales of the system, and they play a major role for system’s dynamics [36, 40]. For neural systems, large delays may emerge as a lump effect of a signal propagation along feed-forward chains of neurons .
When the interaction among oscillators is diffusive, the network possesses a synchronous subspace, where all subsystems constituting the network behave identically. The stability of the synchronous subspace plays a major role in applications. For instance, neural synchronization is known to be involved in brain functioning , synchronization of lasers is used for communication purposes [8, 2].
Therefore, the stability of synchronization for strongly self-feedback delayed interactions has been addressed in various contexts and generalities in a mixture of analytical and numerical techniques [22, 13].
Here, we aim at studying how stability of the synchronization manifold depends on the dynamics of the isolated nodes and network structure. We focus on the case where the isolated dynamics is either periodic or an equilibrium solution. This case is amenable to detailed understanding in the limit of large delays.
Model and discussion of results: We consider a network model with a self-feedback term in the coupling. This kind of coupling is widely studied, for example, in semiconductors lasers models [36, 18], where the self-feedback interaction is generated by the optical feedback. We consider the following system of identical oscillators with time-delayed interactions [18, 13, 22, 37, 9, 7]
where , is the coupling strength, is the adjacency matrix with the elements if and there is a link from to and otherwise. The function describes the uncoupled dynamics and the coupling function , , describes interactions between the nodes. More details and assumptions on the model (1.1) is given in Sec. 2.
We consider the time-delay as a large parameter. Physically, this means that the interaction time is much larger than the typical time scale of an uncoupled system, which often occurs in, e.g. coupled laser systems [36, 40].
The uncoupled units of the network have an attractor, which is either an equilibrium or periodic orbit. And, we obtain conditions for synchronization and desynchronization which depends on the network dynamics.
For the equilibrium, we show that with strong enough delay, there is a critical coupling parameter , which depends on the dynamics, coupling function and network structure, such that the equilibrium solution in the network remains stable if and only if (see Theorem 3.1). For this case, is independent of the delay.
Synchronization of stable periodic orbits is in sharp contrast to fixed point case. It is shown to be always desynchronized for long enough time-delay. However, for long but finite delay the synchronization of periodic orbits are attained for an interval that is shrinking as the delay grows to infinity, that is, for this case the critical coupling parameter depends also on the delay, , and as . See Theorem 5.1 for the precise statement.
Fixing the vector field , the coupling function and the delay , we can study how the network structure affects the critical coupling . Our results elucidate this dependence. For instance, we will show that
For Barabási-Albert scale free network, .
For Erdös-Réniy (ER) random networks, .
This shows that having a large number of connections is detrimental, and close to percolation threshold is optimal for synchronization. This is in contrast to the non-delayed case [25, 29] – best synchronization scenario happens for homogeneous networks and the large the degrees the better.
Here we use the theory of functional differential equations [17, 35], elements of the spectral theory of graphs [12, 3, 6], as well as a spectral theory for delay differential equations with strong delays [38, 23, 33, 40]. Some important ideas from Ref.  on the synchronization of strongly delayed networks are used as well.
The manuscript is organized as follows: In Sec. 2, we give some assumption on the considered model. In Sec. 3 we state the main results, in particular, a special case for the result of synchronization of periodic orbits. In Section 4 we give a description of the spectrum for the variational equation and prove the main results with illustrations given in Sec. 6. In Sec. 7 we discuss the relevance of the structure of the network to the synchronization condition and in Sec. 7.1 we discuss how scaling properties of the coupling parameter allow synchronization.
2 Assumptions on the network model
The initial conditions of (1.1) are history functions and we assume that is continuous for all . The state space where the solutions and initial conditions lives is the space of continuous functions endowed with the maximum norm in defined by where is some norm in .
The function is of class , . Assume that the solutions of the system are uniformly bounded, i.e., the overall system is dissipative. So the solution operator is eventually compact and thus we can apply the spectral mapping theorem. Thus, we can obtain detailed information by studying the linearized system.
The following assumptions for the vector field restrict the model (1.1) to the synchronization scenarios that we are interested in.
The uncoupled system possesses an exponentially locally stable equilibrium .
The uncoupled system possesses a locally exponentially stable periodic solution .
The coupling function , is assumed to be bounded and differentiable, is the Jacobian matrix at and .
Due to the diffusive nature of the coupling, the coupling term vanishes identically if the states of all oscillators are identical. This ensures that the synchronized state for all persists for all coupling strengths . Let be the solution specified in Assumptions 2.1 or 2.2 and a tubular neighborhood which belongs to the basin of attraction of . The set
is called the synchronization manifold. The local stability of determines the stability of the synchronization, and it depends, in particular, on spectral properties of Laplacian matrix defined as , where is the adjacency matrix and is the diagonal matrix of the network’s degrees. We assume that the matrix is diagonalizable.
3 Main Results
If the uncoupled system has stable equilibrium, then the coupled system possesses the stable equilibrium at , and the equilibrium solution remains stable for small and small delay by the principle of linearization.
Our result concerns the limit of large delay. In this setting, the principle of linearization does not apply, and the spectral theory of DDE offers the tools to tackle this problem.
Theorem 3.1, gives the interval of the coupling parameter where the equilibrium solution of (1.1) is locally exponentially stable for large delays. More specifically, it provides a critical coupling parameter such that the destabilization occurs for . Moreover, does not depend on the delay.
Theorem 3.1 (Persistence of equilibrium).
and , the equilibrium solution remains locally exponentially stable. Here, is the spectral radius of the Laplacian matrix .
If the condition is fulfilled, then there exists such that the equilibrium solution is unstable for .
As follows from Theorem 3.1, the condition is the strict destabilization value for , while the value does not depend on time delay . The proof of Theorem 3.1 is presented in Sec. 4. The interval of the coupling strength will be called the synchronization window.
In the case of the synchronous periodic solutions, the situation is subtle. In particular, one can show that the periodic orbits will be desynchronized with an increasing delay, however, it is possible to synchronize them for any finite time-delay.
The generic condition for synchronization of periodic orbits is a co-dimension one condition. This condition is technical and it will be discussed at length later in Sec. 5.2. To avoid overly technical statements we first give our result for the special case when the isolated dynamics is given by a Stuart-Landau (SL) system. The network model reads
The uncoupled SL system is retrieved if . Note that it has one equilibrium at the origin, which is asymptotically stable for , and a stable periodic orbit for , which emerges from the Hopf bifurcation at . This model is illustrative since it represents a normal form for a Hopf bifurcation.
Theorem 3.2 (Synchronization of periodic SL system).
Consider the system (3.3) with , and . Let the condition
be fulfilled. Then, there is such that for each there is such that the synchronous periodic solution is locally exponentially stable
for if or
for if .
Moreover, as .
Also, roughly speaking, the critical coupling parameter in Theorem 3.2, is written as .
The main consequences of the theorems 3.1 and 3.2 for different networks are presented as corollaries below. From the point of view of the network structure, the stability of the synchronization manifold is related to the spectral radius of the Laplacian matrix . Therefore, fixing , and large enough, one can study the effect of the changes in the network to the synchronization.
We give the asymptotic behavior of the synchronization window for two important examples of complex networks, namely, heterogeneous (e.g. Barabási-Albert (BA) scale-free network), and homogeneous network (e.g., Erdös-Réniy (ER) random graph). More details about BA and ER networks and the proofs of the corollaries that follow are given in Sec. 7.
Corollary 3.1 (Synchronization window for large BA networks).
Corollary 3.2 (Synchronization window for large ER networks).
Consider the model (1.1) and its assumptions with a connected ER network with nodes. Then, for sufficiently large , the length of the synchronization window scales as . Furthermore, the synchronization window is maximal near the percolation threshold.
4 Preliminaries: variational equation and spectral theory
In this section, we introduce the relevant elements to proof our main results.
4.1 Dynamics near the synchronization manifold
In order to study the local stability of the synchronization manifold we linearize (1.1) setting with small. We get
where with the degree of the node and if and otherwise. Here, is the Jacobian matrix of the vector field along and is the Jacobian of at .
Using we rewrite (4.1) as
where is the Kronecker product and is the identity matrix. As is diagonalizable we use , with , and the change of coordinates to get the block diagonal equation
Then, each block of (4.2) is given by
Note that and the variational equation corresponding to is
which describes the perturbations within the synchronization manifold. So, the interest concentrates now on the spectrum of (4.3) for .
Case 1: the synchronized solution is an equilibrium of the uncoupled system and then does not depend on .
Case 2: is a periodic solution of the uncoupled system, implying that .
4.2 Spectral Theory
Omitting the index and denoting , Eq. (4.3) can be rewritten as
where is a non-trivial -periodic function, and are Floquet exponent and Floquet multipliers respectively, one can obtain a delay differential equation (DDE) for
As the function is periodic we can rewrite in terms of a fraction of the period so that the large parameter appears only as a parameter in in Eq. (4.6):
where . The system (4.7) is said to have a non-trivial periodic solution when it posses a Floquet multiplier equals to .
The solutions of forms the whole spectrum of (4.4). In the case of (equilibrium solution) then
We will define now certain objects called “instantaneous spectrum”, “strongly unstable spectrum” as well as “asymptotic continuous spectrum”. Strictly speaking, these objects do not belong to the spectrum of the synchronous states, i.e., they are not the Lyapunov exponents of system (4.4). However, they play an important role since the spectrum will be well approximated by the “strongly unstable spectrum” and “asymptotic continuous spectrum” as the delay becomes large. Another advantage of these limiting spectra is that they can be much more easily found or computed in comparison to the actual spectrum of system (4.4), see more details in [42, 41, 38, 23, 33, 40].
Definition 4.1 (Instantaneous spectrum and strongly unstable spectrum).
The set of all for which the linear ODE system
has a non-trivial periodic solution is called the instantaneous spectrum. The subset of those with positive real part is called the strongly unstable spectrum.
In the case when (does not depend on time), the instantaneous spectrum consists of the eigenvalues of .
Definition 4.2 (Asymptotic continuous spectrum).
For any the complex number belongs to the asymptotic continuous spectrum if the DDE
has a non-trivial periodic solution for some . Here .
If does not depend on time, the asymptotic continuous spectrum can be determined from the following equation
As follows from [42, 41, 38, 19, 23, 33, 40], the spectrum of generic linear delay system (4.4) converges to either the instantaneous spectrum or to the curves in the complex plane , where is defined from the asymptotic continuous spectrum (note the division by ). The second part of the spectra – consisting of eigenvalues with asymptotically vanishing real parts – approaches a continuous curves asymptotically, while being still discrete for any finite ; for this reason, it is called pseudo-continuous spectrum.
An example of a typical spectrum of the system with long delay is shown in Fig. 6.2. In particular, the distances between neighboring eigenvalues within one curve of the pseudo-continuous spectrum scale as for large delay, and in the limit of they vanish and the eigenvalues fill the curve .
The union of the strongly unstable spectrum, , with the asymptotic continuous spectrum forms the approximation of the whole spectrum of Eq. (4.3), given that the instantaneous spectrum does not contain eigenvalues with zero real parts and some non-degeneracy conditions are fulfilled [23, 33]. Moreover, if the set of the strongly unstable spectrum is empty (), and the asymptotic continuous spectrum is entirely contained on the left side of the complex plane () then the trivial solution of Eq. (4.3) is exponentially asymptotically stable.
5 Proof of the main theorems
The result obtained in Theorem 3.1 could also be proved by using Lyapunov-Kravoskii functionals . However, we use the approach of studying the spectrum for large delay not only because it is powerful, but it also serves as a preparation to prove the result of synchronization of periodic solutions.
5.1 Persistence of equilibrium solution: Theorem 3.1
In this section we specify the stability condition for the case when system (1.1) possesses a synchronous solution i.e. , and the Jacobian is a constant matrix. The corresponding characteristic equation is
The real parts of the eigenvalues determine the stability, and, as it was discussed above, the whole spectrum converges to either the strongly unstable spectrum or pseudo-continuous spectrum. Lemma 5.1 gives explicit dependence of the asymptotic continuous spectrum on the coupling strength .
Lemma 5.1 (Ref.).
Consider the linear delay differential equation
with and . Then, the asymptotic continuous spectrum for (5.2) is given by the branches
where and are complex roots of the polynomial
Proof of Theorem 3.1 (Persistence of equilibrium solution).
The basic idea of the proof is to show that the strongly unstable spectrum is empty and the asymptotic continuous spectrum is stable if and only if the condition (3.1) is satisfied. The rest of the proof elaborates this idea more carefully in details.
The instantaneous spectrum coincides with the spectrum of and, by the Assumption 2.1, the equilibrium solution of the isolated system is asymptotically stable, thus there are no eigenvalues of with positive real parts, hence .
The condition is fulfilled if and only if
The asymptotic continuous spectrum lies strictly on the left side of the complex plane if the inequality (5.6) holds for all , , and . This leads to the condition
where exists and is always bounded from zero. Indeed, if we assume the opposite, i.e., , then it means that there exist such and that , and hence, implying that belongs to the spectrum of . In this way we arrive at the contradiction to the assumption that the spectrum of has strictly negative real parts. Moreover, since the functions are the roots of the characteristic equation (5.4). The number stands for the spectral radius of the Laplacian matrix . Therefore, under the condition (3.1), the asymptotic continuous spectrum and therefore the zero solution of (4.3) is stable.
The statement about the instability of the equilibrium follows from the fact that for there exist such , and that , and, hence the real part of the asymptotic continuous spectrum is positive Therefore, for sufficiently large time-delays and for , there will be eigenvalues from the pseudo-continuous spectrum with positive real parts. ∎
With the result of persistence of equilibrium solution proven, we move to the case of periodic synchronous solution.
5.2 Synchronization of periodic orbits
We have previously stated our result on the synchronization of periodic orbits for the SL oscillators (Theorem 3.2), so, we could avoid the discussion about the characteristic equation . Now we present a generalization of the announced result and we prove it in this section.
Theorem 5.1 (Synchronization of periodic orbits for any finite delay).
Consider system (1.1) and Assumption 2.2. Let an additional non-degeneracy assumption be fulfilled, where is defined by (4.8). Then, given fixed large enough, there exists such that one of the two following statements hold:
The synchronous periodic solution is locally exponentially stable for and unstable for .
The synchronous periodic solution is locally exponentially stable for and unstable for .
Moreover, as . That is, for any , there exists such that for all the synchronous periodic solution is unstable.
The co-dimension 1 condition may lead to isolated points, where the synchronization of the synchronous periodic orbit cannot be achieved (see example in Sec. 6.2).
The proof of Theorem 5.1 rely on the following lemma, adapted from  for the case of the stability of a periodic synchronized solution with respect to desynchronized perturbations (transverse to the synchronization manifold).
The synchronous periodic orbit of system (1.1) with period is exponentially stable with respect to perturbations transverse to the synchronization manifold for all sufficiently large if all of the following conditions hold:
(No strong instability) All elements of the instantaneous spectrum have negative real parts (this implies in particular that the strongly unstable spectrum is empty),
(Simple trivial multiplier) The trivial Floquet exponent is simple.
(Weak stability) the asymptotic continuous spectrum is contained in for all with , being all nontrivial eigenvalues of the Laplacian matrix .
And, it is exponentially unstable with respect to perturbations transverse to the synchronization manifold for sufficiently large if one of the following conditions hold:
(Strong instability) the strongly unstable spectrum is non-empty, or
(Weak instability) a non-empty subset of the asymptotic continuous spectrum has positive real part for nontrivial eigenvalue of the Laplacian matrix .
This theorem follows almost directly from Theorem 6 of , and we highlight the main features for our setup.
First of all, the existence of the periodic solution does not depend on time delay . As a result, can be considered as a continuous parameter here, instead of the parameter which is an integer part of used in . Hence, the asymptotic statements with respect to are equivalently formulated for in the present theorem.
Secondly, the stability of the periodic solution is determined by the variational equation (4.3) that splits into the part along the synchronization manifold with and the remaining part for the transverse perturbations with nonzero . Hence, the transverse stability is determined by the variational equation (4.6) with . The conditions for the stability S-I – S-III guarantee that the spectrum of the corresponding variational equations is stable for large enough . ∎
The linear stability of a synchronous periodic orbit is governed by the linearized equation (4.4) with periodic . In Ref.  the authors proved results about the stability of this equation for large . In particular, the existence of a holomorphic function is shown, such that is a Floquet exponent of the linear DDE (4.4) if and only if (see Eq. (4.8)).
The function in this case is analogous to the characteristic equation (5.1) for the case of equilibrium. The main difference of the periodic case is that the function is not given explicitly. The asymptotic continuous spectrum is determined from the equation
(compare (5.8) and (4.10)). Here we should emphasize that, in contrast to Ref. , we explicitly write the parameter in the argument of the function since the dependence on is of interest for this study. Moreover, this parameter can be eliminated from Eq. (5.8) by the transformation
leading to the equation
which is the same as Eq. (5.8) but with . Here we denoted . As a result, the following Lemma holds:
The main effect of the feedback strength for strong delays is the shift of the asymptotic continuous spectrum by the value .
Proof of Theorem 5.1.
The proof consists on showing that the conditions S-I – S-III of Lemma 5.2 are satisfied.
We remark that
since is the characteristic equation of the uncoupled system, which possesses one simple trivial multiplier by Assumption 2.1. Consider now the implicit function problem
It has a unique smooth solution with provided . As a result, the asymptotic continuous spectrum
has a singularity at and . Hence, the asymptotic continuous spectrum of (4.4) is singular as well
independently of the value of . Hence, the asymptotic continuous spectrum possesses always an unstable part, which implies instability for large enough values of time-delays.
We know that for the characteristic equation possesses one simple zero root , hence . We find how the real parts of these eigenvalues change if deviates from zero using the implicit function theorem for the equation . Since
we have the unique solution for small and . Here by assumption. Hence
In particular, this expression shows that for , the periodic solution will be destabilized for positive , and stabilized for negative . For , the stabilization occurs for positive and destabilization for negative. It is important to notice, that the stabilization (or destabilization) occurs for all transverse modes simultaneously, since the eigenvalues of the Laplacian matrix are positive and can admit values , which have the same sign for all , .
6 Example: Coupled Stuart-Landau systems
Let us consider an example of the ring of coupled Stuart-Landau (SL) oscillators shown in Fig. 6.1.
Figure 6.2 shows the spectrum of two coupled Stuart-Landau oscillators linearized at the origin and coupling function being the identity.
6.1 Persistence of equilibrium
Firstly, we consider the case (equilibrium solution) so that the eigenvalues of the uncoupled system have negative real parts. The Jacobian matrix at zero has the eigenvalues . Therefore, the strongly unstable spectrum is empty, and the whole spectrum of the zero equilibrium for the network system (4.3) consists only of the asymptotic-continuous spectrum for long delays.
Hence, we find . Therefore, the synchronization manifold for the considered network is locally exponentially stable if and only if
for sufficiently long time delay (and unstable if ).
Fig. 6.3 illustrates the convergence of the trajectories to the equilibrium (left panel) for the case when the condition (6.2) is fulfilled and the absence of convergence in the opposite case. The detailed parameter values are given in the figure’s caption. Moreover, in order to compute the synchronization error we compare each solution to a fixed one taking the norm of maximal difference, that is, we measure the synchronization error by .
6.2 Periodic orbit synchronization
Let us consider the case when the synchronous periodic solution exists. In this section we prove Theorem 3.2.
Consider the transformation , then Eq. (6.1) reads, in terms of ,
where are the eigenvalues of . For short, we write Eq. (6.4) as .
The instantaneous spectrum can be computed using Definition 4.1. It consists of the eigenvalues of the non-delayed part of (6.4) and reads . The eigenvalue in the instantaneous spectrum is associated with the trivial Floquet multiplier producing a singularity in the asymptotic spectrum. Then, as predicted by Theorem 5.1, the synchronization cannot be achieved for an arbitrary large delay. However, Theorem 5.1 guarantee the existence of a synchronization interval (or with ) with the decreasing length with increasing .
The asymptotic continuous spectrum can be computed as in the case of equilibrium solution. Using Eq. (4.10), one obtains where are the solutions of
or, more specifically,
The non-degeneracy condition (assumption in Theorem 5.1) is satisfied since provided , .
The solution of (6.5) reads
From (6.6), we get and provided , . Therefore, the singularity occurs uniquely at the function .
In order to obtain , as introduced in Eq. (5.11), we compute . Hence, . As , this implies that synchronization occurs for negative when and for positive otherwise (positive is obtained if ).
with . Eq. (6.7) can be numerically solved.
We compare the solutions of (6.7) to the analytical approximation. The asymptotic spectrum (given in terms of Eq. (6.6)) and the spectrum points (solutions of Eq. (6.7)) are given in Fig. 6.4 with parameters given in the figure’s caption.
From the data of Fig. 6.4 we notice that for , and , stale synchronization is attained for .
Now, in order to have a complete view of the stability domain, we produce a synchronization map in the parameter space . The Fig. 6.5 shows such a color map presenting the values of , where , , is a solution of Eq. 6.7, in the parameter space. Note that and, as predicted by Theorem 5.1, the stable synchronization either occurs for or for with shrinking as grows.
The parameter values of the color map in Fig. 6.5 can be related to more complicated connected network for coupling parameter values in the range . The interchange between stability domains occurs at the values , , where we considered . For such values of time delays no stable synchronization is attained.
6.3 Characteristic time
In this section, we discuss the transient time such that the trajectories enter a small vicinity of the synchronization manifold. In particular, we are interested in the scaling of the transient time with coupling strength and time delay .
The real parts of the eigenvalues of the linearized system can be estimated rigorously, so the characteristic time should be related to the properties of the linearized system. The solutions of Eq. (4.3), in the case of exponential stability, decay as
with to be the largest real part of the eigenvalues. Hence, we define the characteristic time as
The characteristic time measures how fast the slowest solution approaches . One can write where is the maximum of the real part of the asymptotic continuous spectrum given in Eq. (5.5). It can be computed as
Hence, the characteristic time is
7 Synchronization loss versus network structure
Here, we explore the relationship between growing networks (with strongly delayed connection) and its synchronization window in the case of equilibrium. The main results are the corollaries 3.1 and 3.2.
We will concentrate on the behavior of large networks such as Barabási-Albert scale-free network, Erdös-Réniy random network, and some regular graphs, for which the expressions for the Laplacian spectral radius are known.
First, let us take a look at how regular graphs respond to the synchronization (using the network model (1.1) with long delay) in the limit of large network size. Table 7.1 lists spectral radius of the Laplacian matrix of the main regular graphs: complete, ring, star, and path.
For strong delay and a large network size , the synchronization manifold tends to be always unstable in networks of the types Complete or Star provided that the coupling strength does not scale with .
For strong delay and a large network size , the synchronization manifold tends to be stable for a certain interval of the coupling strength in simple networks of the types Ring or Path.
Now, let us consider some complex networks. We relate the synchronization condition to the graph structure for two important examples of complex networks.
Homogeneous networks, characterized by a small disparity in the node degrees. A canonical example is the Erdös-Réniy (ER) random network: Starting with nodes the graph is constructed by connecting nodes randomly. Each edge is included in the graph with probability independent from every other edge. If with then the ER network is almost surely connected . We will consider that is chosen so that the ER network is connected.
Heterogeneous networks, where some nodes (called hubs) are highly connected whereas most of the nodes have only a few connections. A canonical example of such networks is the Barabási-Albert (BA) scale-free network. One way to construct it is to start with two nodes and a single edge that connect them. Then at each step, a new node is created and it is connected with one of the preexisting nodes with a probability proportional to its degree. This process is called preferential attachment.
More details about the construction, structure, and dynamics of such networks can be found in [27, 4]. Illustrations of Erdös-Réniy (ER) random networks (homogeneous) and Barabási-Albert (BA) Scale-Free networks (heterogeneous) can be seen in Figure 7.1.
The response of the BA and ER networks to synchronization under the considered delayed model already stated in Sec. 3 and encoded in corollaries 3.1 and 3.2. The both results says that ER and BA networks tend to not have stable synchronization in the limit of large . But, ER networks, losses stable synchronization at a slow rate compared to BA networks.
Here we prove the both cited corollaries. The proof of Corollary 3.1 is based on the following well-known results.
Lemma 7.1 (Ref. ).
Let denote the largest degree of a undirected network of size . Then the spectral radius of the Laplacian matrix of has the following estimates:
Lemma 7.2 (Ref. ).
Consider a BA undirected network of size and its largest degree. With probability we have
the limit is almost surely positive and finite.
Proof of Corollary 3.1.
Corollary 3.1 shows that the synchronization manifold tends to be unstable in large and strongly delayed BA (heterogeneous) networks if the coupling strength is not scaled with or .
Lemma 7.3 (Ref. ).
Consider an Erdös-Réniy network with nodes, connection probability and . Then, the probability that the maximum degree being at most , for some constant , tends to as .
Proof of Corollary 3.2.
For large and using the probability with one get
So, using Lemma 7.1, we end up with
which means that when with a rate of order . The spectral radius is the lowest possible when maintaining the network connected, or, is the lowest possible when the network crosses the connectivity threshold becoming connected. ∎
Although Corollary 3.2 says that the ER random network does not allow the synchronization manifold to be stable in the limit of , the rate in which it happens is slow, making it possible to synchronize very large ER networks with long time delays.
The properties observed for the stability of the synchronization manifold for BA and ER networks with strong delay, that is, large BA networks doesn’t support strong delay interaction and relatively large ER networks supports strong delay interaction, are similar to the persistence of the synchronization when the non-delayed coupling functions are nonidentical .
7.1 Synchronization of BA and ER networks when coupling strength is scaled with
As we have seen from the previous subsection, not only simple but also complex networks tend to have an always unstable synchronization manifold with strong delay and large network size .
In many network dynamical models, it is common to normalize the coupling parameter, in our case , in order to preserve certain behaviors and properties of the network, such as synchronization, mean field oscillation, community clustering, etc [1, 31, 14]. When the network size is dynamical, for instance, the size of the network is growing with time, then this normalization becomes even more important.
With this notion in mind, we can see that in the regime of large network size, the coupling parameter should have some natural scaling depending on the network structure. If those scaling are taken into account in the network model then the stability of the synchronization manifold can always be preserved for .
For example, if we know beforehand that we have a large simple network of the type Complete (or Star) then the natural scaling of the coupling parameter would be
Consider a BA scale-free network with number of nodes equals to and the network model (1.1) with the coupling parameter
Then for any large enough size and long enough delay, there is always a non-empty interval such that any synchronous steady state is locally exponentially stable for all and unstable if (with probability 1). Moreover, the length of this interval converges to a nonzero constant with with probability 1:
Any equilibrium solution is locally exponentially stable if and unstable for for some . For BA scale-free networks we know that (see Lemma 7.2). Then, if we re-scale the coupling parameter as the new synchronization condition is , which leads to . ∎
Consider an ER random network with nodes and the network model (1.1) with new coupling parameter scaled as
Then for large enough network size and long enough time delay , there is an interval such that any equilibrium solution is locally exponentially stable if and unstable if (with probability 1). Moreover, the length of the interval converges to a nonzero constant with with probability 1:
The work of D.N.M Maia was supported by CNPq grant 233718/2014-1. E. Macau also acknowledges the support of CNPq and FAPESP2015/50122-0 T. Pereira acknowledges the support of CEPID-CeMeai FAPESP project 2013/07375-0 and S.Yanchuk acknowledges the support of the German Research Foundation (DFG) in the framework of the Collaborative Research Center 910. This research is also supported by grant 2015/50122-0 of Sao Paulo Research Foundation (FAPESP) and DFG-IRTG 1740/2. The authors acknowledge valuable discussions with Jan Philipp Pade and Stefan Ruschel.
-  A. Arenas, A. DÃaz-Guilera, J. Kurths, Y. Moreno, and C. Zhou. Synchronization in complex networks. Physics Reports, 469(3):93 – 153, 2008.
-  A. Argyris, D. Syvridis, L. Larger, V. Annovazzi-Lodi, P. Colet, I. Fischer, J. Garcia-Ojalvo, C. R. Mirasso, L. Pesquera, and K. A. Shore. Chaos-based communications at high bit rates using commercial fibre-optic links. Nature, 438(7066):343–346, November 2005.
-  L.W. Beineke and R.J. Wilson. Topics in Algebraic Graph Theory. Encyclopedia of Mathematics and its Applications. Cambridge University Press, 2004.
-  S. Boccaletti, V. Latora, Y. Moreno, M. Chavez, and D. Hwang. Complex networks: Structure and dynamics. Physics Reports, 424(4-5):175–308, February 2006.
-  B. Bollobás. Random graphs. Cambridge Univ Pr, 2001.
-  A.E. Brouwer and W.H. Haemers. Spectra of Graphs. Universitext. Springer New York, 2011.
-  S.A. Campbell, I. Ncube, and J. Wu. Multistability and stable asynchronous periodic oscillations in a multiple-delayed neural system. Physica D: Nonlinear Phenomena, 214(2):101 – 119, 2006.
-  P. Colet and R. Roy. Digital communication with synchronized chaotic lasers. Opt. Lett., 19(24):2056–2058, 1994.
-  T. Dahms, J. Lehnert, and E. Schöll. Cluster and group synchronization in delay-coupled networks. Phys. Rev. E, 86:016202, Jul 2012.
-  T. Erneux. Applied Delay Differential Equations, volume 3 of Surveys and Tutorials in the Applied Mathematical Sciences. Springer, 2009.
-  B. Fiedler, S. Yanchuk, V. Flunkert, P. Hövel, H.-J. Wünsche, and E. Schöll. Delay stabilization of rotating waves near fold bifurcation and application to all-optical control of a semiconductor laser. Phys. Rev. E, 77(6):066207, 2008.
-  M. Fiedler. Algebraic connectivity of graphs. Czechoslovak Mathematical Journal, 23(2):298–305, 1973.
-  V. Flunkert, S. Yanchuk, T. Dahms, and E. Schöll. Synchronizing distant nodes: A universal classification of networks. Phys. Rev. Lett., 105(25):254101, 2010.
-  S. Fortunato. Community detection in graphs. Physics Reports, 486(3â5):75 – 174, 2010.
-  J. Foss and J. Milton. Multistability in recurrent neural loops arising from delay. J Neurophysiol, 84:975–985, 2000.
-  Emilia Fridman. Tutorial on lyapunov-based methods for time-delay systems. European Journal of Control, 20(6):271 – 283, 2014.
-  J. K. Hale and S. M. Verduyn Lunel. Introduction to Functional Differential Equations. Springer-Verlag, 1993.
-  J. D. Hart, J. P. Pade, T. Pereira, T. E. Murphy, and R. Roy. Adding connections can hinder network synchronization of time-delayed oscillators. Phys. Rev. E, 92:022804, Aug 2015.
-  S. Heiligenthal, T. Dahms, S. Yanchuk, T. Jüngling, V. Flunkert, I. Kanter, E. Schöll, and W. Kinzel. Strong and weak chaos in nonlinear networks with time-delayed couplings. Phys. Rev. Lett., 107:234102, 2011.
-  E. M. Izhikevich. Polychronization: Computation with spikes. Neural Computation, 18:245–282, 2006.
-  J. Javaloyes, P. Mandel, and D. Pieroux. Dynamical properties of lasers coupled face to face. Phys. Rev. E, 67:036201, 2003.
-  W. Kinzel, A. Englert, G. Reents, M. Zigzag, and I. Kanter. Synchronization of networks of chaotic units with time-delayed couplings. Physical Review E (Statistical, Nonlinear, and Soft Matter Physics), 79(5):056207, 2009.
-  M. Lichtner, M. Wolfrum, and S. Yanchuk. The spectrum of delay differential equations with large delay. SIAM J. Math. Anal., 43:788–802, 2011.
-  L. Lücken, J. P. Pade, K. Knauer, and S. Yanchuk. Reduction of interaction delays in networks. EPL (Europhysics Letters), 103(1):10006, 2013.
-  D. N. M. Maia, E. E. N. Macau, and T. Pereira. Persistence of network synchronization under nonidentical coupling functions. SIAM J. Appl. Dyn. Syst., 15(3):1563â1580, 2016.
-  T. F. Móri. The maximum degree of the barabási-albert random tree. Comb. Probab. Comput., 14(3):339–348, may 2005.
-  M. E. J. Newman. The Structure and Function of Complex Networks. SIAM Review, 45(2):167–256, 2003.
-  G. Orosz, R. E. Wilson, and G. Stepan. Traffic jams: dynamics and control. Phil. Trans. R. Soc. A, 368:4455–4479, 2010.
-  T. Pereira, J. Eldering, M. Rasmussen, and A. Veneziani. Towards a theory for diffusive coupling functions allowing persistent synchronization. Nonlinearity, 27(3):501, 2014.
-  O. Riordan and A. Selby. The maximum degree of a random graph. Comb. Probab. Comput., 9(6):549–572, November 2000.
-  F. A. Rodrigues, T. K. DM. Peron, P. Ji, and J. Kurths. The kuramoto model in complex networks. Physics Reports, 610:1 – 98, 2016.
-  J. Schlesner, A. Amann, N. B. Janson, W. Just, and E. Schöll. Self-stabilization of high-frequency oscillations in semiconductor superlattices by time-delay autosynchronization. Phys. Rev. E, 68:066208, Dec 2003.
-  J. Sieber, M. Wolfrum, M. Lichtner, and S. Yanchuk. On the stability of periodic orbits in delay equations with large delay. Discrete Contin. Dyn. Syst. A, 33:3109–3134, 2013.
-  W. Singer. Synchronization of cortical activity and its putative role in information processing and learning. Annu. Rev. Physiol., 55:349–374, 1993.
-  H. L. Smith. An introduction to delay differential equations with applications to the life sciences, volume 57. Springer Science+ Business Media, 2010.
-  M. C. Soriano, J. Garcia-Ojalvo, C. R. Mirasso, and I. Fischer. Complex photonics: Dynamics and applications of delay-coupled semiconductors lasers. Rev. Mod. Phys., 85:421–470, 2013.
-  E. Steur, W. Michiels, H. Huijberts, and H. Nijmeijer. Networks of diffusively time-delay coupled systems: Conditions for synchronization and its relation to the network topology. Physica D, 277:22–39, 2014.
-  M. Wolfrum, S. Yanchuk, P. Hövel, and E. Schöll. Complex dynamics in delay-differential equations with large delay. Eur. Phys. J. Special Topics, 191:91–103, 2010.
-  J. Wu. Symmetric functional differential equations and neural networks with memory. Transactions of the American Mathematical Society, 350(12):4799–4838, 1998.
-  S. Yanchuk and G. Giacomelli. Spatio-temporal phenomena in complex systems with time delays. Journal of Physics A: Mathematical and Theoretical, 50(10):103001, 2017.
-  S. Yanchuk and P. Perlikowski. Delay and periodicity. Phys. Rev. E, 79(4):046221, 2009.
-  S. Yanchuk and M. Wolfrum. Instabilities of equilibria of delay-differential equations with large delay. In D.H. van Campen, M.D. Lazurko, and W.P.J.M. van der Oever, editors, Proceedings of ENOC-2005, pages 1060–1065, Eindhoven, Netherlands, August 2005.
Received xxxx 20xx; revised xxxx 20xx.