Patterns of cooperation: fairness and coordination in networks of interacting agents
Abstract
We study the selfassembly of a complex network of collaborations among selfinterested agents. The agents can maintain different levels of cooperation with different partners. Further, they continuously, selectively, and independently adapt the amount of resources allocated to each of their collaborations in order to maximize the obtained payoff. We show analytically that the system approaches a state in which the agents make identical investments, and links produce identical benefits. Despite this high degree of social coordination some agents manage to secure privileged topological positions in the network enabling them to extract high payoffs. Our analytical investigations provide a rationale for the emergence of unidirectional nonreciprocal collaborations and different responses to the withdrawal of a partner from an interaction that have been reported in the psychological literature.
pacs:
89.75.Fb, 89.75.Kd, 89.65.sCooperation is the basis for complex organizational structures in biological as well as in social systems [1, 2]. The evolutionary and behavioural origin of cooperation is a subject of keen scientific interest, because the ubiquity of cooperation in nature seems to defy the often high costs incurred by the cooperating agent [3]. Evolutionary game theory has identified several mechanism allowing for the evolution and persistence of costly cooperation [4]. In particular the emergence of cooperation is promoted if the interacting agents are distributed in some (potentially abstract) space, so that only certain agents can interact at any given time [5, 6, 7]. In the context of social cooperation spatial structure can be appropriately modeled by a complex network, in which nodes represent agents, while the links correspond to collaborations. The topology of this network, i.e., the specific configuration of nodes and links, has been shown to be of central importance for the level of cooperation that evolves [8, 9, 10, 11, 12].
In social networks the topology is not static, but reacts to the behaviour of the agents [13, 14, 15, 16, 17, 18]. This defines an inherent dynamical interplay: While the agents’s behaviour may depend on their topological neighbourhood, this neighbourhood is, at least in part, shaped through the agent’s behavioural choices. Networks containing such an dynamical interplay between the state of the nodes and the networks topology are called adaptive networks [19, 20]. While adaptive networks have been studied for some time in the social literature (e.g. [13, 21, 22]), pioneering work [23, 27, 26, 24] only recently triggered a wave [25] of detailed dynamical investigations in physics. Recent publications discuss simple cooperative games such as the oneshot prisoner’s dilemma [9, 28, 29, 32, 31, 30, 38, 39, 33, 37, 36, 35, 34], the iterated prisoner’s dilemma[40], and the snowdrift game [32, 31, 41] on adaptive networks. They showed numerically and analytically that a significantly increased level of cooperation can be achieved if individuals are able rewire their links [9, 28, 29, 30, 38, 39, 41, 42] if links are formed and broken [32, 31, 42, 33, 34, 43] or if new agents are added to the network [37, 36]. Moreover, it has been shown that the adaptive interplay between the agents’ strategies and the network topology can lead to the emergence of distinguished agents from an initially homogeneous population [9, 27, 28, 29].
While important progress has been made in the investigation of games on adaptive networks, it is mostly limited to discrete networks, in which the agents can only assume a small number of different states, say, unconditional cooperation with all neighbours and unconditional defection. By contrast, continuous adaptive networks have received considerably less attention [22, 44, 45]. Most current models therefore neglect the ability of intelligent agents to maintain different levels of cooperation with different selfchosen partners [45].
In this paper we propose a weighted and directed adaptive network model in which agents continuously and selectively reinforce advantageous collaborations. After a brief description of the model, we show in Sec. 2 that the network generally approaches a state in which all agents make the same total cooperative investment and every reciprocated investment yields the same benefit. Despite the emergence of this high degree of coordination, the evolved networks are far from homogeneous. Typically the agents distribute their total investment heterogeneously among their collaborations, and each collaborations receives different investments from the partners. In Sec. 3, we show that this heterogeneity enables resource fluxes across the network, which allow agents holding distinguished topological positions to extract high payoffs. Thereafter, in Sec. 4, we investigate further topological properties of the evolved networks and identify the transition in which large cooperating components are formed. Finally, in Sec. 5, we focus on the appearance of unidirectional (unreciprocated) investments. Specifically, we identify three distinct scenarios in which unidirectional collaborations can arise and discuss their implications for the interaction topology. Our conclusions are summarized in Sec. 6.
1 Model
We consider a population of agents, representing for instance people, firms or nations, engaged in bilateral collaborative interactions. Each interaction is described by a continuous snowdrift game [2], one of the fundamental models of game theory. In this game, an agent can invest an amount of time/money/effort into the collaboration with another agent . Cooperative investments accrue equal benefits to both partners, but create a cost for the investing agent. Assuming that investments from both agents contribute additively to the creation of the benefit, the payoff received by agent from an interaction with an agent can then be written as
(1) 
The game thus describes the generic situation in which agents invest their personal resources to create a common good shared with the partner.
As an example of the snowdrift game, the reader may think of a scientific collaboration where two researchers invest their personal time in a project, while the benefit of the publication is shared between them. This example makes it is clear that the benefit of the collaboration must saturate when an extensive amount of effort is invested, whereas the cost to the an agents, measured for instance in terms of personal wellbeing, clearly grows superlinearly once the personal investment exceeds some hours per day.
In the following we do not restrict the cost and the benefitfunctions, and , to specific functional forms, except in the numerical investigations. However, we assume that both are differentiable and, moreover, that is sigmoidal and is superlinear (cf. Fig. 3). These assumptions capture basic features of realworld systems such as inefficiency of small investments, saturation of benefits at high investments, as well as additional costs incurred by overexertion of personal resources and are widely used in the sociological and economic literature [46, 47].
To account for multiple collaborations per agent, we assume that the benefits received from collaborations add linearly, whereas the costs are a function of the sum of investments made by an agent, such that the total payoff received by an agent is given by
(2) 
where denotes the total investment of the agent while denotes the total investment made in the collaboration . This is motivated by considering that benefits from different collaborations, say different publications, are often obtained independently of each other, whereas the costs generated by different collaborations stress the same pool of personal resources of an agent.
Let us emphasize that we do not restrict the investment of an agent further. While investments cannot be negative, no upper limit on the investments is imposed. Furthermore, the agents are free to make different investments in collaborations with different partners. Thus, to optimize its payoff, an agent can reallocate investments among its potential partners as well as change the total amount of resources invested.
For specifying the dynamics of the network, we assume the agents to be selfish, trying to increase their total payoff by a downhillgradient optimization
(3) 
Every agent can cooperate with every other agent. Thus, the network of potential collaborations is fully connected and the deterministic timeevolution of the model system is given by a system of ordinary differential equations of the form of Eq. 3. The network dynamics, considered in the following, is therefore only the shifting of link weights . Note however that already the weight dynamics constitutes a topological change. As will be shown in the following, the agents typically reduce their investment in the majority of potential collaborations to zero, so that a sparse and sometimes disconnected network of nonvanishing collaborations is formed. Therefore the terminology of graph theory is useful for characterizing the state that the system approaches. Below, we use the term link to denote only those collaborations that receive a nonvanishing investment . A link is said to be bidirectional if nonvanishing investments are contributed by both connected agents, while it is said to be unidirectional if one agent makes a nonvanishing investment without reciprocation by the partner. Likewise, we use the term neighbours to denote those agents that are connected to a focal agent by nonvanishing collaborations and the term degree to denote the number of nonvanishing collaborations in which a focal agent participates.
In the following, the properties of the model are investigated mostly by analytical computations that do not require further specifications. Only for the purpose of verification and illustration we resort to numerical integration of the ODE system. For these we use the functions
For studying the timeevolution of exemplary model realizations by numerical integration, all variables are assigned random initial values drawn independently from a Gaussian distribution with expectation value and standard deviation constituting a homogeneous state plus small fluctuations. The system of differential equations is then integrated using Euler’s method with variable step size . In every timestep, is chosen such that no variable is reduced by more than half of its value in the step. If in a given timestep a variable falls below a threshold and the corresponding time derivative is negative, then is set to zero for one step to avoid very small time steps. We emphasize that introducing the threshold is done purely to speed up numerical integration and does not affect the results or their interpretation. In particular, we confirmed numerically that, the exact value of does not influence the final configuration that is approached. In all numerical results shown below was used.
2 Coordination of investments
The numerical exploration of the system reveals frustrated, glasslike behavior; starting from a homogeneous configuration as described above, it approaches either one of a large number of different final configurations, which are local maxima of the total payoff.
A representative example of an evolved network, and snapshots from the timeevolution of two smaller example networks are shown in Figs. 1,2, respectively. In the example networks only those links are shown that receive a nonvanishing (i.e. abovethreshold) investment. Most of these nonvanishing links are bidirectional, receiving investments from both of the agents they connect. Only rarely, unidirectional links appear, which are maintained by one agent without reciprocation by the partner.
For further investigations it useful to define a bidirectionally connected component (BCC) as a set of agents and the bidirectional links connecting them, such that, starting from one agent in the set, every other agent in the set can be reached by following a sequence of bidirectional links. In the numerical investigations we observe that all bidirectional links within a BCC receive the same total investment in the final state. However, the investment made in every given link is in general not split equally among the two connected agents. Furthermore, all agents within a BCC make the same total cooperative investment in the final state. However, the investments of one agent in different collaborations are in general different. The coordination of total investments , therefore arises although no agent has sufficient information to compute the total investment made by any other agent.
We emphasize that the level of investments, which the agents approach is not set rigidly by external constraints but instead depends on the topology of the network of collaborations that is formed dynamically. This is evident for instance in differences of up to 20 % between the level of investment that is reached in different BCCs of the same network.
To understand how coordination of investment arises, we now formalize the observations made above. We claim that in our model in the final state the following holds: Within a BCC (i) every agent makes the same total investment, and (ii) either all bidirectional links receive the same total investment or there are exactly two different levels of total investment received by bidirectional links. For reasons described below, the case of two different levels of total investment per link is only very rarely encountered. In this case every agent can have at most one bidirectional link that is maintained at the lower level of investment.
We first focus on property (i). This property is a direct consequence of the stationarity of the final state. Consider a single link . Since both investments, and , enter symmetrically into , the derivative of the benefit with respect to either investment is . Thus, if , the stationarity conditions require
(4) 
This stipulates that the slope of the cost of the two interacting agents must match the slope of the shared benefit in the stationary state (Fig. 3). Due to the symmetry of , holds for all . Therefore, Eq. (4) implies . As we assumed to be superlinear, is injective and it follows that , such that and , are at a point of identical total investment. Iterating this argument along a sequence of bidirectional links yields (i).
Let us remark that the stationarity of vanishing investments may be fixed due to the external constraint that investments have to remain nonnegative. The stationarity condition for vanishing and unidirectional links, analogous to Eq. (4), is therefore
(5) 
Because of the inequalities that appear in this equation, the argument given above does not restrict the levels of total investment found in different components. For similar reasons agents that are only connected by unidirectional links can sustain different levels of investment, which is discussed in Sec. 5.
We note that, although the network of potential interactions is fully connected, no information is transfered along vanishing links. Therefore, the equation of motion, Eq. 3, should be considered as a local update rule, in the sense that it only depends on the state of the focal agent and on investments received from a small number of direct neighbours.
In order to understand property (ii) we consider multiple links connecting to a single agent . In an equilibrium the investment into each of the links has to be such that the slope of the benefit function of each link is identical. Otherwise, the payoff could be increased by shifting investments from one link to the other. Since the benefit function is sigmoidal, a given slope can be found in at most two points along the curve: one above and one below the inflection point (IP). By iteration, this implies that if a stationary level of investment is observed in one link, then the investment of all other links of the same BCC is restricted to one of two values, which amounts to the first sentence of (ii).
For understanding why the case of two different levels of investments is rarely encountered the stability of steady states has to be taken into account. A local stability analysis, based on linearisation and subsequent application of Jacobi’s signature criterion, is presented in the appendix. We show that for a pair of agents connected by a bidirectional link, stability requires
(6) 
and every pair of links and connecting to the same agent has to satisfy
(7) 
Note that Eq. (6) does not stipulate the sign of as it only implies . As Eq. (6) applies also to the link , the same holds for . We therefore have to consider three different cases when testing the compatibility of Eq. (7) with Eq. (6):
 a)

and , (both investments above the IP)
 b)

and , (both investments below the IP)
 c)

and (one investment above and one below the IP).
In case a), Eq. (7) is trivially fulfilled as the left hand side has positive and the right hand side negative sign. In case b), Eq. (7) and Eq. (6) are incompatible: estimating the lower bound of the right hand side of (7) using the relation leads to the contradiction
This shows that in a stable stationary state, every agent can at most have one link receiving investments below the IP. In case c), Eq. (7) can in principle be satisfied. However, the equation still imposes a rather strong restriction on a positive requiring high curvature of the benefit function close to saturation. The restriction becomes stronger, when the degree of agent increases [48].
Bilateral links with investments below the IP can be excluded entirely, if the benefit function approaches saturation softly, so that the curvature above the inflection point remains lower or equal than the maximum curvature below the inflection point. For such functions, every pair of solutions to the stationarity condition yields a pair of coefficients violating (7). In this case only configurations in which all links receive investments above the IP can be stable and hence all links produce the same benefit in the stable stationary states. This explains why the case of two different levels of cooperation is generally not observed in numerical investigations if realistic cost and benefit functions are used.
For understanding the central role the IP plays for stability consider that in the IP the slope of is maximal. Therefore, links close to the IP make attractive targets for investments. If the total investment into one link is below the IP then some disturbance raising (lowering) the investment increases (decreases) the slope, thus making the link more (less) attractive for investments. Hence, below the IP, a withdrawal of resources by one of the partners, no matter how slight, will make the collaboration less attractive, causing a withdrawal by the other partner and thereby launching the interaction into a downward spiral. Conversely, for links above the IP the gradual withdrawal of resources by one partner increases the attractiveness of the collaboration and is therefore compensated by increased investment from the other partner. In psychology both responses to withdrawal from a relationship are well known [49]. The proposed model can therefore provide a rational for their observation that does not require explicit reference to long term memory, planning, or irrational emotional attachment.
For our further analysis property (ii) is useful as it implies that, although our model is in essence a dynamical system, the BCCs found in the steady states of this system can be analyzed with the tools of graph theory for undirected graphs. In the Secs. 3, 4 we go one step further and treat not only the BCC but the whole network as an undirected graph. We thereby ignore the differences between directed and undirected links in order to study properties such as the degree and componentsize distributions before we continue in Sec. 5 with a more detailed investigation of directed links and their topological implications.
3 Distinguished topological positions
Despite the coordination described above, the payoff extracted by agents in the final state can differ significantly. This is remarkable because the agents follow identical rules and the network of collaborations is initially almost homogeneous with respect to degree, link weights, and neighbourhood.
Because all bidirectional links in a BCC produce the same benefit, the total benefit an agent receives is proportional to the degree of the agent. By contrast, the cost incurred by an agent does not scale with the degree, but is identical for all agents in the BCC, because agents of high degree invest a proportionally smaller amount into their collaborations. Topological positions of high degree thus allow agents to extract significantly higher benefits without requiring more investment.
The payoff distribution in the population is governed by the degree distribution describing the relative frequency of agents with degree . Figure 4 shows a representative degree distribution of an evolved networks in the final state. While the finite width of the distribution indicates heterogeneity, the distribution is narrower, and therefore fairer, than that of an ErdősRényi random graph, which constitutes a nullmodel for randomly assembled network topologies. We verified that variance of the evolved network is below the variance of a random graph for the whole range of admissible mean degree in a network of given size.
Although the snowdrift game is not a zerosum game, payoffs cannot be generated arbitrarily. In order to sustain the extraction of high payoffs by agents of high degree, investments have to be redistributed across the network. In the definition of our model, we did not include the transport of resources directly. Nevertheless, a redistribution of investments arises indirectly from the asymmetry of the agents’ investments. This is illustrated in Fig. 5. Consider for instance an agent of degree 1. This agent necessarily focuses his entire investment on a single collaboration. Therefore, the partner participating in this collaboration only needs to make a small investment to make the collaboration profitable. He is thus free to invest a large portion of his total investment into links to other agents of possibly higher degree. In this way investments flow toward the regions of high degree where high payoffs are extracted.
4 Formation of large components
To explore the topological properties of the networks of collaborations in the final state further, we performed an extensive series of numerical integrations runs in which we varied all parameters in a wide range. These revealed that an important determinant of the topology is the mean degree , where denotes the number of links and the number of agents in the network. Given two evolved networks with similar , one finds that the networks are also similar in other properties such as the componentsize distribution, clustering coefficient, and the fraction of collaborations that are unidirectional. We therefore discuss the topological properties of the evolved networks as a function of , instead of the original model parameters.
We first consider the expected size of a network component to which a randomly chosen agent belongs. In contrast to the BCC’s discussed above, unidirectional collaborations are now taken into account in the computation of component sizes. The value of in the evolved network as a function of is shown in Fig. 6a. The figure reveals that large components begin to appear slightly below . Because of the difficulties related to integrating differential equations, our numerical investigations are limited to networks of up to 100 agents. While it is therefore debatable whether the observed behaviour qualifies as a phase transition, it can be related to the giant component transition commonly observed in larger networks.
In the giant component transition a component is formed that scales linearly with network size. In the absence of higher correlations the transition occurs at [50], where is the mean excess degree of the network, i.e., the number of additional links found connected to a agent that is reached by following a random link.
In ErdősRényi random graphs, , therefore the giant component transition takes place at . In the present model the transition in is shifted to higher values of because of the nature of the underlying snowdrift game. The snowdrift game favors cooperation in the sense that for an agent of degree zero it is always advantageous to initiate an interaction. Therefore is the lowest possible value that can be observed in evolved networks. Further, any evolved network with invariably consists of isolated pairs, which precludes the existence of a giant component. Finally, the relatively narrow degree distribution of the evolved networks implies and therefore at the transition.
To estimate an upper limit for the connectivity at which the giant component transition occurs, it is useful to consider degree homogeneous networks. In these networks the degree distribution is a delta function and , so that the transition occurs at . In the networks evolved in the proposed model we can therefore expect a critical value of between one and two. Based on numerical results we estimate that the giant component transition in the present model occurs at (Fig. 6). At this value a powerlaw distribution of component sizes, which is a hallmark of the giantcomponent transition, begins to show already in relative small networks with .
5 Unreciprocated collaborative investments
While in Sec. 2 we have mainly considered bidirectional links, and in Sec.3 and 4 only distinguished between vanishing and nonvanishing links, we will now focus on unidirectional links, which one partner maintains without reciprocation by the other. The presence of such links in collaboration networks was recently discussed in detail by [44].
For the discussion below it is advantageous to consider the mean degree of agents in a connected component , where and are the number of agents and links in the component. Note that in large components while the two properties can be significantly different in small components. In contrast to , allows us to infer global topological properties: Components with are trees. Components with contain exactly one cycle to which trees might be attached. And, components with contain more than one cycle, potentially with trees attached.
As in the previous section, the term component refers to maximal subgraphs which are connected by bidirectional and/or unidirectional links. According to this definition a component may, beside one or more BCCs, contain agents, which only have unidirectional links. In the following we denote the set of these agents as the nonBCC part of the component (nBCC). For the sake of simplicity we focus on components which contain only one BCC, but note that the case of multiple BCCs can be treated analogously.
Unlike the BCC, the nBCC is not a subcomponent but only a set of agents which are not necessarily connected. Nevertheless, numerical results show that (i*) all nBCC agents make the same total investment and (ii*) all unidirectional links maintained by nBCC agents receive the same total investment . While property (ii*) can be understood analogously to property (ii) of BCCs, property (i*) cannot be ascribed to stationarity or stability conditions but seems to result from optimality restrictions. As a consequence of the properties (i*) and (ii*) the number of outgoing links is identical for all agents in the nBCC.
So far we have decomposed a component into the BCC and the nBCC. Within each subset, all agents make the same total investment, and all links receive the same total investment, therefore each subset can be characterized by two parameters, for BCC and for the nBCC. To recombine the subsets and infer properties of the whole component, we need to study the relation between these four parameters.
The central question guiding our exploration is, why do agents not start to reciprocate the unidirectional investments. The lack of reciprocation implies that the unidirectional links are either less attractive or just as attractive as bidirectional links. We distinguish the two scenarios
 a)

,
 b)

.
In case a) the unidirectional collaborations are as attractive as targets for investments as bidirectional collaborations. In typical networks, where all remaining links receive investments above the IP this implies . Furthermore, in case a) the stationarity condition, Eq. (4), requires that , which stipulates . Therefore the whole component consists of agents making an investment and links receiving an investment .
Conservation of investments within a component implies and hence
(8) 
We know further that , where is the number of outgoing links of an agent in the nBCC. Inserting in Eq.(8) yields , showing that unidirectional links that are as attractive as bidirectional links can only occur in components in which mean degree, , is an integer multiple of 2. This matches the numerical data displayed in Fig. 7a, which shows that is observed in components with and .
It is remarkable that observing in a pair of collaborations is sufficient to determine the mean degree of the whole component. Moreover components in which the mean degree is exactly 2 have to consist of a single cycle potentially with trees attached. In the numerical investigations we mostly observe cycles of bidirectional links to which trees of unidirectional links are attached, as shown in Fig. 8b.
In case b) the bidirectional links are more attractive targets for investments than unidirectional links. In typical networks with this implies . Now the stationarity condition, Eq. (4), demands that , so that unidirectional links receive a higher investment than bidirectional links. By contrast the total investment made by an agent investing in bidirectional links is higher than the one made by agents investing in unidirectional links, i.e.
(9) 
This relationship restricts the connectivity in the BCC to , which implies , because the mean degree of the component cannot be smaller than 2 if a subcomponent already has a degree greater than 2. Therefore, we find that unidirectional links that are less attractive than bidirectional links only occur in components in which the mean degree is larger than , but not an integer multiple of 2 (cf. Fig. 7a). As such links are only found at beyond the giant component transition they occur typically in large components as shown in Fig. 1.
In numerical investigations, we also observe some unidirectional links in components with (cf. Fig. 7b). To explain these we have to consider case b) but relax the assumption that both, and are above the IP. Thus, we obtain case c), about which we know that the unidirectional links are less attractive than bidirectional links, , and that the unidirectional link only receives investments from one agent, i.e., . Moreover, implies and therefore . Therefore
(10) 
which shows that unidirectional links can only appear in components with if the investment received by unidirectional links is smaller than the investment received by bidirectional links. Satisfying and simultaneously requires . The components with , in which such links are found, are trees formed by a core of bidirectional links, to which individual agents are attached by unidirectional links (Fig. 8a). Chains of unidirectional links, as we have observed in case a), cannot appear for as this would mean that some agents would have one incoming and one outgoing link below the IP, which is ruled out by a trivial extension of the reasoning from Sec. 2.
6 Conclusions
In this paper we have proposed a model for the formation of complex collaboration networks between selfinterested agents. In this model the evolving network is described by a large system of deterministic differential equations allowing agents to maintain different levels of cooperation with different partners.
We showed analytically that bidirectionally communities are formed, in which every agent makes the same total investment and every collaboration provides the same benefit. In contrast to models for cooperation on discrete networks, the present model thereby exhibits a high degree of coordination which can be interpreted as a precursor of a social norm. We emphasized that coordination is generally achieved although single agents possess insufficient information for computing the total investment made by any other agent and although the level of cooperation that is reached in a community is not fixed rigidly by external constraints.
Despite the high degree of coordination, we observed the appearance of privileged agents, reminiscent of the leaders emergind in [27]. In the model proposed in the present paper, the privileged agents hold distinguished topological positions of high degree centrality allowing them to extract much higher payoffs than other agents, while making the same cooperative investment. However, we found that in the absence of further mechanism reinforcing differences the assembled topologies were fairer than random graphs.
Although our primary aim was to investigate the formation of social networks, some aspects of the behavior of social agents are reminiscent of results reported in psychology. For instance our investigation showed that agents can react to the withdrawal of investment by a partner either by mutual withdrawal of resources or by reinforcing the collaboration with increased investment. Our analysis provides a rational which links the expected response to the withdrawal of resources to an inflection point of an assumed benefit function.
Furthermore, we investigated under which conditions nonreciprocated collaborations appear. Here, our analysis revealed that such unidirectional collaborations can appear in three distinct scenarios, which can be linked to topological properties of the evolving networks. In particular exploited agents whose investments are not reciprocated invest less than the average amount of resources in their links when occurring in small components, but more than the average amount, when integrated in large components.
We believe that the results from the proposed model can be verified in laboratory experiments in which humans interact via a computer network. Such experiments may confirm the topological properties of the selforganized networks reported here and may additionally provide insights into the perceived cost and benefit functions that humans attach to social interactions.
Furthermore, results of the proposed model may be verified by comparison with data on collaboration networks between people, firms or nations. This comparison may necessitate modifications of the model to allow for instance for slightly different cost functions for the players. Most of these extensions are straight forward and should not alter the predictions of the model qualitatively. For instance in the case of heterogeneous cost functions, players will make different total investments, but will still approach an operating point in which the slope of their cost function is identical. Further, coordination should persist even if the network of potential collaborations is not fully connected. Finally, but perhaps most importantly our analytical results do not rely heavily on the assumption that only two agents participate in each collaboration. Most of the results can therefore be straightforwardly extended to the case of multiagent collaborations.
Our analytical treatment suggests that the central assumption responsible for the emergence of coordination is that the benefit of a collaboration is shared between the collaborating agents, but is independent of their other collaborations, whereas the cost incurred by an agent’s investment depends on the sum of all of an agent’s investments. Because this assumption seems to hold in a relatively large range of applications we believe that also the emergence of coordination and leaders by the mechanisms described here should be observable in a wide range of systems.
The analysis presented in this paper has profited greatly from the dual nature of the model, combining aspects of dynamical systems and complex network theory. In particular our analytical investigations were based on the application of Jacobi’s signature criterion to the system’s Jacobian matrix. Apart from the symmetry of the Jacobian, this ‘doubleJacobi’ approach does not depend on specific features of model under consideration. The same approach can therefore be used to address significant extensions of the present model. We therefore believe that also beyond the field of social interactions, the doubleJacobi approach will prove to be a useful tool for the analytical exploration of the weighted adaptive networks that appear in many applications.
Appendix A Stability condition
To determine the local asymptotic stability of the steady states we study the Jacobian matrix defined by . The terms contained in this matrix can be grouped into three different types
(11)  
(12)  
(13) 
albeit evaluated at different points. For reasons of symmetry
and consequentially , and . Ordering the variables according to the mapping the Jacobian can be written in the form
which is shown here for . As each cooperation is determined by a pair of variables , each occurs twice forming quadratic subunits with the corresponding entries and . Subsequently, we restrict ourselves to the submatrix of , which only captures variables belonging to ‘nonvanishing’ links. As argued before, ‘vanishing links’, i.e. links with , are subject to stationarity condition (5). If , their stability is due to the boundary condition and is independent of the second derivatives of and . Hence, they can be omitted from the subsequent analysis. This means in particular that the spectra of different topological components of the network decouple and can thus be treated independently.
All eigenvalues of the real, symmetric matrix are real. According to Jacobi’s signature criterion the number of negative eigenvalues equals the number of changes of sign in the sequence where is the rank of and , [51]. In a stable system the sequence has to alternate in every step. A necessary condition for stability is therefore alternation in the first steps .
By means of an even number of column and row interchanges the above stated form of can always be transformed such that the first block reads
Since we assume that is a nonvanishing link, and, hence, and to be in the same component, both agents make the same total investment . It follows from definition (13) that and therewith that . Thus, the sequence alternates if
(14)  
(15) 
Equation (15) stipulates that and have the same sign. Of the two possible scenarios
(16) 
the second is ruled out by Eq. (14): If , it follows from Eq. (14) that , which contradicts . Hence, the necessary conditions for stability, Eqs. (14), (15), require
(17) 
If either agent or agent has another bilateral link, say , it is furthermore possible to transform by an even number of row and line interchanges such that the first block reads
(18) 
In this representation the sequence alternates if
(19)  
(20) 
Condition (20) can then be written as
(21) 
Inserting the definitions Eqs.(11)(13) in Eqs. (17) and (21) yields the stability conditions cited in the main text as Eqs. (6)(7).
References
 [1] Axelrod R and Hamilton WD 1981 Science 211 1390–1396
 [2] Doebeli M, Hauert C and Killingback T 2004 Science 306 859–862
 [3] Nowak MA and Sigmund K 2004 Science 303 793–799
 [4] Nowak MA 2006 Science 314 1560–1563
 [5] Axelrod R 1984 The Evolution of Cooperation (New York: Basic Books)
 [6] Nowak MA and May RM 1992 Nature 92 826–829
 [7] Burtsev M and Turchin P 2006 Nature 440 1041–1044
 [8] Hauert C and Doebeli M 2004 Nature 428 643–646
 [9] Eguíluz VM, Zimmerman MG, Cela–Conde CJ and San Miguel M 2005 Am. J. Soc. 110(4) 977–1008
 [10] Santos FC and Pacheco JM 2005 Phys. Rev. Lett. 95 0981041–4
 [11] Ohtsuki H, Hauert C, Lieberman E and Nowak MA 2006 Nature 441 502–505
 [12] Santos FC, Santos MD and Pacheco JM 2008 Nature 454 213–216
 [13] Macy MW 1991 Am. J. Soc. 97(3) 808–843
 [14] Gould RV 1993 Am. Soc. Rev. 58(2) 182–196
 [15] Willers D 1999 Network Exchange Theory (Westport: Praeger)
 [16] Fehr E and Fischbacher U 2003 Nature 425 785–791
 [17] Palla G, Barabási AL and Vicsek T 2007 Nature 446 664–667
 [18] Braha D and BarYam Y 2009 Adaptive Networks (Heidelberg: Springer) 39–50
 [19] Gross T and Blasius B 2008 JRS Interface 5 259–271
 [20] Gross T and Sayama H (Eds.) 2009 Adaptive Networks: Theory, Models, and Data (Heidelberg: Springer)
 [21] Ashlock D, Smucker MD, Stanley EA and Tesfatsion L 1996 BioSystems 37 99–125
 [22] Bala V and Goyal S 2001 J. Econ. Theory 17 101–120
 [23] Bornholdt S and Rohlf T 2000 Phys. Rev. Lett. 84 6114
 [24] Pascuski M, Bassler KE and Corral A 2000 Phys. Rev. Lett. 84 3185–3188
 [25] For a collection of respective publications see http://adaptivenetworks.wikidot.com/publications
 [26] Skyrms B and Pemantle R 2000 Proc. Natl. Acad. Sci. USA 97 9340–9346
 [27] Zimmermann MG, Eguíluz VM San Miguel M and Spadaro A 2000 Adv. Complex Syst. 3 283–297
 [28] Zimmermann MG, Eguíluz VM and San Miguel M 2004 Phys. Rev. E 69 065102
 [29] Zimmermann MG and Eguíluz VM 2005 Phys. Rev. E 72 056118
 [30] Fu F, Wu T and Wang L 2008 Phys. Rev. E 79 036101
 [31] Pacheco JM, Traulsen A and Nowak MA 2006 J. Theor. Biol. 243 437–443
 [32] Pacheco JM, Traulsen A and Nowak MA 2006 Phys. Rev. Lett. 97 2581031–4
 [33] Szolnoki A, Perc M and Danku Z 2008 Euro. Phys. Lett. 84 50007
 [34] Van Segbroeck S, Santos FC, Lenaerts T and Pacheco JM 2009 Phys. Rev. Lett. 102 058105
 [35] Szolnoki A and Perc M 2009 EPL 86 30007
 [36] Poncela J, GómezGardeñes J, Floría LM, Sánchez A and Moreno Y 2008 PLoS one 3 e2449
 [37] Poncela J, GómezGardeñes J, Traulsen A and Moreno Y 2009 New J. Phys. 11 083031
 [38] Fu F, Wu T and Wang L 2009 Phys. Rev. E 79 036101
 [39] Suzuki R, Kato M and Arita T 2008 Phys. Rev. E 77 021911
 [40] Ebel H and Bornholdt S 2002 Preprint arXiv:condmat/0211666
 [41] Zschaler G, Traulsen A and Gross T 2009 Preprint arXiv:0910.0940
 [42] Biely C, Dragosits K and Thurner S 2007 Physica D 228 40–48
 [43] Szolnoki A and Perc M 2009 New J. Phys. 11 093033
 [44] Koenig MD, Battiston S, Napoletano M and Schweitzer F 2008 Preprint CERETH Working Paper 08/95
 [45] Tomassini M, Pestelacci E and Luthi L 2010 Biosystems 99 50–59
 [46] Oliver P, Marwell G and Teixeira R 1985 Am. J. Sociol. 91 522–556
 [47] Heckathorn DD 1996 Am. Soc. Rev. 61 250–277
 [48] This can be shown by taking determinants with into account.
 [49] Baxter LA 1984 J Soc. Pers. Relat. 1 29–48
 [50] Newman ME 2003 SIAM Review 45 167–256
 [51] Zeidler E, Hackbusch W, Schwarz HR and Hunt B 2004 Oxford User’s Guide to Mathematics (New York: Oxford University Press)