Empirical confirmation of creative destruction from world trade data
We show that world trade network datasets contain empirical evidence that the dynamics of innovation in the world economy follows indeed the concept of creative destruction, as proposed by J.A. Schumpeter more than half a century ago. National economies can be viewed as complex, evolving systems, driven by a stream of appearance and disappearance of goods and services. Products appear in bursts of creative cascades. We find that products systematically tend to co-appear, and that product appearances lead to massive disappearance events of existing products in the following years. The opposite – disappearances followed by periods of appearances – is not observed. This is an empirical validation of the dominance of cascading competitive replacement events on the scale of national economies, i.e. creative destruction. We find a tendency that more complex products drive out less complex ones, i.e. progress has a direction. Finally we show that the growth trajectory of a country’s product output diversity can be understood by a recently proposed evolutionary model of Schumpeterian economic dynamics.
Joseph A. Schumpeter held that the key mechanism of economic development is radical innovation [1, 2]. In his view the Walrasian economic equilibrium is continuously disturbed by actions of entrepreneurs, introducing novel goods and services in the market. These innovations may replace existing goods and services and thereby impact related industries. If this happens as a cascading process it is called creative destruction. Current colloquial examples of how once market-dominating companies lose their position due to creative destruction include instant photography or printed newspapers in light of the age of digitalization. But is this only the driving force behind major shifts in industrial production and long-term business cycles, or does it also condition economic change on much shorter time-scales?
This question has been addressed using firm entry and exit dates , job creation and destruction rates , within specific countries  or within specific industries . These works capture the complex interplay between factor re-allocation and productivity growth in existing economic sectors. However, little is added to our understanding of the impact of emerging industries on the development of already established parts of the national economy. If a new industrial branch emerges, how does this impact other economic sectors?
Traces of the creation of unprecedented industries can be observed using world trade data. We study the dynamics of the diversity of export products and show that the process through which it changes follows the patterns of creative destruction. The set of products a given country exports reveals the presence of the nontradable inputs or capabilities that the products require for their production (e.g. specific productive knowledge, infrastructure, legal system, labor skills, regulations, etc.) [7, 8]. In this view capabilities are elementary building blocks and each product requires a combination of them to be manufactured. A change in the diversity of a country’s product basket indicates a change in its set of capabilities. New capabilities may lead to new products and the abandonment or substitution of already existing products or capabilities. Products requiring one of these abandoned capabilities as input will then disappear, while simple products that require only subsets of capabilities of more complex products may disappear as they are unable to compete for these inputs – creative destruction at work.
In this article we show that typically within a country clusters of products appear simultaneously in bursts. We interpret such a burst as the acquisition of a novel capability which is required as input for each of the newly appearing products. In the years following creative bursts there is an increased chance that already existing products will cease to be exported, that is, emerging industries effectively push out the old ones. The novel products tend to be more sophisticated and complex than the disappearing products, i.e. progress has a direction. Interestingly, we do not observe a higher probability of product appearances following disappearance events of products. This means that the canonical mechanism of filling ”market niches” is not a significant feature of the data. We confirm empirically that creative destruction, cascades of competitive replacement, plays an important role in the development of national economies.
We apply a recently proposed Schumpeterian diversity dynamics model  to account for the evolution of the product diversity of countries. In this model entrepreneurs use and combine available capabilities to create novel goods and services and substitute them for already existing ones. The result is a model economy in a self-organized critical state, characterized by creative and destructive co-evolutionary avalanches. The changes in product diversity and the distribution of product appearances and disappearances observed in world trade data are well explained by this model. We base our results on the World Trade Flows database compiled by the National Bureau for Economic Research .
1.1 Diversity dynamics
The World Trade Flows database  contains exports of approximately 200 countries over the years 1984-2000 in about 800 product categories (4-digit SITC rev.2 classification). We include only those countries in the analysis which have a population of at least 1.2 million people and total exports of at least 1 billion USD, for more information see Text S1 in the SI. We label the countries contained in this database by , the product category by and the year by . The export values , denominated in USD are then extracted. As a diversification measure of country in year the number of products with nonzero export values is used, that is, . The total number of countries is denoted by , the number of products by .
The change of diversity of product exports in world trade data over a timespan of 16 years is shown in Fig.1(a)-(c). For each country index the diversity is shown for two different years, in Fig.1(a) and in Fig.1(b). The net change in diversity for each country between 1984 and 2000, is shown in Fig.1(c). Values from trade data are shown in blue and are compared to results of the Schumpeterian diversity dynamics model (in red, to be explained below). There is a general trend towards increased diversity. Countries with a relatively low or high diversity in 1984 show smaller fluctuations in diversity than countries with intermediate initial diversity. That is, countries with a low diversity tend to stay poorly diversified, fully diversified countries stay fully diversified. In between there is a regime of transition countries, some of them showing explosive growth in terms of their economic diversity. We show later that these observations can be described through the onset of a ’creative phase transition’ , a distinguishing property of Schumpeterian diversity dynamics. Let us now empirically investigate the process by which the countries’ product export diversities change.
Let be a product indicator function for the appearance of product in country between year and ,
Similarly the indicator function for a product disappearance is
with a threshold value set to 100,000 USD. For more details see Fig. S1 Fig.1(d) and (e) show the distribution of (dis)appearance events () per country and product for world trade data and the Schumpeterian diversity dynamics model. They are far from being homogeneously distributed. For example, the number of appearance events per country varies between more than 300 and almost zero across different countries. Further there is a substantial number of products appearing in, say, five countries or less, while others appear in almost one third of all the countries studied. The model captures the functional form of these distributions. The number of appearances clearly exceeds the number of disappearances, consistent with the general trend towards higher diversity.
1.2 Co-occurrence analysis
Creative destruction can be described as a process started by introducing novel goods or services in a national economy. If successful, this stimulates the market introduction of related goods, complimentary to the newly introduced ones. Thereby a novel cluster of inter-related products can form. This cluster may render existing parts of the national economy obsolete. If this process is actually at work within national economies, one would expect two empirical facts to hold. To pin down this very process empirically, one needs to measure two features, (i) products enter the market in creative bursts, i.e. not incrementally and (ii) the appearance of goods tends to foster the disappearance of other products. We quantify this with two different product indicators referred to as ’Schumpeterian Product Indicators’ (). The first is introduced to assess co-occurrences of product (dis)appearances and is denoted . Here and stand for any combination of events for product . The second measures if an appearance or disappearance event of products at is correlated to an event of another product within the following years and is denoted by .
The marginal appearance (disappearance) frequency () for each product is given by
The number of co-appearances of products and across all countries and times is,
The co-occurrence111By co-occurrence we will refer to any of the four possible pairs of events for two products and , that is (dis)appearance in together with (dis)appearance in . statistics and are obtained by appropriately substituting disappearance events for in Eq. 4. Obviously products with a relatively high number of appearances will also be more likely to co-appear. Consequently whenever one compares co-occurrence statistics of two different pairs of products one has to correct for this bias. A simple way to do this is to compare the number of measured co-occurrences of two products to their marginal (dis)appearance frequencies given in Eq. 3. For this we define the pairwise conditional co-occurrence measure as . The idea is that given two products and we take the product with the higher appearance probability, say , and measure how often appears conditional on an appearance event of in the same country. To quantify in how many co-occurrence events a given product participates, one can define an for simultaneous appearances by
where is a normalization factor given by guaranteeing that the index lies within the range and is thus comparable across datasets of different sizes. It is straight forward to define s for other pairs of events .
We proceed to quantify to what extent an appearance event in year is related to disappearance events at a later time . Assume a maximal lag of years between the two events, . If not denoted otherwise, we work with a value of years. A simple measure is the number of all appearances of which are followed by disappearances of within the next years in the same country and summed over all countries, i.e. . This number can be compared to the count of appearances of product followed by disappearances of , i.e. we exchange the roles of and . If there an asymmetry emerges when exchanging and in , this indicates that appearing before disappears is observed more often than the other way around. In this spirit, for each product a time-lagged is defined as
This index is within the range . Intuitively, if one thinks of the appearance of followed by disappearance of within a country as a replacement, a positive value of means that, on average, replaces more often any other product than itself is replaced by . The higher the value for , the higher the tendency that can act as a substitute for other products.
1.3 Products appear in bursts
In Fig. 3 we show the maximum spanning tree for products obtained from the pairwise conditional co-appearance measure, . The clusters highlighted there point at a non-random structure in product co-appearance dynamics. To make this structure explicit we compare values for trade and the surrogate data, see histogram in Fig. 2(a). A huge difference between trade and surrogate data is found. This indicates the presence of strong temporal correlations between individual product appearances. Products appear simultaneously in bursts. A way to interpret this is that the co-appearing products require a common capability to be manufactured. When a national economy acquires this capability the corresponding cluster of products can appear. In this sense the observation of a newly emerging cluster of inter-related products serves as a proxy for a country’s development of a novel capability. This process is not unique within a given country, it can be observed in a substantial fraction of them (since the indicator values are averages calculated over more than one hundred countries). This may hint at common patterns in the diversification trajectory of individual national economies.
1.4 Creative destruction at work
There is a tendency for specific products to substitute or replace others. This can be seen as deviations in the distribution of indicator values between world trade and surrogate data, see Fig. 2(b). A high value of corresponds to the dominance of the pattern: ’product appears and disappears later in the same country’ in a large number of them independently. This is a direct fingerprint of creative destruction at work, i.e. emerging industries pushing out the old. It is interesting to note that the opposite process – the disappearance of a product is followed by the appearance of another one – is not observed to a significant extent, see Figs. S2 and S9. For the case surrogate and data are practically identical. To measure the statistical significance of deviations from the surrogate data we formulate the null hypothesis that both surrogate and trade data are drawn from a normal distribution with the same mean. The -value using the alternative hypothesis that the trade data shows a higher mean than the surrogate data is computed for all four possible combinations: , , , and . The results are listed in Tab. 1, together with -values from various robustness tests as described in the SI. This series of tests confirms that the results above are not a consequence of trivial effects such as fluctuations in the trade records (case ’ = 200k USD’), the artificial creation of product categories due to changes in reporting schemes (’all products with positive exports’) or the transition out of communism of former Soviet countries (’Excl. FSU’), see SI. Results are also robust with respect to changes in the time-period (’1989-2000’), the choice of the maximal lag (’’,’’) or the underlying dataset (’UN Comtrade data’).
1.5 Progress has a direction
Is it true that more complex products replace less complex ones? Do products produced by richer countries replace products associated with poorer ones? To elucidate this, we quantify the change in complexity and income levels associated with individual processes. The creative destruction dynamics is dominated by products with a high value of or . and are thus measured for each process with , where the appearing (disappearing) product has one of the hundred highest values of (). A positive indicates an increase in economic complexity of the country where this process was observed. A positive indicates that the country is upgrading its exports towards those made by richer countries. Histograms for and are shown in Fig. 4. There is a clear skew to the positive side for both quantities. Products with a higher tendency to be pushed from the market have in general lower economic complexity than products from appearing industrial branches.
One could imagine that this effect is stronger in emerging economies than in mature ones. To test this, one can compare and distributions for different economies by aggregating the countries into seven regions (Latin America and the Carribean, East-Asia and the Pacific, Middle-east and North-Africa, Sub-Saharan Africa, South-Asia, Western Europe and Northern America, Eastern Europe), as done in the SI. A clear development towards higher economic complexity can be seen for Latin America, Eastern Europe and East Asia & Pacific. The other regions do not display such a strong trend. Western Europe and Northern America are already almost fully diversified and stay that way, whereas e.g. Sub-Saharan Africa stays in the low diversity regime. These results are discussed in more detail in the SI.
1.6 Which products are the killers?
Let us get a clearer picture about the products driving the creative destruction process. Are there Leamer classes whose products appear more often than others? Which types of products disappear instead? We consider the matrix . Each product can be assigned to one of ten Leamer classes, labeled by , . One can obtain a measure for processes where products from class appear and products from disappear by computing the mean value of over all products from the respective Leamer classes. To this end is defined. As before, we are only interested in the ’net flow’ of processes, the antisymmetric Leamer transition matrix, . This is basically the same measurement strategy as discussed for , however aggregated to the level of Leamer classes. The matrix is shown in Fig. 5.
A positive value of indicates that an appearance event of a product from class followed by disappearance of a product from , is more often observed than an appearance from followed by disappearance in . Given that processes convey information about how national economies are re-structured over time, positive values in indicate which parts of the economy are abandoned or disappear because of which other parts. There is a clear trend. Capital and labor intensive products, as well as machinery and chemicals appear much more often than they disappear. Agricultural products and cereals tend to disappear. This intuitively confirms that markets re-structure themselves towards higher economic complexity as observed in Fig. 4. Note that these observations can not be described by diffusion or migration processes of e.g. production facilities or capabilities from one country to another. Each measurement of appearances followed by disappearances takes place within a single country. A product appears within a country and another product disappears later within the same country.
= 200k USD
all products with positive exports
cleaned data 1989-2000
UN ComTrade data
1.7 A simple model
A recently introduced Schumpeterian diversity dynamics model  centers around the assumption that countries have an evolving set of capabilities which firms combine to manufacture products, see SI. The economic state of a country is represented by two (high-dimensional) binary vectors, one indicating whether a country has a given capability, the other indicating whether a country exports a given product. These vectors evolve over time in each country. Capabilities can be acquired through entrepreneurs who combine existing capabilities. For example, an existing production infrastructure and a certain type of knowledge stock can be combined to acquire an upgraded production facility. This scheme is shown in Fig. 6, where capabilities are represented by blue squares. In this case capability is a combination (blue ellipse) of and . The model capability assumes that if a country has capability and , it will acquire in the next time-step.
Each product requires a set of capabilities in order to be produced. In the model a country exports a product if it has all necessary capabilities. The simplest possible case (one capability needed for one product) is shown in Fig. 6 where products are represented by red circles. Product requires capability , product requires . As soon as a country acquires , it will start to report exports in . Since one capability may be required for more than one product, all of these products may co-appear with .
Capabilities can also be lost or abandoned. There is a chance that may act as substitute for . In this case the acquisition of capability renders obsolete. With some probability capability is thus abandoned or destroyed because of . As a consequence will then no longer be exported.
In the model it is further assumed that the rules of how capabilities can be combined, substituted and used as inputs for products are identical in each country. Economies only differ by their initial diversity of products (from which the implied diversity of capabilities is calculated). The model is iterated until the number of model (dis)appearances matches the number of events observed in the trade data. Fig. 1 shows a comparison of (a) initial and (b) final product diversity, (c) net diversity change and the number of appearances for each (d) country and (e) product for model and trade data. The complex observed patterns of creative destruction can be explained by the almost embarrassingly simple process of recombining and substituting capabilities. The crucial feature of the model is the existence of a creative phase transition with a position depending on the initial diversity [15, 16]. If it is below a certain threshold, there are not enough capabilities available to find successful combinations of them. If a country is at, or above this threshold the creative destruction process kicks in, restructuring the market . For a complete model specification, including dynamical algorithm, see the SI.
The main novelty of the approach in this article is to identify, in a large sample of countries, the existence of a systematic relationship between the appearance of new industries and the appearance or disappearance of other industries within the same country. In particular our analysis reveals that (i) products appear cluster-wise in creative bursts which consequently (ii) increases the chance for other, already existing products to be pushed from the market and (iii) the emerging products are typically associated with higher income and a higher level of economic complexity. The effect of shifting production towards higher complexity is strongest in the developing countries of Latin America, Eastern Europe and East Asia and Pacific and barely visible in the least developed countries or Europe and North America (see SI).
These observations can be explained within an evolutionary model of Schumpeterian economic dynamics . Just as the product portfolio of countries can be explained as a consequence of the presence of productive capabilities in that country , changes in a country’s product portfolio can be understood through the evolution of its capabilities. Entrepreneurs (firms) upgrade and recombine existing capabilities to create innovations. These may substitute existing industries, restructuring the market. Such a system can exist in three different modes [15, 16]. First, if the initial number of capabilities is too low to allow for a sufficient number of novel combinations, the creative destruction process may not set in at all. Second, if the country is already fully diversified progress is also slowed down. In between these regimes there is a third, transition regime, where the creative destruction process is most effective. We calibrate the model with initial product diversities and (dis)appearance rates observed through world trade data, and can reproduce (i) the position of the transition regime from low to high diversity, (ii) the patterns of (dis)appearance frequencies per country and (iii) the distribution of (dis)appearance frequencies for individual products.
Beyond finding evidence of creative destruction in a large set of national economies, this paper also helps to further reveal the complex topology of industry relatedness. Understanding
3 Materials and methods
3.1 Surrogate data
For the purpose of statistical analysis we construct a surrogate dataset with the aim to destroy the correlations in the timing of (dis)appearances while the event statistics (as shown in Fig.1 (d) and (e)) are preserved. The surrogate data is prepared as follows. Each event is given by a triplet where index runs over all appearance (disappearance) events in the data. For each we fix and while shuffling the years between the events in the triplets. Formally this defines a random permutation over the set of all event indexes . One may then calculate the co-occurrence measures from the triplet and average the result over many realizations of . This ensures that the marginal distributions of the events (Fig. 1 (d) and (e)) remain unchanged while all correlations in the timing of appearances or disappearances are destroyed.
The creative bursts of cluster-wise co-appearing products can be effectively displayed as a network. The pairwise conditional co-appearance measure, , allows to construct similarity matrices for product categories from which the maximum spanning tree, shown in Fig. 3. is constructed (see SI). Nodes in the network represent product categories according to the SITC rev.2 4-digit classification. The color of the nodes represents the products’ Leamer classes . This is a classification based on relative factor intensities such as amount of capital, labor, land, skills etc. A similar route has been followed to construct the product space . Fig. 3 suggests that the clusters of co-appearing products require one or several common capabilities. Once a country acquires or upgrades these capabilities, it starts to report exports in these product categories. Their appearances are simultaneously observed as a creative burst within the same Leamer class.
3.3 Product Indicators
Product Income Indicator PRODY. This indicator for a given product is the weighted average of the per capita GDPs of countries exporting it. It is a weighted average of the income per capita of the countries that have revealed comparative advantage in that product . A more sophisticated product, in principle, should be made by richer countries. Let us define the difference in for products and as appears at disappears at with .
Product Complexity Indicator. The Product Complexity Index is an indicator for the economic complexity involved in manufacturing a given product . The is a combination of the ubiquity of a product (i.e. the number of countries that make it) and the economic diversity of its exporting countries, see SI for more details. Products with high typically are made by few highly diversified countries which is indicative of high economic complexity . The change in complexity between two products is given by appears at disappears at , .
Killer Index. We refer to as the ’Killer Index’ for each product . It measures the likelihood that the appearance of a given product is observed with the disappearance of any other product in the next years.
Extinction Index. The likelihood that a product disappears together with the appearance of any other product years earlier is expressed by its ’Extinction Index’ . We set .
We acknowledge extremely helpful discussions with Rudolf Hanel and financial support from FP7 project CRISIS.
-  Schumpeter JA (1942) Capitalism, Socialism and Democracy (Harper, New York).
-  Thurner S, Klimek P, Hanel R (2010) Schumpeterian Economic Dynamics as a Quantifiable Minimum Model of Evolution. New J Phys 12: 075029.
-  Bartelsman EJ, Haltiwanger JC, Scarpetta S (2004) Microeconomic Evidence of Creative Destruction in Industrial and Developing Countries. IZA Discussion Paper No. 1374; Tinbergen Institute Discussion Papers No. TI 2004-114/3; World Bank Policy Research Paper No. 3464.
-  Caballero RJ, Hammour ML (1996) On the Timing and Efficiency of Creative Destruction. Q J Econ, 111 (3): 805-52.
-  Aghion P, Fedderke J, Howitt P, Kularatne C, Viegi N (2008) Testing Creative Destruction in an Opening Economy: the Case of the South African Manufacturing Industries. Observatoire Francais des Conjonctures Economiques (OFCE) 2008-23.
-  Tripsas M (1997) Unraveling the Process of Creative Destruction: Complementary Assets and Incumbent Survival in the Typesetter Industry. Strategic Manage J 18: 119-42.
-  Hidalgo CA, Hausmann R (2009) The Building Blocks of Economic Complexity. Proc Natl Acad Sci USA 106 (26): 10570-5.
-  Hausmann R, Hidalgo CA (2011) The network structure of economic output. J Econ Growth 16 (4): 309-42.
-  Hidalgo CA, Klinger B, Barabasi A-L, Hausmann R (2007) The Product Space Conditions the Development of Nations. Science 317: 482-7.
-  Feenstra RC, Lipsey RE, Deng H, Ma AC, Mo H (2005) World Trade Flows: 1962-2000. NBER Working Paper Series, 11040. http://www.nber.org/papers/w11040.
-  http://comtrade.un.org/ (retrieved March 2011).
-  Leamer E (1984) Source of Comparative Advantage: Theory and Evidence. (MIT Press, Cambridge MA).
-  Hausmann R, Hwang J, Rodrik D (2007) What You Export Matters. J Econ Growth 12 (1): 1-25.
-  Hausmann R, Hidalgo CA, Bustos S, Cocia M, Chung S, Jimenez J, Simoes A, Yildirim MA (2011) The Atlas of Economic Complexity: Mapping Paths to Prosperity.
-  Hanel R, Thurner S, Kauffman SA (2005) The Phase Transition of Random Catalytic Sets. Phys Rev E 72: 036117.
-  Hanel R, Thurner S, Kauffman SA (2007) Towards a physics of evolution: critical diversity dynamics at the edges of collapse and bursts of diversification. Phys Rev E 76: 036110.
Supplementary Information for ’Empirical Confirmation of Creative Destruction’
Appendix A Description of Datasets
We use two independent data sets in this work.
NBER trade data . Compiled by the National Bureau of Economic Research, this set of bilateral trade data by commodity spans the period 1962-2000. Trade flows (in USD) are reported in product categories following 4-digit SITC rev.2 classification. This dataset is a combination of two others, spanning 1962-1983 and 1984-2000 respectively. We work with the timespan 1984-2000 to exclude any possible artifacts in the results due to changes in data collection between these two timespans. The NBER trade data introduces artificial product categories (containing ’A’s and ’X’s in the SITC code) to account for differences in import and export records (i.e. if country A exports to countries B,C, but A’s export record deviates from (B+C)’s import records). We only focus on export data and exclude these artificial product categories. Finally, we only include ’real’ countries (the dataset also lists world regions, such as Southern Asia or Oceania, etc.). This results in longitudinal trade data for 200 countries in 800 product categories over 17 years.
COMTRADE trade data . The United Nations Commodity Trade Statistics Database (UN COMTRADE) publishes annual international trade statistics data by commodities and partner countries. We use data from the timespan 1990-2010. Export values (in USD) are reported in HS1992 product categories for over 170 countries (again, leaving aside world regions), amounting to roughly 5000 categories over 21 years.
Let be a product indicator function for the appearance of product in country between year and ,
Similarly the indicator function for a disappearance event is
Note that these definitions are only useful if there exists a data record for at both and . We exclude small countries from the analysis by demanding a population of at least 1.2 million people and total exports of at least 1 billion USD, leaving us with a list of 125 countries. The reported results for the SPI where computed over the timespan 1984-2000. Individual trade flows between countries are only included if they exceed 100000 USD Furthermore, appearance and disappearance events are not included if one of the following is true.
In the year before product appears (or after disappears) in a country , the country reports positive exports in less than fifty different categories.
The diversity time-series of the product does not belong to one of the four types shown in Fig. S1.
After these filtering procedures we assign each product a appearance or disappearance event (or no event at all). If existing, each product in each country is assigned a unique appearance (disappearance) event which is its first (last) measured event. For this particular event we set () and zero at each other point, in Fig. S1 appearance events are highlighted by green slashed lines, disappearances by red dashed lines.
Appendix B Robustness
Several types of robustness checks are conducted. The analysis is repeated with a threshold of 200,000 USD for export values, that is whenever we set . The results remain basically unaltered and are thus not driven by small, fluctuating export values, see column ’threshold’ in Tab. 1. The next check concerns artificial product appearances / disappearances due to the creation or abandonment of product categories or countries. To this end only product categories are included in the analysis which have positive world exports in each year. This does not affect the analysis, see column ’all products with positive exports’. Thirdly the influence of the time-span on the results was checked. The time-span was reduced to 1989-2000, see ’cleaned data 1989-2000’. Former communist transition countries from the FSU are excluded in the column ’Excl. FSU’. Then the maximal time lag is varied to and years respectively. Finally the same analysis is carried out with the UN ComTrade data.
Appendix C Maximum Spanning Tree
The MST is the network with the least number of links with the highest possible weights spanning each node of the network. It can be computed using Kruskal’s algorithm. The MST can be regarded as the ’skeleton’ or ’backbone’ of a network. It positions each node in the neighborhood of other nodes to which it has strong ties and is therefore reminiscent of hierarchical clustering procedures.
Appendix D Result for COMTRADE database
All results reported in the main text can also be found in the COMTRADE database. We have chosen to work with the NBER data for the following reasons. The product classification employed for COMTRADE has gone through several revisions, namely HS1992, HS1996 and HS2002. Each of these revisions causes artificial appearances and disappearances (due to re-classification of products). At the time the dataset was extracted a substantial amount of trade data was still to be reported causing artificial disappearances, thus one can only effectively work with the range 2000-2009. The NBER database, on the other hand, is the outcome a collaborative research effort to provide a coherent dataset. For example, if a country only reports its trade flows in 3-digit SITC or an older revision, this is painstakingly checked against the reports of the trade partners and records from the US trade database to ’fill the gaps’. This reduces the number of artificial appearances and disappearances. A detailed description of how the NBER data was composed can be found in . -Values for the comparison of trade and surrogate data are shown in Tab. 1, column ’COMTRADE’
Appendix E Further results on product comparisons
The PRODY value was computed as in  using NBER trade data as an average over each PRODY from the timespan 1993-2000. To compute the PCI we extract the matrix of significant exporters as defined in  from the NBER trade data for each year from 1993-2000. Using and one computes the matrix . The PCI is the average over all years of the eigenvector associated with the second largest eigenvalue of . Fig.3 shows how these two indexes are related.
Appendix F Further results on country comparisons
Not each region in the world shows the same pattern of development towards higher economic complexity. We repeat the analysis of complexity change associated with processes for countries from Latin America and the Carribean, East-Asia and the Pacific, Middle-east and North-Africa, Sub-saharan Africa, South-Asia, Western Europe and Northern America, as well as Eastern Europe separately. That is, we use only countries from the respective regions, compute for these countries and compute and as described in the main text, see Fig. S4. Transitions towards higher economic complexity (skew to the right in the histograms) is clearly visible for Latin America and Eastern Europe. In other regions this trend is less visible or even absent. This supports the notion of ’critical economies’ where Schumpeterian economic evolution is successful at work. These critical economies can be identified as transition countries. For low diversity countries (compare e.g. Sub-saharan Africa) there is simply ’too little to start with’ in order to move towards higher economic complexity, with respect to this they can be called ’sub-critical’. Fully diversified countries (compare Western Europe and North America) also defy this trend. Since they are already at the top of the ’complexity scale’, there is not much room for improvement here. This may be due to an too coarse resolution of the standard product classification. These countries can be dubbed supra-critical.
Eastern European countries have undergone a major shift in their political regimes in the timespan we use for the measurement. One may wonder whether the shift towards higher economic complexity is due to developments under the centrally planned economy before 1990 or afterwards. The analysis is repeated for these countries using the timespan 1984-1989, see Figs. S5(a) and (b). Compare these histograms to the ones observed between 1990-2000 in Figs. S5(c) and (d). There is no clear movement towards higher complexity before 1990. This suggests that the move towards higher complexity observed later is due to the shift from a centrally planned to a free market economy.
In analogy to the SPI a Schumpeterian Country Index SCI is defined for and as
We show that the SCI measure is not an artifact of the number of appearances alone in Fig. S6, where the SCI for each country is plotted against the number of appearances in this country. Countries like Portugal and Hongkong have one of the lowest ranking SCIs, Ecuador and Lithuania one of the highest ranking ones. But each of these countries have rougly the same number of product appearances.
Countries with lowest ranking SCI values are countries which are either already fully diversified and show thus only little activity in terms of (dis)appearances (USA, Germany, France, China, UK, …) or countries with constant low diversities (Malawi, Gabon, Uganda, …). Countries with a relative high SCI include Uruguay, Kuwait, Croatia, … and tend to be bridge countries between these two regimes. Fig. S7 shows countries and their SCI and Gross Domestic Product (GDP) per capita of 2000. Western countries are mostly found at the bottom right (low SCI and high GDP), poor countries to the bottom left (low SCI and low GDP), countries with high SCI form a bridge between those two regimes.
The virtues of having or not having a product are shown in Fig. S8. For each country we compute the average PRODY value of products which are not exported by this country as of 2000. High GDP countries (compare Canada, Austria, USA, Norway, Sweden, …) do not export products which have on average a significant lower PRODY than developing and least developed countries. There are some outliers, for example oil exporting countries achieving a high GDP per capita with low complexity products.
Since the transition countries from the Former Soviet Union are main contributors to the process, as can be observed from the previous results shown in Fig. S4, Fig. S6 and Fig. S7, it is worth to show that the significance of the results is not due to the contributions of these countries alone. To this end we compute histograms for for a set of countries excluding the FSU and Eastern Europe, see Fig. S9 and the respective column of -Values in Tab. 1 entitled ’Excl. FSU’.
Appendix G Schumpeterian Evolutionary Model
The occurrence of bursts of creation (product appearance) and destruction (product disappearance) is a prominent feature of Schumpeterian economic dynamics . We show that this model can be used to describe the development of national economies in terms of product (dis)appearances as Schumpeterian ’gales of destruction’. The model is a variant of  with some features proposed by . The components of the model are now described in detail.
g.0.1 Model Components
Products. For each country the binary product vector records whether product is currently produced () or not (). To produce it is required to possess a specific set of capabilities.
Capabilities. A country’s product portfolio is determined by the available nontradable capabilities residing in it . Each country ’s set of capabilities is described be a time-dependent vector with binary components. The ’th entry in indicates whether the capability is available in country at time () or is not available (). The total number of capabilities which can be acquired is fixed to some .
Productions - Capability Gain. Capabilities are acquired through a novel combination of already present capabilities. This is encoded in the production rule table . If capability can in principle be acquired through a combination of and then , otherwise . Note that each the production rule table is the same for each country. The production process is then given by
There are on average unique and different production processes for each capability , with and chosen at random from the entire set of capabilities.
Product disappearance. If a product requires a set of capabilities which is a subset of capabilities required to produce another product, it may disappear. The idea is that the product with the larger set of capabilities is a more complex and advanced product substituting its antecedent (e.g. wikipedia replacing an encyclopedia). Assume product requiring capability and product requires capability . If there is a production rule then product requires capability and and is thus an improved version of product . We incorporate this as competitive replacement in the model by assuming that with probability a production rule for leads to a negative influence on . For this the destruction rule table is introduced. It encodes whether capability leads to a substitution for () or not (). The destruction process is given by
The destruction rule table is ubiquitous for each country.
Migration of Capabilities. In addition to the deterministic production and substitution processes there is a stochastic migration of capabilities among the countries. With probability a capability migrates from a country to another, randomly chosen country . If we set and with probability .
From Capabilities to Products. Each product needs different capabilities as input. This is accounted for in the capability product matrix . If product requires capability then , otherwise . Thus each column has randomly distributed nonzero entries. In each timestep it is checked for each product whether its set of required capabilities is present. Thus if and only if .
g.0.2 Dynamical Algorithm
The Schumpeterian dynamical algorithm for this model is given by:
Pick a country at random.
For each capability with , set and with probability (where is another randomly chosen country).
Pick a capability at random.
Sum all productive and destructive influences on , that is compute . If () then (), otherwise .
Continue picking capabilities until all capabilities have been updated, then go to the next country.
Once all countries have been updated, update the product vectors and go to the next timestep.
The model is initialized with a number of countries and products taken from the data. As further model input serves the number of products that each country exports at the initial time-step (corresponding to 1984 for the data). Let this diversity be . We set with probability . This guarantees that the initial model diversity equals . After initialization, the model is iterated over time-steps. Assume that we compare the model to an empirical timeseries over years. The resulting model trajectories are segmented into segments of equal length (’model years’). The value of is chosen such that the absolute number of appearance and disappearance events is the same in model and real world data. This rescaled model data is now called and can be compared to the real world data . We will denote model entities by a bar, e.g. denotes appearance events obtained from via the same procedure as for .
The results of a comparison between the Schumpeterian diversity dynamics model and world trade data are summarized in Fig. 1. Here the model parameter , , , . All other model parameters can be measured in the data. In Figs.1(a),(b) the initial and final product diversities for each country are shown. In both cases the countries are ranked by diversity. Per calibration the initial diversities are equal. The final diversities (b) also overlap to a large extent. A more detailed view of this is given in Fig. 1(c). Here the increase in product exports for countries of a given rank is shown. A remarkable peak is visible in both model and trade data. In the model this is explained by the onset of a creative phase transition ,. As a country gradually acquires novel capabilities it eventually reaches a point where it has accumulated enough critical capabilities to diffuse into the entire product space. Creative bursts of diversification are the consequence. Countries below this critical point experience stagnation, whereas countries above this threshold reach a fully diversified plateau.
The results reported are independent of . The variable merely sets the time-scale for . The parameters and determine the number of capabilities required for creative bursts to set in, that is the phase transition to a fully diversified country. Changing these values rescales the peak in Fig.1(d). The main conclusions however remain intact.