Intelligent Agents in Co‑Evolving Knowledge Networks

: We extend the agent‑based models for knowledge diffusion in networks, restricted to ran‑ dom mindless interactions and to “frozen” (static) networks , in order to take into account intelligent agents and network co‑evolution . Intelligent agents make decisions under bounded rationality. This is the key distinction of intelligent interacting agents compared to mindless colliding molecules , involved in the usual diffusion mechanism resulting from accidental collisions. The co‑evolution of link weights and knowledge levels is modeled at the local microscopic level of “agent‑to‑agent” interaction . Our network co‑evolution model is actually a “ learning mechanism” , where weight updates depend on the previ‑ ous values of both weights and knowledge levels. The goal of our work is to explore the impact of (a) the intelligence of the agents, modeled by the selection‑decision rule for knowledge acquisition, (b) the innovation rate of the agents, (c) the number of “top innovators” and (d) the network size . We find that rational intelligent agents transform the network into a “centralized world” , reducing the entropy of their selections‑decisions for knowledge acquisition. In addition, we find that the average knowledge , as well as the “knowledge inequality” , grow exponentially.


Introduction
The increasing complexity of the highly interconnected 21st century economy [1][2][3][4] is modeled in terms of knowledge networks [5][6][7]. The emerging dynamics of knowledge in complex networks depends on 11 Conditioning Factors (CF) [8][9][10][11]: The dependence on network structure (CF1) was studied for regular, random, and smallworld networks [12][13][14], as well as for scale-free and hierarchal networks [15][16][17]. The dependence on network evolution (CF2) was studied for networks with probabilistic edgerewiring [18][19][20][21]. The presence of agents creating knowledge (CF3) increases significantly the speed of knowledge growth [22,23]. However, the knowledge stock is rising with The paper is organized as follows. The relevant definitions and assumptions of our model are presented in Section 2. The parameter values of the simulations, as well as the assessment criteria for the emerging dynamics are presented in Section 3. The impact of different probabilistic selection rules (CF7), of different innovation rates (CF3), of different numbers of "top-innovators" (CF3) and of different network sizes in Sections 4-7 correspondingly. The key findings of our work are summarized and discussed in Section 8.

The Model
We formulate knowledge diffusion in networks of agents, assuming that each agent selects another agent to gain knowledge, at each time = 0, 1, …. We provide below the relevant definitions and modeling assumptions.

Definition 1. (Knowledge Networks).
Knowledge networks consist of agents, denoted as = 1, 2, … , , with knowledge levels ( ) at time = 0, 1, … Knowledge levels are non-negative real values ( ) ≥ 0 so that, agents with higher knowledge level are effectively more knowledgeable than agents with lower knowledge level. Knowledge levels may be assessed by experts using any methodology [30]. The links of the network are the communication channels between the agents through which knowledge is transferred. Each link → is characterized by the corresponding weight w → ( ) = w ( ). The weight w ( ) incorporates the knowledge transfer efficiency from agent to agent , taking values 0 ≤ w ( ) ≤ 1. The diagonal weight (self-weight) w ( ) incorporates the capability of agent for innovation, taking non-negative values w ( ) ≥ 0.

Assumption 1. (One Agent is Selected at a Time).
The knowledge upgrade of each agent during the time interval ( , + 1] is the difference: ( + 1) − ( ). The durations ( , + 1] are selected-specified so that the knowledge of the agents may change by one "link event" only among their in-neighbors. In this way, the reduction of efficiency and reliability associated with multi-tasking is avoided [31][32][33]. However, in the other direction, an agent may have more than one disciples at the same time [12,17,34].

Definition 2. (Probabilistic Selection Rules for Knowledge Acquisition).
The selection of the in-neighbor by agent , with ≠ , for knowledge acquisition is specified by the value of the selection-decision function I ( ). Each selection function I ( ) implements some selection rule I, specified by the corresponding selection probability p I ( ). For example, I ( ) = means that agent was selected by agent at time with probability p I ( ). Each selection rule I indicates the bound of rationality of the intelligent, rationally selecting agent [25,26]. Agents with lower bound of rationality are considered as more intelligent. The bound of rationality is lower, when decisions-selections are more effective. We consider four representative probabilistic selection rules [9] (Table 1). The term is the Iverson bracket [35] which converts Boolean values to numbers 0, 1:

Assumption 2. (Knowledge Transfer is Unidirectional).
Knowledge transfer between two agents may take place only from the agent with higher knowledge to the agent with lower knowledge, i.e., agent may upgrade his/her knowledge level by the selected in-neighbor agent , only if: ( ) − ( ) > 0. The opposite direction is never realized. This assumption is a "Filtering Rule" (B) over the set of in-neighbors, regarding the possibility for knowledge upgrade of the selecting agent . The criterion conditioning the "Filtering Rule" (B) is the sign of the knowledge difference ( ) − ( ) between the sender and the recipient of knowledge.
All incoming links have equal selection probability.
There is no rationality, as communication is random. The agent has no intelligence.
More knowledgeable in-neighbors have higher selection probability Rationality is limited to the awareness of the knowledge of the in-neighbors. The agent has knowledge-based intelligence.
Higher incoming weights have higher selection probability. Rationality is limited to the awareness of the incoming weights. The agent has weight-based intelligence.
Higher product of ℎ · have higher selection probability Rationality is limited to the awareness of the incoming weights and the knowledge of the in-neighbors. The agent has both knowledge and weight-based intelligence. The agent has finer discrimination capability, lower bound of rationality and higher intelligence (Definition 2), compared to the other cases.

Definition 3. (Knowledge Transfer Dynamics).
The Knowledge Transfer Dynamics for each agent is as follows: where Φ ( ) is the formula for Knowledge Transfer from agent to agent , with ≠ :
The Iverson Bracket I ( ) = incorporates the probabilistic selections of the agents for knowledge acquisition into the dynamic law of diffusion. The Iverson Bracket ( ) − ( ) > 0 is serving as a "valve", indicating the allowed direction of knowledge, from the more knowledgeable to the less knowledgeable agent. Knowledge Transfer is proportional to the knowledge difference ( ) − ( ) between the provider and the recipient . This assumption is common in knowledge transfer models, as for example, Formula (2) in [12], Formula (3) in [13], Formula (6) in [14], For-mula (2) in [17], Formula (1) and (3) in [18], Formula (3) in [23], Formula (1) in [27], Formula (4) in [24], Formula (3) and (4) in [36], Formula (3) in [21] and Formula (1) in [28]. However, the diffusion Equation (1) is a generalization of the above models in order to have the possibility to implement different selection rules I (Table 1), corresponding to intelligent, non-random interactions at the local-microscopic level. The analogous equation for attitude-opinion change incorporates the implementation of selection rules for communication and social influence [37].

Definition 4. (Evolution of the Off-Diagonal Weights).
We define a local learning rule for the evolution of the off-diagonal weights w ( ), which is driven by the selections I ( ) of the individual agents as follows: • If the in-neighbor agent is selected ( I ( ) = ), the corresponding weight w ( ) may change due to the relevance feedback learning.

•
If the in-neighbor agent is not selected ( I ( ) ≠ ), the corresponding weight w ( ) is subjected to decay with time .
In this first exploratory work, we shall assume the simplest case of linear decay, with decay parameter , taking values 0 < < 1. The parameter corresponds to the speed of weakening of the communication channels, resulting from the passage of time. A lower value of decay parameter makes the weight ( ) vanish more quickly. We assume for simplicity the same decay parameter = 0.99 for all agents = 1, 2, … , . In other words, each weight w ( ) is weakening by 1% for each time not selected. The evolution formula for the off-diagonal weights w ( ) is as follows: If the relevance feedback is positive (F ( ) = 1), then learning L ( ) is low (below 0.5), equal to ℓ ∈ (0, 0.5). On the contrary, if the relevance feedback is zero (F ( ) = 0), then learning L ( ) is high (above 0.5), equal to 1 − ℓ ∈ (0.5, 1). In this first exploratory work, we shall assume learning rate ℓ = 0.4.

Assumption 3. (Periodic Innovation).
All agents create new knowledge (w ( ) > 0 for = 1, 2, … , N, Definition 1) periodically with period . The period is the innovation rate of the system.

Definition 5. (Selection Function for Innovation Production and Knowledge Acquisition).
Taking into account Assumption 3, the selection function ( ) incorporates: (a) the selection of distinct agents (with ≠ ) for knowledge acquisition, based on some selection rule I ( ( ) = I ( ) = ) , as well as, (b) the self-selection of agent ( ( ) = ) for innovation production with period . Therefore, the selection function ( ) is defined as follows: where is the floor function which returns the largest integer not greater than x. For example, 2.2 = 2 and 2.9 = 2.

Definition 6. (Knowledge Dynamics Equation). The Knowledge Dynamics Equation for each agent is as follows:
The off-diagonal elements Φ ( ) correspond to Knowledge Transfer from each agent to agent , with ≠ , (Definition 3). The diagonal element Φ ( ) corresponds to Innovation Production from agent (see Definition below). Knowledge dynamics in networks is understood and modeled as spread of knowledge, due to discrete diffusion in the network. This diffusion process is in general non-uniform and non-isotropic, as diffusion in disordered systems [38] and anomalous biased diffusion [39]. Our model allows moreover the simulation of "active" interactions among the agents, introduced by selections-decisions characterized by awareness, resulting in higher intelligence. These "intelligent selections" (Definition 2, Table 1) are mechanisms of "active" diffusion, interpreted as awareness propagation in communication networks [40].

Definition 7. (Innovation Production Dynamics)
The Innovation Production Dynamics for each agent is as follows: where Φ ( ) is the formula for Innovation Production from agent :

Remark 3. Weights-Knowledge co-evolution via local "agent-to-agent" interactions.
The co-evolution of weights and knowledge is formulated in terms of evolution equations for weights (2) and knowledge (4). This Weights-Knowledge co-evolution equation is a non-linear stochastic difference equation, incorporating the actual interplay of weights with knowledge levels in time. The interdependence of weights with knowledge levels is formulated at the local microscopic level of "agent-to-agent" interaction, the result of which is twofold (Figure 1): On one hand, there is an upgrade of agents' knowledge due to the diffusion process. On the other hand, at the same time, there is a mutually dependent update of agents' weights due to the "experience" of communication (feedback) with the selected agent. The simultaneous update of knowledge and weights is the key distinction of our model, compared to other agent-based models for knowledge network co-evolution, where the updates of knowledge and weights, are not realized simultaneously. At each time step, they propose a random choice for: either link rewiring only, or knowledge diffusion only [20,21], excluding simultaneous update. Moreover, in the existing literature of agent-based models for knowledge diffusion in networks [18,20,21,41], the evolution of weights from w ( ) to w ( + 1) is imposed exogenously. Thus, the evolution of weights and knowledge is not a mutually dependent evolution. On the contrary, in our model, we observe from equation (2) that the weights evolve to the value w ( + 1) depending on the previous values of both weights w ( ) and knowledge levels ( ): w ( + 1) = ( w ( ), I ( w ( ), ( ) ) , F ( ( ), ( ) )) This is a learning mechanism [42] where co-evolution is intrinsic/endogenous.

Estimating the Dynamics of Network Co-Evolution
In order to focus on the impact of factors (CF7) and (CF3) on the emerging coevolutionary dynamics, we study fully connected networks [43]. The impact of the selection rule (I) (CF7) is assessed in terms of 4 different probabilistic selection rules (Definition 2, Table 1). The impact of the innovative agents (CF3), is assessed in terms of 3 different innovation rates (Assumption 3) and 3 different number of "top innovators". We also examine the dependence on network size. The initial network setting is presented in Table 2 and the values of parameters in the simulations in Table 3. Table 2. Initial network setting.

Knowledge
All agents have Equal Initial knowledge level, with value (t) = 1

Links
Off-diagonal weights are initially equal, with value w ( ) = 0.5 Fully connected network structure with evolving weights Diagonal weights are constant in time (Remark 2) The value of most diagonal weights is w = 0.05.
We assume a small number (5%, 10%, 15%) of randomly distributed "top innovators" (highly innovative agents) with w = 0.5 The off-diagonal weights , incorporating the knowledge transfer efficiency from agent to agent , take values within the interval [0, 1]. We assume that the initial value is at the center: = 0.5. The selected values in simulations are context-dependent, for example, (a) in simulations of collective invention dynamics [12], knowledge diffusion [13] and knowledge transfer [17,28], the off-diagonal weights take values within the same interval [0, 1], (b) in simulations of the dependence of knowledge transfer on the connection structure, the off-diagonal weights take values within the interval [0, 0.5] [18]. Concerning network size, it is not expected that simulations with more than 300 agents will add significantly to the results. This is confirmed by several works on knowledge dynamics in networks, namely, (a) simulations with 150 agents for tacit knowledge transmission in online social networks [44] "managers must make sure the number of employees in an organization is less than 150 if the organization means to run efficiently and becomes the incubator of the propagation of knowledge and thoughts. 150 is a tipping point. If the number of employees is more than 150, many organizations will break up" [45,46], (b) simulations with 100 agents for knowledge diffusion performance in R&D collaboration networks [14], (c) simulations with 200 agents for coevolution of endogenous knowledge networks and knowledge creation [47], (d) simulations with 200 agents for knowledge diffusion dynamics with faceto-face interactions [48], (e) simulations with 100 agents for knowledge diffusion in social networks, manifesting serendipity [49].
The emerging dynamics of network co-evolution is assessed in terms of the following: • The average knowledge of the agents and the "knowledge inequality" (standard deviation of knowledge of the agents); • The average selection entropy of the agents; • The out-degree centralization of the network.
The definition for the average knowledge of the agents is as follows:

Definition 10. (Selection Entropy).
The selection entropy ( ) = I ( ) of agent is the "in-entropy" of node , computed from the selection probabilities p I ( ) of Table 1 as follows: The normalized selection entropy ℐ ( ) = ℐ I ( ) of agent is as follows: The average normalized selection entropy ℐ ( ) = ℐ I ( ) of the agents of the network is as follows: We shall use the average normalized selection entropy ℐ ( ) to estimate the "Selection Entropy".
The relevant definitions for the centralization of the network are:

Definition 11. (Weighted Out-Degree).
The weighted out-degree ( ) of agent is defined as the sum of the outgoing weights w ( ) to all its first distinct neighbors:

Definition 13. (Weighted Out-Degree Centralization).
The centralization of a network [50,51], for the weighted out-degree centrality ( ) (Definition 12), is the fraction: The numerator is the sum of differences between the degree centralities of the most central node and all other nodes . The denominator is the theoretically largest sum of such differences in any network of the same size. The theoretically largest sum of such differences is achieved for the directed "star" network topology, where the network consists of one "star" (central) node having maximal out-going weights to all other "satellite" nodes, and "satellite" nodes have no out-going weights. We shall use the weighted out-degree centralization ( ) to estimate the "Centralization".

The Impact of Intelligence-Selection Rule
The impact of intelligence of the agents (CF7) (Definition 2, Table 1) on the emerging dynamics of network co-evolution is assessed by performing simulations for the 4 different probabilistic selection rules (Table 3)

Remark 4. Average knowledge and "knowledge inequality" are both increasing exponentially in time.
We observe in Figure 2a,b that the average knowledge, as well as the "knowledge inequality" (standard deviation of knowledge), are both rising exponentially in time (y axis is in log-10 scale), with more or less the same rate ≃ 3.5%. The intelligence (Definition 2, Table 1) of communicating agents has negligible impact on the emerging dynamics of average knowledge, as well as on knowledge inequality, as the diagrams coincide.

Remark 5. Intelligent agents reduce selection entropy.
We observe in Figure 2c that among intelligent interacting agents, the selection entropy is decreasing in time. The selection entropy of non-intelligent agents, communicating randomly (I = , black line in Figure 2c), does not decrease. This follows from the uniform selection probability (Table 1). The decrease is negligible in the case of knowledge aware intelligent agents (I = , red line in Figure 2c). This follows from the fact that the selection probability for knowledge aware intelligent agents is very close the uniform selection probability, because almost all neighbors have more or less the same knowledge, except the few top innovators (Table 2). On the contrary, the selection entropy of weight aware intelligent agents (I = , blue line in Figure 2c) and of knowledge and weight aware intelligent agents (I = , green line in Figure 2c) is rapidly decreasing almost 50%. The decrease of selection entropy is significant when intelligent agents are aware of the weights, because the selection probability diverges rapidly from the uniform distribution, due to the evolution formula for the off-diagonal weights ( ) (Definition 4). More specifically, the initial selection probability (Table 1) for a link is very low, due to the fully connected structure and the initial equal weights (Table 2). In the next step, the weights of non-selected links are weakened with decay parameter , while the weights of selected links may either increase or decrease, depending on the knowledge transfer realized (Definition 4). The resulting selection probability is rapidly diverging from the initial uniform distribution.

Remark 6. Intelligent agents centralize the network.
The increase of network centralization is clearly observed in Figure 2d. However, the increase depends significantly on the intelligence of the agents. Centralization increases about 13% for non-intelligent agents, communicating randomly (I = , black line in Figure 2d). This increase results from the evolution formula for the off-diagonal weights ( ) (Definition 4). At each time, most of the links are not selected, and therefore, centralization increases. As intelligent agents select non-randomly, we observe for the same reason the emergence of stronger centralizations, namely, about 27% for knowledge aware intelligent agents (I = , red line in Figure 2c), about 58% for weight aware intelligent agents (I = , blue line in Figure 2d) and about 70% for weight and knowledge aware intelligent agents (I = , green line in Figure 2d).

The Impact of the Innovation Rate
The impact of the innovation rate of the agents (CF3) (Assumption 3) on the emerging dynamics of network co-evolution is assessed by performing simulations for the 3 different innovation rates (Table 3), namely, (1) low innovation rate with period = 15 steps, (2) medium innovation rate with period = 10 steps, (3) high innovation rate with period = 5 steps. Results are illustrated in Figure 3.

Remark 7. Higher innovation rates result in higher average knowledge and higher knowledge inequality.
We observe in Figure 3a,b that the average knowledge, as well as the "knowledge inequality" (standard deviation of knowledge), are both rising in time (y axis is in log-10 scale) exponentially. Higher innovation rates result in higher exponential increase of average knowledge as well as of knowledge inequality. The oscillations of knowledge inequality (Figure 3b) are due to the periodic innovation production (Assumption 3). The oscillations are relatively higher for lower innovation rate (black line in Figure 3b). At each instance of innovation, the standard deviation of knowledge is increasing. However, at each step between two successive innovation instances, the standard deviation of knowledge is decreasing, because at these intermediate steps, there is only knowledge diffusion and no innovation.

Remark 8. Higher innovation rates result in stronger selection entropy decrease and stronger network centralization increase.
The selection entropy (Figure 3c) and the network centralization (Figure 3d) are ranked, with respect to the innovation rate. As the innovation rate increases, both the selection entropy decrease, as well as the network centralization increase, become stronger.

The Impact of the Number of Top Innovators
The impact of the number of top innovators (CF3) (Assumption 3) on the emerging dynamics of network co-evolution is assessed by performing simulations for the 3 different numbers of top innovators (Table 3), namely, 5%, 10%, 15%. Results are illustrated in Figure 4.

Remark 9. Fewer "top-innovators" result in stronger selection entropy decrease and stronger network centralization increase.
We observe in Figure 4a,b that the average knowledge, as well as the "knowledge inequality" (standard deviation of knowledge), are both rising exponentially in time (y axis is in log-10 scale), with more or less the same rate ≃ 3.5%. The number of top innovators has negligible impact on the emerging dynamics of average knowledge, as well as on knowledge inequality, as the diagrams coincide. On the contrary, both the selection entropy and the network centralization depend significantly on the number of top innovators. The selection entropy (Figure 4c) and the network centralization (Figure 4d) are ranked, with respect to the number of top innovators. As the number of top innovators decreases, both the selection entropy decrease, as well as the network centralization increase, become stronger.

The Impact of Network Size
The impact of network size on the emerging dynamics of network co-evolution is assessed by performing simulations for the 3 different network sizes (Table 3), namely, N = 100 agents, N = 200 agents, N = 300 agents. Results are illustrated in Figure 5.

Remark 10. Smaller networks give rise to stronger centralization increase.
We observe in Figure 5a,b that the average knowledge, as well as the "knowledge inequality" (standard deviation of knowledge), are both rising exponentially in time (y axis is in log-10 scale), with more or less the same rate ≃ 3.5%. The network size has negligible impact on the emerging dynamics of average knowledge as well as on knowledge inequality. Selection entropy depends slightly on network size (Figure 5c). On the contrary, centralization depends significantly on network size (Figure 5d). For smaller networks, the centralization increase becomes stronger.

Discussion
The development of "new mathematical formalisms for the co-evolutionary dynamics of states and interactions" has been identified by Thurner, Hanel and Klimek as one of the key directions of future research in the Theory of Complex Systems (Chapter 7 of [52]). San Miguel, Eguíluz and others published on the co-evolution of dynamical states and interactions, addressing the question of network formation [53][54][55][56][57][58]. In this context, we have modeled and explored the co-evolution of link weights and knowledge levels among intelligent interacting agents. We extended the mathematical models, restricted to random mindless interactions among the agents [13,14,18,20] taking place on a "frozen" (static) network [12][13][14][15][16][17][18]23,24,27,28], in two ways:

•
The agents (human beings or intelligent machines) are able to make mindful decisions for knowledge acquisition. The decisions of intelligent rational agents are realized under bounded rationality [25,26]. If the bound of rationality, concerning the selections of other agents for knowledge acquisition is lower, then the agent is considered as more intelligent (Definition 2, Table 1).

•
We formulated the co-evolution of the link weights and the knowledge levels at the local microscopic level of "agent-to-agent" interaction. The model describes the "structural plasticity" of the network as a "learning mechanism", where weight updates depend on the previous values of both weights and knowledge levels. As a result, the co-evolution is intrinsic/endogenous (Definition 4, Remark 3).
The goal of this work is to explore the impact of the following: • The intelligence of the agents, modeled by the selection-decision rule for knowledge acquisition (Definition 2, Table 3 The innovation rate of the agents (Assumption 3, Table 3) (CF3); • The number of "top innovators" (Table 3); • The network size (Table 3).
Our results are summarized in 3 key findings, presented also in Table 4: The network centralization increases as the agents become more intelligent (Remark 6), as the innovation rate increases (Remark 8), as the number of top innovators decreases (Remark 9) and as the network size decreases (Remark 10). The selection entropy decreases as the agents become more intelligent (Remark 5), as the innovation rate increases (Remark 8) and as the number of top innovators decreases (Remark 9). Selection entropy does not depend significantly on the network size (Remark 10). The average knowledge and the knowledge inequality grow exponentially in time ( Remarks 4,7,9,10). The rate of exponential growth is increasing as the innovation rate increases. The exponential growth of average knowledge has been observed in several socio-economic systems [59] and scientific knowledge [60]. However, the analysis of exponential knowledge increase for individuals is beyond the scope of this work. Moreover, we observe increasing small oscillations, for lower innovation rates (Remark 7). On the contrary, there is negligible dependence on the intelligence of the agents (Remark 4), on the number of top innovators (Remark 9) and on the network size (Remark 10).

Conclusions
Our work offers some insight on the dynamics of networked societies. The "Death of Distance" [61], due to the World Wide Web, resulted in global interconnectedness. We are interconnected through online social networks, platforms and communities (Facebook, LinkedIn, Instagram, Twitter, Airbnb, ResearchGate, TripAdvisor, Booking and YouTube). We are influencing each other, directly or indirectly, intentionally or unintentionally, on global scale. We share knowledge and we rank individuals, services or products. This "ranking" is visible, for example, the Followers at Instagram or Twitter, the Endorsements at LinkedIn, the Likes at Facebook, the 5-star experience at Airbnb or Booking or TripAdvisor, the RG Score at ResearchGate, the Views and Likes at YouTube. Therefore, intelligent decision makers (selecting agents) being aware of this ranking, decide with higher rationality, lowing the selection entropy. Intelligent selections are effectively a mechanism of "preferential attachment" (the newcomer is aware of the degree connectivity of all other nodes and attaches to nodes with higher degree). This behavior increases the centralization of the network society because more and more individuals tend to select the "best option" (high-ranked agents) and the link weights with the low-ranked agents are weakening. Of course, the correlation between the rank/popularity and the quality of the "best option" is not always positive.

Future Work
Our work is a first step towards the exploration of the emergence of centralization due to the intelligence of agents, communicating in a co-evolving network. We see two main directions for future work, namely, (a) the dependence on the initial network structure (regular, random, small-world, scale-free) and (b) the dependence on time-dependent diagonal weights ( ) expressing the agents' innovation capability. Concerning the dependence on the diagonal weights, agents with low innovation capability initially, may eventually develop high innovation capability, which is expected to have significant impact on the emerging dynamics of knowledge inequality, selection entropy and network centralization. More specifically, high network centralization may collapse, due to the emergence of "new" top innovators with high knowledge level. The knowledge of former top innovators becomes depreciated, while the knowledge from "new" top innovators becomes more and more appreciated, due to their higher innovation capability. A real-world paradigm is the mobile phone industry. From 1990s to late 2000s, Nokia and Motorola were both top innovators in the mobile phone industry, with pioneer technology for that time period. However, things changed after 2010, when Samsung and Apple became the "new" top innovators, introducing smartphones like "Samsung Galaxy" and "iPhone".  Acknowledgments: Results presented in this work have been produced using the AUTH Compute Infrastructure and Resources. We appreciate the highly efficient technical support for the computations by the members of the Scientific Computing Office (IT AUTH).

Conflicts of Interest:
The authors declare no conflict of interest.