Next Article in Journal
Extraction of Pigments from Microalgae and Cyanobacteria—A Review on Current Methodologies
Previous Article in Journal
Optimization of Mechanical and Setting Properties in Acrylic Bone Cements Added with Graphene Oxide
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Link Prediction Method Based on Neural Networks

State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University, Beijing 100044, China
*
Author to whom correspondence should be addressed.
Appl. Sci. 2021, 11(11), 5186; https://doi.org/10.3390/app11115186
Submission received: 19 May 2021 / Revised: 31 May 2021 / Accepted: 1 June 2021 / Published: 3 June 2021

Abstract

:
Link prediction to optimize network performance is of great significance in network evolution. Because of the complexity of network systems and the uncertainty of network evolution, it faces many challenges. This paper proposes a new link prediction method based on neural networks trained on scale-free networks as input data, and optimized networks trained by link prediction models as output data. In order to solve the influence of the generalization of the neural network on the experiments, a greedy link pruning strategy is applied. We consider network efficiency and the proposed global network structure reliability as objectives to comprehensively evaluate link prediction performance and the advantages of the neural network method. The experimental results demonstrate that the neural network method generates the optimized networks with better network efficiency and global network structure reliability than the traditional link prediction models.

1. Introduction

A network is a special case to express the relationship between systems. In recent years, network systems have attracted more and more attention from various disciplines in modeling, network topology and structure optimization [1]. Generally, network system is often seen in reliability engineering practice and real life, such as communication networks, computer networks, circuit networks, traffic networks, urban water supply networks, power supply networks, etc. However, we know that these real networks are constantly evolving in actual operation to ensure the sustainable development of various fields. Therefore, a series of network evolution models and algorithms aiming at optimizing the structure are emerged as the time requires [2].
As an essential mechanism for network evolution, link prediction has received widespread attention as soon as it was proposed, and it has been practically applied in many fields [3]. At present, the research on link prediction mainly focuses on evaluating the accuracy and precision of missing links. For many real networks, network evolution aims to extend the network topology to ensure the long-term development and regular operation of networks. Therefore, it is necessary to study link prediction with the purpose of improving reliability in network evolution.
However, the structure complexity and diversity of real networks bring great difficulties to link prediction aiming at improving reliability. In recent years, various disciplines have devoted themselves to intelligent research in related fields. Artificial intelligence has been at the forefront of the development of science and technology around the world with its advantages of improving productivity and reducing the difficulty of work. It has exerted a profound influence on all fields and promoted the evolution of society. We have to say that artificial intelligence of networks is the general trend. Among them, the neural network has become the representative of artificial intelligence methods because of the powerful self-learning function and the ability to find optimal solutions. It provides strong support for link prediction based on improving reliability.
Therefore, in order to ensure the safe operation and sustainable development of networks, an artificial intelligence method based on neural networks is used to realize link prediction in order to improve reliability in network evolution. The main contributions of this paper are as follows.
  • We try to combine artificial intelligence method with complex network theory, and propose a link prediction method based on neural networks.
  • A link pruning strategy based on the greedy algorithm is applied to solve the problem of neural network generalization on experiments.
  • According to the traditional reliability, the quantitative formula of global network structure reliability is given to measure the performance of extended networks.
  • By conducting two kinds of experiments on several networks with N = 30, 50, 80 and 100, we prove that the neural network method is the best in improving network efficiency and global network structure reliability compared with different link prediction models.
The structure of the remainder of the paper is as follows. The work related to link prediction and reliability is reviewed in Section 2. Section 3 introduces the research base, including traditional link prediction models and the evaluation indexes. In Section 4, the neural network algorithm is described. In Section 5, we present the experimental results and conclusions are given in Section 6.

2. Literature Review

In network evolution, the primary methods to improve reliability include adding links, reconnecting links and adding nodes with changing network topology. At present, the most widely used method is link prediction based on adding edges [4]. Barabási and Albert [5] regarded the node degree as the basis of link possibility. Newman [6] introduced the concept of the common neighbor to link prediction for the first time. As soon as this method came out, it caused a boom in the field of link prediction. Ma et al. [7] proposed a local friend recommendation index to facilitate link prediction by a typical structural property: nodes were preferentially linked to the nodes with the weak clique structure in many real networks. By considering both the nodes’ types of effects and structural similarities, Fan et al. [8] proposed a combined link prediction index and studied the robustness. Gao et al. [9] proposed a link prediction algorithm suitable for bipartite networks. Aghabozorgi and Khayyambashi [10] tested the similarity measure based on structural units through a supervised learning experiment framework, and found that the relations built through the paths between the endpoints determine the influence of the new links. Yang et al. [11] proposed a novel link prediction index significant influence, which was modeled by distinguishing the strong influence of the weak. Pech et al. [12] assumed that the likelihood of a link between two nodes can be realized by a linear summation of neighbor nodes’ contributions. As a result, they obtained the analytical solution of the optimal likelihood matrix and better performance. Balls-Barker and Webb [13] proposed a new method to predict the formation of unobserved links in the real-world networks, relying on the theory of isospectral matrix reduction to calculate the probability and finally transitioning from one vertex to another in a random walk on the network. Li et al. [14] combined the four similarity indexes, including Common Neighbors, Leicht–Holme–Newman, Cosine based on the Laplacian matrix, and Matrix Forest based on the Logistic regression algorithm and the Xgboost algorithm, and introduced the idea of stacking into the link prediction of complex networks. Bai et al. [15] constructed a new model that regarded link prediction in multiplex networks as a multi-attribute decision-making problem, in which the potential links in the target layer are alternatives, the layers are viewed as attributes, and the similarity score of a potential link in each layer are an attribute value.
Artificial intelligence method, a hot research topic in recent years, is also used in link prediction. Liu et al. [16] believed that different common neighbors played various roles so that they have different contributions, and therefore proposed a local naive Bayes model. Wu [17] proposed a generalized tree augmented naive Bayesian probability model by exploiting mutual information to quantify neighbors’ neighborhood influence. Moreover, it was easily adapted to other common neighbors-based methods including Common Neighbors, Adamic/Adar and Resource Allocation. Considering the differences between latent features, Wang et al. [18] proposed the variational Bayesian probabilistic matrix factorization with Student-t prior model. Xiao et al. [19], who studied the internal and external factors that affect the link formation, integrated the user behavior and user relationships into link prediction and proposed a three-level hidden Bayes model. Yuan et al. [20] calculated the graph kernel similarities between subgraphs to train the Support Vector Machine (SVM) classifier to achieve link prediction. Shan et al. [21] regarded link prediction as a binary classification problem and proposed a supervised method to achieve link prediction in multiplexed networks. Experiments conducted on six networks have confirmed the effectiveness of this method. In order to fully explore and utilize the public opinion characteristics of social network node users, Wang et al. [22] established a multidimensional network model oriented to the topology of “We the Media” networks and designed a link prediction algorithm suitable for multidimensional networks. Neural network technology is a mature intelligent computing technology, and its application has achieved great success at present [23]. Li et al. [24] proposed a multiple-types link prediction model for heterogeneous networks based on back propagation neural networks. Ozcan and Oguducu [25] proposed a multivariate link prediction method in heterogeneous network evolution by using a nonlinear autoregressive neural network with external inputs. Cai et al. [26] proposed a link prediction method based on recurrent neural networks for the time-varying characteristics and the historical information of node pairs in opportunistic networks that had a vital influence on the future link state. Lee and Sohn [27] combined an artificial neural network algorithm and hill climbing algorithm to propose a new intelligent link prediction method in scale-free networks. Wang et al. [28] inferred the possible regulatory relationship between two genes through calculations, which can be expressed as a link prediction problem between two nodes in the graph. An end-to-end gene regulatory graph neural network method is proposed under the framework of supervised and semi-supervised. Xiao et al. [29] proposed an attention-based convolutional neural network link prediction method that can effectively improve the performance by fusing and mining structural features and text features.
Reliability, which plays an essential role in ensuring network security [30], is the goal of network development. In other words, reliability is an important index to evaluate network structure or link prediction in network evolution. Shi et al. [31] thought that adding redundant edges to key nodes can effectively improve the network robustness. Shargel et al. [32] proposed an optimized network with better robustness and connectivity by parametrizing two aspects of network construction: growth and preferential attachment. Hayashi and Matsukubo [33] propose a method to improve scale-free networks’ invulnerability by randomly adding the shortest path to some nodes. Xiao et al. [34] studied the controllability based on edge directions. Yan et al. [35] proposed an algorithm based on local information to optimize the network controllability. Sohn [36] regenerated scale-free networks into more optimized robust networks based on neural networks.
At present, the main content of link prediction is to evaluate the prediction accuracy of missing links. However, link prediction is an important step in network evolution, and its crucial task is to ensure network performance and improve reliability for most real networks. Reliability has always been used as an index for the comprehensive evaluation of structural safety, but there is no clear definition. Therefore, to solve these problems, we propose a new link prediction method implemented by the neural network algorithm to improve reliability in network evolution. The input training data are based on the scale-free networks and the output desired data are based on the optimized networks obtained by link prediction models. The network efficiency is used as an index to evaluate the quality of the methods. To verify the network performance comprehensively, the global network structure reliability is proposed in the paper.

3. Problem Description and Formula

Link prediction refers to predicting the possibility of a link between two nodes that have not yet been connected in the network through known nodes and structural information [37]. The undirected scale-free network G (V, L) is studied in this paper, where V and L denote sets of nodes and links, respectively. In this section, we introduce link prediction models and evaluation indexes for the undirected scale-free networks. Link prediction methods need to provide a score (S) to predict the probability of a link existing between a pair of unconnected nodes. For example, S x y C N represents the score of possible links between two nodes x and y in a network calculated by the Common Neighbors (CN) model. Similarly, S xy RA is the score of the Resource Allocation (RA) model, and SMF is a matrix of the scores of all links obtained using the Matrix Forest (MF) model. All links not generated in the original network are sorted in decreasing order according to their scores, and the links at the top are most likely to exist.

3.1. Link Prediction Models

There exist many methods applied in the link prediction field. Some of the well-known techniques [38], including local link prediction methods and global link prediction methods, are selected as the necessary link prediction models to compare with the neural network methods.
Common Neighbors (CN) [39] takes the number of common neighbors as a score to determine whether or not a link can be generated between two nodes. The more common neighbors two nodes share, the greater the probably they are related with a link. For nodes x, y, the sets of their neighbors are Γ(x), Γ(y); their common neighbors’ set is Γ(x)∩Γ(y). CN is defined as:
S xy CN = | Γ ( x ) Γ ( y ) |
Resource Allocation (RA) [40] measures the possibility of a link occurs by common neighbors’ degree. Here, z represents the common neighbor node of node x and y, kz is the degree of node z. Then, the expression of RA is:
S xy RA = z Γ ( x ) Γ ( y ) 1 k z
The Jaccard Coefficient (JC) [41] is proposed by Jaccard, which considers the neighbor nodes and common neighbors of two nodes. It is defined as:
S xy JC = | Γ ( x ) Γ ( y ) | | Γ ( x ) Γ ( y ) |
Hub Promoted (HP) [42] is proposed for quantifying the topological overlap of pairs of substrates in metabolic networks, and defined as:
S xy HP = | Γ ( x ) Γ ( y ) | min { k x , k y }
Leicht–Holme–Newman (LHN) [43] considers the number of common neighbors and degree of two nodes. The expression of LNH is:
S xy LHN = | Γ ( x ) Γ ( y ) | k x   ×   k y
Average Commute Time (ACT) [44] thinks that the shorter the time, the more similar the two nodes, then the possibility of link between the nodes x and y can be defined as:
S xy ACT = 1 l xx + + l yy + 2 l xy +
where l xy + denotes the corresponding entry in terms of the Laplacian matrix’s pseudoinverse, L+ (L = D − A) [45].
Cosine Time (CT) [45] is an inner-product-based measure, which is based on L+ by calculating the possibility of two vectors. The cosine time is defined as the cosine of the node vectors:
S xy CT = cos ( x , y ) + = l xy + l xx + · l yy +
Matrix Forest (MF) [46] thinks the similarity between x and y can be understood as the ratio of the number of spanning rooted forests, such that nodes x and y belong to the same tree rooted at x to all spanning rooted forests of the network. MF is defined as:
SMF = (I + L)−1

3.2. Reliability Indexes

3.2.1. Network Efficiency (E)

At present, the direct definition or measurement of network reliability is not clear. Network efficiency is usually used to indirectly evaluate it. For nodes x, y in a network, the efficiency is the reciprocal of the shortest distance between them [47]. For an undirected network, it is expressed as:
E = 2 x < y 1 d xy N ( N 1 )
where dxy is the shortest distance between the nodes x and y; N is the number of nodes in the network. It reflects the overall connection in the whole range of the network itself. The greater the value is, the better the network structure establishes.

3.2.2. Global Network Structure Reliability (P)

Gupta and Kundu [48] first proposed the generalized exponential distribution of reliability index and applied it to the machine, components and other equipment [49]. Its form is:
P = eℷt
here, is the failure rate. The failure rate of the systems is difficult to obtain, so the formula evolves into:
P = 1 − eℷC
where is the reliability factor and C is the equivalent system cost of destructions after achieving the object.
In researches, many complex systems are regarded as networks. Therefore, we consider changing some expression forms to realize the calculation of global network structure reliability to comprehensively characterize the optimization degree in the process of network evolution. Generally, the parameter ℷ is related to the knowledge level, the computing resources, human resources, time and other measurable factors [50]. Similarly, the critical network structural characteristic indexes include average shortest path length, betweenness centrality structural entropy and average clustering coefficient [51,52]. Therefore, we quantify global network structure reliability within a weighted summation method to describe the parameter . One of the most straightforward indexes to measure a network is the degree. We consider that the average degree ( K = x = 1 N k x N ) has the same effect as C in calculating the global network structure reliability, so the global network structure reliability can be expressed in the following form:
P = 1 e ( ε 1 L + ε 2 E B + ε 3 C ) × K
where L is the average shortest path length. EB is the betweenness centrality structural entropy. C is the average clustering coefficient. ε1, ε2, ε3 are the weights of parameters, and ε1 + ε2 + ε3 = 1. Here, we assume that ε1 = ε2 = ε3 = 1/3 in a general scale-free network. The following is the specific description and formula explanation for these indexes.
A. Average Shortest Path Length (L).
The average shortest path length is an important feature measure in network analysis, which is the average distance of all node pairs. For an undirected network, it is defined as follows:
L = 2 x < y d xy N ( N 1 )
The smaller the L, the greater the connection intensity between nodes. In order to solve the difference between L and other indexes, let L = 1/L.
B. Betweenness Centrality Structural Entropy (EB).
Node betweenness centrality characterizes the importance of the nodes. Network structure entropy is introduced to characterize the dispersion of the nodes’ importance [51]. Let dyk denote the total number of the shortest path starting from the nodes y to k; dyk(x) is the number of the shortest path through the node x from node y to k. If it goes through the node x, then dyk(x) = 1, otherwise dyk(x) = 0. The betweenness centrality of node x is Bx:
B x = y x k d yk ( x ) d yk ( N 1 ) ( N 2 )
The betweenness centrality structural entropy is expressed as:
E B = x = 1 N B x lnB x
C. Average Clustering Coefficient (C).
The clustering coefficient is a characteristic index to describe the tightness of the network [52]. A node with a larger clustering coefficient is closer to its neighbor nodes in the network. The clustering coefficient of node x (Cx) is:
C x = 2 E x k x ( k x 1 )
Therefore, the network’s average clustering coefficient is:
C = 1 N x = 1 N C x
here, Ex is the number of edges connected to neighbor nodes of node x.

4. Method

4.1. Neural Networks (NN)

Neural networks have many successful applications in solving various problems related to prediction, classification and regression [53]. There are three basic layers in neural networks, including input layer, hidden layer and output layer, as shown in Figure 1. Usually, the data form of neural networks is arrays. As we know, a network is always expressed as an adjacency matrix. It is impossible to train the neural network as input data because using the adjacency matrix as the input of neural networks would require the dimension size that can represent 2 N 2 adjacency matrices, where N is the number of nodes in the network. Here, a new network representation called link list (LL) is applied that contains binary elements representing existence of node pairs among all possible combinations ( N 2 ) . Generally, the possible links are L = {(1, 2), (1, 3), (1, 4), (1, 5), (2, 3), (2, 4), (2, 5), (3, 4), (3, 5), (4, 5)} for an undirected network with N = 5. If four of the links exist by L = {(1, 4), (2, 3), (2, 4), (3, 5)}, then LL = [0 0 1 0 1 1 0 0 1 0]. In this way, the network’s adjacency matrix is transformed into an array, and link prediction of a network is achieved by the neural network method. The neural network is trained based on original scale-free networks as the input data and optimized networks by link prediction models as the desired output data. Specifically, we first generate scale-free networks with specified requirements as original data, and the link prediction models obtain the optimized networks. Then, the adjacency matrix of the networks is transformed into the link list. In the training of the neural network, the input is the link list of the original scale-free networks and the output is the link list of the optimized networks generated by the link prediction models. It solves the problem that neural networks cannot train network data.
The original networks are scale-free networks with the initial number of nodes N0 = 3 and link density M0 = 2 for N = 30, N = 50, N = 80 and N = 100. The link prediction method based on neural networks is evaluated by the network efficiency and global network structure reliability. In order to verify the feasibility and advantages of link prediction based on neural networks, we use the traditional link prediction models as the performance reference models. In experiments, we assume that the number of links increased by link prediction models is equal to the number of network’s nodes. We randomly generate a database of 10 data sets which have scale-free networks with the same number of nodes as the input data of the neural network; 80% of them are training data and 20% are test data. In the neural network method, the number of hidden layers is set to 4 [54]. The maximum training epochs is 1000, the training goal is 0.00001 and the neural network’s learning rate is set to 0.001.
We performed two kinds of experiments on scale-free networks with N = 30, 50, 80 and 100, and analyze the results by MATLAB. First, we randomly generated several scale-free networks with a specified number of nodes as data sets. In Experiment 1, the input data are different networks with the same number of nodes, and the output data are optimized networks obtained by the same link prediction model. We found that the traditional link prediction models have different advantages for different networks. Therefore, in order to give full play to the advantages of different link prediction models to obtain the more optimized networks, we carried out Experiment 2, in which the input data are the same network and the output data are the optimized networks generated by different link prediction models.

4.2. Link Pruning

The number of links of the optimized networks produced by neural networks cannot be controlled to be equal to the number of links of the optimized network produced by link prediction models, due to neural networks’ generalization properties. To solve this problem, there is an additional stage named link pruning. Link pruning is the process of removing redundant links generated by neural networks according to the goal, so that the optimized network generated by the neural network has the same network topology complexity as the optimized network generated by link prediction. Here, in order to maximize the reliability, we apply the idea of the greedy algorithm to achieve link pruning. The greedy algorithm means that when solving the problem, the algorithm always makes what seems to be the best choice at the moment. Our specific approach is to add all the links generated by the neural network into the original network to form a new network. Then, one of all the links generated by the neural network is randomly deleted from the new network at a time to calculate the network efficiency and global network structure reliability. After all the links generated by the neural network have been deleted once, the data are sorted from large to small according to the target. Finally, the link pruning process is completed when the number of links in the network is equal to that generated by the link prediction models.

4.3. General Scheme

Next, we describe the general scheme for the above the neural network method.
Step 1—The scale-free networks that meet the specified requirements are randomly generated as the original networks.
Step 2—The optimized networks are obtained by link prediction models.
Step 3—Convert the original networks and optimized networks to the link list.
Step 4—Train the neural network where the inputs are scale-free networks and the outputs are optimized networks.
Step 5—The predicted networks are input into the trained neural network to obtain the new optimized networks.
Step 6—According to the goals, the final optimized networks are obtained by link pruning.
Step7—According to Equations (11) and (14), the network efficiency and global network structure reliability are calculated.

5. Experiment Results

We found that the hubs of the optimized networks produced by the link prediction models are obviously observed and the degree difference between nodes is large through comparison and analysis. For example, Figure 2 shows the network topology of the original network, the optimized network generated by the RA model and the optimized network generated by the neural network. This structure is unstable when the network is targeted attacked. As for the optimized networks produced by neural networks, compared to the optimized network produced by the link prediction models, the number of medium-sized hubs increased. The structure can withstand greater attacks. Therefore, the performance of the network structure optimized by the neural network is better.
In order to further illustrate and verify our conclusion, we calculate the network efficiency and global network structure reliability and plot the experimental results of the networks with N = 30, 50, 80 and 100 into Figure 3, Figure 4, Figure 5 and Figure 6. As shown in Figure 3, Figure 3a is the network efficiency of the networks with N = 30 for different methods. Figure 3b shows the global network structure reliability of the networks with N = 30 for different methods. Similarly, we can explain Figure 4a to Figure 6b. It is found that the networks optimized by neural networks are significantly higher than those by the traditional link prediction models, regardless of network efficiency or global network structure reliability. Besides, by comparing Figure 3, Figure 4, Figure 5 and Figure 6, we find that the neural network has a more obvious effect on the traditional link prediction models with poor optimization results. For example, the network efficiency of the optimized network obtained by LHN and MF models in Figure 3a is the minimum, but the network efficiency of the optimized network obtained by the neural network is almost the maximum. In Figure 4b, CN and RA models have achieved high global network structure reliability. Although the trained neural network is higher than the traditional link prediction models, the improvement is not apparent. The conclusion is also reflected in Figure 5 and Figure 6 for networks with N = 80 and 100. Comparing (a) and (b) of the four figures we can see that the difference in network efficiency is more prominent. In contrast, the results of global network structure reliability proposed are more similar for different methods. This is because the global structure network reliability is more comprehensive than network efficiency in evaluating network structure. At the same time, the availability of the global network structure reliability can be explained. We can also see that the original scale-free networks’ global network structure reliability is generally low, which indicates that the structure of the randomly generated scale-free networks is unstable.
From the above results, we find that the traditional link prediction models’ performance ranking is inconsistent for the networks with different node numbers and structures. For example, the optimized network generated by ACT model has the maximum reliability for N = 30 in Figure 3b. The optimized network generated by RA model has the maximum network efficiency for N = 80 in Figure 5a. In Figure 6, for the prediction network 1 with N = 100, the network efficiency and global network structure reliability obtained by the CN model are greater than that obtained by the RA model. However, the network efficiency and global network structure reliability obtained by CN model are lower than that obtained by RA model for the prediction network 2 with N = 100. Thus, we believe that different link prediction models have different advantages in various networks. Therefore, in order to achieve the best results, we carried out new experiments considering the benefits of different models. In the experiments, the input data are the same original network each time, and the output data are the optimized network generated by different link prediction models. After training, we input the original network again, and output a higher performance network. The experimental results shown in Table illustrate that the optimized networks generated by neural networks have the best performance. Moreover, the method based on neural networks has obvious advantages over the traditional link prediction models in improving network efficiency and global network structure reliability. The network efficiency and global network structure reliability in different methods are illustrated in Table 1 and Figure 7 and Figure 8. Table 1 shows the specific data about network efficiency and global network structure reliability of all methods for all networks. In Figure 7 and Figure 8, the X-axis is the number of nodes, and the Y-axis is the network efficiency or global network structure reliability. We want to observe how network efficiency and global network structure reliability vary with the number of nodes. We can see intuitively that the optimized network generated by neural networks always has the most excellent network efficiency and global network structure reliability. In addition, we find that the more nodes the network has, the less network efficiency and global network structure reliability is. This can be attributed to that a large number of nodes indicates a much complex network, the performance of which becomes difficult to improve.

6. Conclusions

The study of optimization network performance by artificial intelligence methods is important and challenging research. In this paper, we propose a new method that produces optimized networks with high network efficiency and reliability in network evolution. The neural network method based on link prediction models greatly reduces the training complexity but improves the performance. In order to solve the generalization problem of neural networks, we propose link pruning, which applies the thought of greedy algorithm to complete missing links and remove redundant links generated by neural networks according to the goal. Furthermore, we also give the quantitative index of global network structure reliability to evaluate the network optimization performance.
We designed two kinds of experiments via MATLAB to explore the link prediction method based on neural networks to improve the reliability. The experimental results show that the optimized networks generated by neural networks have better performance in network efficiency and global network structure reliability than traditional link prediction models. Therefore, the neural network method has higher accuracy and performance than popular link prediction models, and the artificial intelligence method offers a more positive contribution to link prediction.

Author Contributions

Conceptualization, K.L. and S.G.; methodology, S.G.; software, S.G. and D.Y.; validation, S.G.; formal analysis, K.L. and S.G.; investigation, S.G. and D.Y.; resources, K.L.; data curation, S.G. and D.Y.; writing—original draft preparation, S.G.; writing—review and editing, K.L.; S.G. and D.Y.; visualization, S.G.; supervision, K.L.; project administration, K.L.; funding acquisition, K.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Beijing Natural Science Foundation (Grant No. 8202039), the National Natural Science Foundation of China (Grant Nos. 71942006, 71621001) and Research Foundation of State Key Laboratory of Railway Traffic Control and Safety, Beijing Jiaotong University (Grant No. RCS2021ZT001).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sohn, I. Small-world and scale-free network models for IoT systems. Mob. Inf. Syst. 2017, 61, 1–9. [Google Scholar] [CrossRef]
  2. Li, G.; Deng, L.; Xiao, G.; Tang, P.; Wen, C.Y.; Hu, W.H.; Pei, J.; Shi, L.P.; Stanley, H.E. Enabling controlling complex networks with local topological information. Sci. Rep. 2018, 8, 1–10. [Google Scholar] [CrossRef]
  3. Guimerà, R.; Sales-Pardo, M. Missing and spurious interactions and the reconstruction of complex networks. Proc. Natl. Acad. Sci. USA 2009, 106. [Google Scholar] [CrossRef] [Green Version]
  4. Sherkat, E.; Rahgozar, M.; Asadpour, M. Structural link prediction based on ant colony approach in social networks. Physica A Stat. Mech. Appl. 2015, 41, 80–94. [Google Scholar] [CrossRef]
  5. Barabási, A.L.; Albert, R. Emergence of scaling in random networks. Science 1999, 286, 509–512. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Newman, M.E.J. Clustering and preferential attachment in growing networks. Phys. Rev. E 2001, 64, 025102. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Ma, C.H.; Zhou, T.; Zhang, H.F. Playing the role of weak clique property in link prediction: A friend recommendation model. Sci. Rep. 2016, 6. [Google Scholar] [CrossRef] [Green Version]
  8. Fan, C.; Liu, Z.; Lu, X.; Xiu, B.; Chen, Q. An efficient link prediction index for complex military organization. Physica A Stat. Mech. Appl. 2017, 469, 572–587. [Google Scholar] [CrossRef]
  9. Gao, M.; Chen, L.; Li, B.; Li, Y.; Liu, W.; Xu, Y. Projection-based link prediction in a bipartite network. Inform. Sci. 2017, 376, 158–171. [Google Scholar] [CrossRef]
  10. Aghabozorgi, F.; Khayyambashi, M.R. A new similarity measure for link prediction based on local structures in social networks. Physica A Stat. Mech. Appl. 2018, 501, 12–23. [Google Scholar] [CrossRef]
  11. Yang, Y.; Zhang, J.; Zhu, X.; Tian, L. Link prediction via significant influence. Physica A Stat. Mech. Appl. 2018, 492, 1523–1530. [Google Scholar] [CrossRef]
  12. Pech, R.; Hao, D.; Lee, Y.L.; Yuan, Y.; Zhou, T. Link prediction via linear optimization. Physica A Stat. Mech. Appl. 2019, 528. [Google Scholar] [CrossRef] [Green Version]
  13. Balls-Barker, B.; Webb, B. Link prediction in networks using effective transitions. Linear Algebra Appl. 2020, 599, 79–104. [Google Scholar] [CrossRef]
  14. Li, K.Y.; Tu, L.L.; Chai, L. Ensemble-model-based link prediction of complex networks. Comput. Netw. 2020, 166. [Google Scholar] [CrossRef]
  15. Bai, S.S.; Zhang, Y.K.; Li, L.J.; Shan, N.; Chen, X.Y. Effective link prediction in multiplex networks: A TOPSIS method. Expert Syst. Appl. 2021, 177. [Google Scholar] [CrossRef]
  16. Liu, Z.; Zhang, Q.M.; Lü, L.Y.; Zhou, T. Link prediction in complex networks: A local naive Bayes model. Europhys. Lett. 2011, 96. [Google Scholar] [CrossRef] [Green Version]
  17. Wu, J.H. A generalized tree augmented naive Bayes link prediction model. J. Comput. Sci. 2018, 27, 206–217. [Google Scholar] [CrossRef]
  18. Wang, Y.S.; Liu, F.B.; Xia, S.T.; Wu, J. Link sign prediction by variational Bayesian probabilistic matrix factorization with student-t prior. Inform. Sci. 2017, 405, 175–189. [Google Scholar] [CrossRef]
  19. Xiao, Y.P.; Li, X.X.; Wang, H.H.; Xu, M. 3-HBP: A three-level hidden Bayesian link prediction model in social networks. IEEE Trans. Comput. Soc. Syst. 2018, 5, 430–443. [Google Scholar] [CrossRef]
  20. Yuan, W.W.; He, K.Y.; Guan, D.H.; Zhou, L.; Li, C.L. Graph kernel based link prediction for signed social networks. Inform. Fusion 2019, 46, 1–10. [Google Scholar] [CrossRef]
  21. Shan, N.; Li, L.J.; Zhang, Y.K.; Bai, S.S.; Chen, X.Y. Supervised link prediction in multiplex networks. Knowl. Based Syst. 2020, 203. [Google Scholar] [CrossRef]
  22. Wang, G.H.; Wang, Y.F.; Li, J.M.; Liu, K.D. A multidimensional network link prediction algorithm and its application for predicting social relationships. J. Comput. Sci. 2021, 53. [Google Scholar] [CrossRef]
  23. Sanchez, E.N.; Rodriguez-Castellanos, D.I.; Chen, G.R.; Ruiz-Cruz, R. Pinning control of complex network synchronization: A recurrent neural network approach. Int. J. Control Autom. 2017, 15, 1405–1414. [Google Scholar] [CrossRef]
  24. Li, J.C.; Zhao, D.L.; Ge, B.F.; Yang, K.W. A link prediction method for heterogeneous networks based on BP neural network. Physica A Stat. Mech. Appl. 2018, 495, 1–17. [Google Scholar] [CrossRef]
  25. Ozcan, A.; Oguducu, S.G. Link prediction in evolving heterogeneous networks using the NARX neural networks. Knowl. Inf. Syst. 2018, 55, 333–360. [Google Scholar] [CrossRef]
  26. Cai, X.L.; Shu, J.; Al-Kall, M. Link prediction approach for opportunistic networks based on recurrent neural network. IEEE Access 2019, 7, 2017–2025. [Google Scholar] [CrossRef]
  27. Lee, Y.H.; Sohn, I. Reconstructing damaged complex networks based on neural networks. Symmetry 2017, 9, 310. [Google Scholar] [CrossRef] [Green Version]
  28. Al-Kuwaiti, M.; Kyriakopoulos, N.; Hussein, S. A comparative analysis of network dependability, fault-tolerance, reliability, security, and survivability. IEEE Commun. Surv. Tut. 2009, 11, 106–124. [Google Scholar] [CrossRef]
  29. Shi, C.; Peng, Y.; Zhuo, Y.; Tang, J.Y.; Long, K.P. A new way to improve the robustness of complex communication networks by allocating redundancy links. Phys. Scripta 2012, 85. [Google Scholar] [CrossRef]
  30. Shargel, B.; Sayama, H.; Epstein, I.R.; Bar-Yam, Y. Optimization of robustness and connectivity in complex networks. Phys. Rev. Lett. 2003, 90. [Google Scholar] [CrossRef] [Green Version]
  31. Hayashi, Y.; Matsukubo, J. Improvement the robustness on geographical networks by adding shortcuts. Physica A Stat. Mech. Appl. 2007, 380, 552–562. [Google Scholar] [CrossRef] [Green Version]
  32. Xiao, Y.D.; Lao, S.Y.; Hou, L.L.; Small, M.; Bai, L. Effects of edge directions on the structural controllability of complex networks. PLoS ONE 2015, 10, e0135282. [Google Scholar] [CrossRef]
  33. Yan, H.Y.; Hou, L.L.; Ling, Y.X.; Wu, G.H. Optimizing complex networks controllability by local structure information. Int. J. Mod. Phys. C 2016, 27. [Google Scholar] [CrossRef]
  34. Sohn, I. A robust complex network generation method based on neural networks. Physica A Stat. Mech. Appl. 2019, 523, 593–601. [Google Scholar] [CrossRef]
  35. Kwon, H.; Yoon, H.; Choi, D. Restricted evasion attack: Generation of restricted-area adversarial example. IEEE Access 2019, 7, 60908–60919. [Google Scholar] [CrossRef]
  36. Kwon, H.; Yoon, H.; Park, K.W. Acoustic-decoy: Detection of adversarial examples through audio modification on speech recognition system. Neurocomputing 2020, 417, 357–370. [Google Scholar] [CrossRef]
  37. Lü, L.Y.; Jin, C.H.; Zhou, T. Similarity index based on local paths for link prediction of complex networks. Phys. Rev. E 2009, 80. [Google Scholar] [CrossRef] [Green Version]
  38. Dong, L.Y.; Li, Y.L.; Yin, H.; Le, H.; Rui, M. The algorithm of link prediction on social network. Math. Probl. Eng. 2013, 2013. [Google Scholar] [CrossRef]
  39. Yao, L.; Wang, L.N.; Pan, L.; Yao, K. Link prediction based on common-neighbors for dynamic social network. Procedia Comput. Sci. 2016, 83, 82–89. [Google Scholar] [CrossRef] [Green Version]
  40. Adamic, L.A.; Adar, E. Friends and neighbors on the web. Soc. Netw. 2003, 25, 211–230. [Google Scholar] [CrossRef] [Green Version]
  41. Zhou, T.; Lü, L.; Zhang, Y.C. Predicting missing links via local information. Eur. Phys. J. B 2009, 71, 623–630. [Google Scholar] [CrossRef] [Green Version]
  42. Wang, P.; Xu, B.W.; Wu, Y.R.; Zhou, X.Y. Link prediction in social networks: The state-of-the-art. Sci. China Inform. Sci. 2015, 58. [Google Scholar] [CrossRef] [Green Version]
  43. Ravasz, E.; Somera, A.L.; Mongru, D.A.; Oltvai, Z.N.; Barabási, A.L. Hierarchical organization of modularity in metabolic networks. Science 2002, 297, 1551–1555. [Google Scholar] [CrossRef] [Green Version]
  44. Fouss, F.; Pirotte, A.; Renders, J.M.; Saerens, M. Random-walk computation of similarities between nodes of a graph with application to collaborative recommendation. IEEE T. Knowl. Data En. 2007, 19, 355–369. [Google Scholar] [CrossRef]
  45. Lü, L.Y.; Zhou, T. Link prediction in complex networks: A survey. Physica A Stat. Mech. Appl. 2011, 390, 1150–1170. [Google Scholar] [CrossRef] [Green Version]
  46. Chebotarev, P.; Shamis, E.V. The matrix-forest theorem and measuring relations in small social groups. Automat. Rem. Contr. 1997, 58, 1505–1514. [Google Scholar]
  47. Zanin, M.; Sun, X.Q.; Wandelt, S. Studying the topology of transportation systems through complex networks: Handle with care. J. Adv. Transport. 2018, 3156137. [Google Scholar] [CrossRef]
  48. Gupta, R.D.; Kundu, D. Generalized exponential distribution: Existing results and some recent developments. J. Stat. Plan. Infer. 2007, 137, 3525–3536. [Google Scholar] [CrossRef]
  49. Xu, T.Q.; Chen, Y.P. Two-sided M-Bayesian credible limits of reliability parameters in the case of zero-failure data for exponential distribution. Appl. Math. Model. 2014, 38, 2586–2600. [Google Scholar] [CrossRef]
  50. Liu, N.; Zhang, J.; Zhang, H.; Liu, W.X. Security assessment for communication networks of power control systems using attack graph and MCDM. IEEE Trans. Power Deliver. 2010, 25, 1492–1500. [Google Scholar] [CrossRef]
  51. Xiao, Y.H.; Wu, W.T.; Wang, H.; Xiong, M.M.; Wang, W. Symmetry-based structure entropy of complex networks. Physica A Stat. Mech. Appl. 2008, 387, 2611–2619. [Google Scholar] [CrossRef] [Green Version]
  52. Liu, W.Y.; Li, X.; Liu, T.; Liu, B. Approximating betweenness centrality to identify key nodes in a weighted urban complex transportation network. J. Adv. Transport. 2019, 9024745. [Google Scholar] [CrossRef]
  53. Krishnaveni, S.; Pethalakshmi, A. Toward automatic quality detection of Jasmenum flower. ICT Express 2017, 3, 148–153. [Google Scholar] [CrossRef]
  54. Wang, R.B.; Xu, H.Y.; Li, B.; Feng, Y. Research on method of determining hidden layer nodes in BP neural network. Comput. Technol. Dev. 2018, 28, 31–35. [Google Scholar]
Figure 1. Neural network model.
Figure 1. Neural network model.
Applsci 11 05186 g001
Figure 2. Network topology with N = 100. (a) The original network, E = 0.36789562, P = 0.45966444; (b) the optimized network produced by RA model, E = 0.43532997, P = 0.87918564; (c) the optimized network produced by neural networks based on RA model, E = 0.47471380, P = 0.90748775.
Figure 2. Network topology with N = 100. (a) The original network, E = 0.36789562, P = 0.45966444; (b) the optimized network produced by RA model, E = 0.43532997, P = 0.87918564; (c) the optimized network produced by neural networks based on RA model, E = 0.47471380, P = 0.90748775.
Applsci 11 05186 g002
Figure 3. The link prediction results of all methods for networks with N = 30. (a) Network efficiency; (b) global network structure reliability.
Figure 3. The link prediction results of all methods for networks with N = 30. (a) Network efficiency; (b) global network structure reliability.
Applsci 11 05186 g003
Figure 4. The link prediction results of all methods for networks with N = 50. (a) Network efficiency; (b) global network reliability.
Figure 4. The link prediction results of all methods for networks with N = 50. (a) Network efficiency; (b) global network reliability.
Applsci 11 05186 g004
Figure 5. The link prediction results of all methods for networks with N = 80. (a) Network efficiency; (b) global network reliability.
Figure 5. The link prediction results of all methods for networks with N = 80. (a) Network efficiency; (b) global network reliability.
Applsci 11 05186 g005
Figure 6. The link prediction results of all methods for networks with N = 100. (a) Network efficiency; (b) global network reliability. Note: 1. ON is the original network; 2. CN is the optimized network produced by CN model; 3. NN-CN is the optimized network produced by neural networks based on CN model; 4. NN is the optimized network produced by neural networks.
Figure 6. The link prediction results of all methods for networks with N = 100. (a) Network efficiency; (b) global network reliability. Note: 1. ON is the original network; 2. CN is the optimized network produced by CN model; 3. NN-CN is the optimized network produced by neural networks based on CN model; 4. NN is the optimized network produced by neural networks.
Applsci 11 05186 g006
Figure 7. Network efficiency in different methods. (a) Predicted network 1; (b) predicted network 2.
Figure 7. Network efficiency in different methods. (a) Predicted network 1; (b) predicted network 2.
Applsci 11 05186 g007
Figure 8. Global network structure reliability in different methods. (a) Predicted network 1; (b) predicted network 2.
Figure 8. Global network structure reliability in different methods. (a) Predicted network 1; (b) predicted network 2.
Applsci 11 05186 g008
Table 1. Network efficiency and global network structure reliability of all methods.
Table 1. Network efficiency and global network structure reliability of all methods.
IndexNPredicted NetworkONCNRAJCHPLHNACTCTMFNN
E3010.48697320.55593870.56475100.55708810.54904220.53544060.55249040.53524900.53850580.5839081
20.48099620.56341000.55938700.56436780.55900380.55287360.55823760.54501920.54425290.5827586
5010.43604080.50115650.51272110.50115650.49374150.46787760.49918370.47680270.47564630.5202721
20.43209520.50517010.51632650.50517010.51234010.48061220.49455780.46911570.46795920.5418367
8010.37967300.43953590.45250530.43958860.43902430.41449370.43881330.41280060.41178800.4672996
20.39635550.46460970.45954640.46033760.45757910.42748950.45398210.42903480.42513190.4782437
10010.36789560.44133330.43533000.44133330.46466670.39187210.42389900.40370370.39993600.4889899
20.36527270.42407740.43208420.42407740.43651520.39285520.41928620.40244780.39805720.4520875
P3010.68238150.91544750.91682450.91042100.90424220.85962960.93158460.90556760.89746700.9388779
20.67632700.92784720.91038990.92893630.91655030.88061710.93156670.90891690.90488700.9387938
5010.66127090.92764010.92399630.92764010.90536360.83968450.92722980.89340190.89097360.9277433
20.56936400.90872180.91298380.90872180.90833420.83597190.90477670.87770540.87676070.9439408
8010.45706950.86518470.88075300.86334150.84253820.76970390.86945480.82341310.81403070.8994345
20.51953500.91158350.90049210.90379030.89115660.80224900.90340390.84258710.84414840.9272361
10010.45966440.87918560.86402350.87918560.89414820.74204750.84214910.81282430.81052830.9234288
20.37974150.85636020.86172170.85636020.85486640.71520760.82468430.81741760.80093780.9001898
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, K.; Gu, S.; Yan, D. A Link Prediction Method Based on Neural Networks. Appl. Sci. 2021, 11, 5186. https://doi.org/10.3390/app11115186

AMA Style

Li K, Gu S, Yan D. A Link Prediction Method Based on Neural Networks. Applied Sciences. 2021; 11(11):5186. https://doi.org/10.3390/app11115186

Chicago/Turabian Style

Li, Keping, Shuang Gu, and Dongyang Yan. 2021. "A Link Prediction Method Based on Neural Networks" Applied Sciences 11, no. 11: 5186. https://doi.org/10.3390/app11115186

APA Style

Li, K., Gu, S., & Yan, D. (2021). A Link Prediction Method Based on Neural Networks. Applied Sciences, 11(11), 5186. https://doi.org/10.3390/app11115186

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop