Next Article in Journal
Exploring the Possibility of a Recovery of Physics Process Properties from a Neural Network Model
Previous Article in Journal
Distributed Learning for Dynamic Channel Access in Underwater Sensor Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Incomplete Information Management Using an Improved Belief Entropy in Dempster-Shafer Evidence Theory

School of Big Data and Software Engineering, Chongqing University, Chongqing 401331, China
*
Author to whom correspondence should be addressed.
Entropy 2020, 22(9), 993; https://doi.org/10.3390/e22090993
Submission received: 8 August 2020 / Revised: 2 September 2020 / Accepted: 3 September 2020 / Published: 7 September 2020
(This article belongs to the Section Signal and Data Analysis)

Abstract

:
Quantifying uncertainty is a hot topic for uncertain information processing in the framework of evidence theory, but there is limited research on belief entropy in the open world assumption. In this paper, an uncertainty measurement method that is based on Deng entropy, named Open Deng entropy (ODE), is proposed. In the open world assumption, the frame of discernment (FOD) may be incomplete, and ODE can reasonably and effectively quantify uncertain incomplete information. On the basis of Deng entropy, the ODE adopts the mass value of the empty set, the cardinality of FOD, and the natural constant e to construct a new uncertainty factor for modeling the uncertainty in the FOD. Numerical example shows that, in the closed world assumption, ODE can be degenerated to Deng entropy. An ODE-based information fusion method for sensor data fusion is proposed in uncertain environments. By applying it to the sensor data fusion experiment, the rationality and effectiveness of ODE and its application in uncertain information fusion are verified.

1. Introduction

Uncertain information processing is applied to complex systems in many fields, such as sensor networks [1,2], pattern recognition [3,4], and supply chain network management [5,6]. Dempster–Shafer (D–S) evidence theory [7,8,9] has a good performance in dealing with uncertain information, such as reliability assessment [10,11], pattern recognition [12,13], decision-making [14,15,16], and so on [17,18,19,20]. The sources of uncertainty information of D-S evidence theory include: (1) mass function of focal element, (2) non-zero mass function of empty set, and (3) uncertain information represented by possible incomplete FOD. Previously, many scholars have proposed many uncertainty measurement methods, which can identify the difference of uncertain information in probability framework to different degrees and are widely used in different fields. As the most widely used information entropy theory, Shannon entropy has been extended to a variety of fields, such as network entropy in complex networks [21] and gene enlargement analysis in the field of biological information [22]. Uncertainty measure for uncertain information management is a hot topic [23,24,25,26,27]. Entropy-based measure attracts lots of attention among researches [28,29]. Inspired by Shannon entropy, in the framework of evidence theory, many scholars have proposed methods in order to measure the uncertainty of evidence from different perspectives, such as Yager’s dissonance measure [30], Deng entropy [31,32], and so on [17,33]. Meanwhile, some improved belief entropy based on Deng entropy has been proposed by scholars, such as Zhou et al.’s entropy [34] and Cui et al.’s entropy [35]. Belief entropy has shown its advantages for addressing uncertain information processing in some practical applications, such as risk analysis [36,37,38], decision-making [15,33] and sensor data fusion [39]. According to the introduction to belief entropy in [40], the existing methods are mainly for complete information in the closed world conditions.
In the open world hypothesis, the empty set of non-zero mass functions means that the FOD is incomplete. The incomplete uncertain information is modeled by non-zero mass function of empty set, so we can use the empty set of non-zero mass functions in order to model the incomplete information in the open world. For this reason, the reasonable measure should take into consideration of the incomplete information that was caused by the empty set of non-zero mass functions, and at the same time, the uncertainty of the FOD should also be considered [41]. Thus, uncertainty measure can be applied in the open world assumption [42]. An improved belief entropy named Open Deng entropy (ODE) is proposed in this work in order to solve the uncertainty measurement of open world assumption. The ODE takes into account the sources of uncertain information in the Dempster–Shafer evidence theory framework that are rarely considered by other existing methods, including the uncertain information brought by the incomplete FOD and the non-zero mass function of empty set. This article gives some examples and the application of ODE in sensor data fusion to further discuss and verify the validity and applicability of the ODE. First, BPA is adopted to model the uncertain information, then, ODE is used to measure the uncertainty of BPA. After that, calculating the weight of each evidence function for modifying the mass function. Finally, data fusion using Dempster’s combination rule and applying the method to engineering applications.
The remainder of this article is shown below. Section 2 covers the preliminary knowledge. In Section 3, the ODE is proposed, and its properties are discussed, and some numerical examples are given. In Section 4, the information fusion method that is based on ODE and its application in sensor data are introduced. Finally, the conclusion of this paper is drawn in Section 5.

2. Preliminaries

This section provides a brief overview of some preliminaries.

2.1. Dempster-Shafer Evidence Theory

Definition 1.
The frame of discernment Ω is defined as a finite non-empty set containing N mutually exclusive events, and its specific expression is as follows:
Ω = Θ 1 , Θ 2 , , Θ i , , Θ N .
Definition 2.
The power set of Ω, denoted as 2 Ω , which is composed of 2 N elements, is defined, as follows:
2 Ω = ϕ , Θ 1 , Θ 2 , , Θ N , Θ 1 , Θ 2 , , Θ 1 , Θ 2 , Θ i , , Ω .
Definition 3.
For Ω, a basic probability assignment(BPA)(or mass function) is a mapping m: 2 Ω [ 0 , 1 ] , which satisfies the following properties:
m ( ϕ ) = 0 , A Ω m ( A ) = 1 .
If m ( A ) > 0 , the subset A is called a focal element and m ( A ) > 0 is the mass function value of proposition subset A.
Definition 4.
A body of evidence (BOE) is a component unit of uncertain information based on FOD, power set of FOD, and mass function. A BOE is a binary group of proposition subset and corresponding mass function, which is defined as:
( , m ) = < A , m ( A ) > : A 2 Ω , m ( A ) > 0 ,
where ℜ is a subset of the power set 2 Ω .
Definition 5.
For Ω, the belief function B e l or the plausibility function P l , is defined as
B e l ( A ) = ϕ B A m ( B ) ,
P l ( A ) = B A ϕ m ( B ) .
Definition 6.
In Dempster–Shafer (D–S) evidence theory, Dempster’s rule of combination can fuse two independent mass functions m 1 and m 2 :
m ( A ) = ( m 1 m 2 ) ( A ) = 1 1 K B C = A m 1 ( B ) m 2 ( C ) ,
where k is a normalization factor defined, as follows:
k = B C = ϕ m 1 ( B ) m 2 ( C ) .
It is worth noting that the classical definitions of DST are defined and used in the closed world.
Definition 7.
In the open world hypothesis, Dempster’s rule of combination is extended by Deng in [31]. The intersection of empty set and empty set is still empty set, which satisfies condition ϕ 1 ϕ 2 = ϕ . Given two BPAs ( m 1 and m 2 ), the generalized combination rule is defined, as follows:
m A = 1 m ϕ B C = A m 1 B · m 2 C 1 K ,
K = B C = ϕ m 1 ( B ) m 2 ( C ) ,
m ( ϕ ) = m 1 ( ϕ ) · m 2 ( ϕ ) ,
m ( ϕ ) = 1 i f a n d o n l y i f K = 1 .

2.2. Shannon Entropy and Belief Entropy

Definition 8.
As the most widely used information entropy theory, Shannon entropy has been extended to many fields, such as network entropy in complex networks [21] and gene enlargement analysis in the field of biological information [22]. Shannon entropy is defined as [43]:
H = i = 1 N p i l o g b p i ,
where N is the number of basic states, p i is the probability of state i, and p i satisfied i = 1 N p i = 1 .
Definition 9.
Deng entropy was proposed in [31] based on Shannon entropy. Some properties and behaviors are discussed in [31,44]. Deng entropy is defined as [31]:
E d ( m ) = A X m ( A ) l o g 2 m ( A ) 2 A 1 ,
where | A | represents the cardinality of the proposition A. According to [31], there are some advantages in Deng entropy when compared with other methods. However, Deng entropy also has some significant disadvantages. For example, Deng entropy does not take into account the influence of the size of the FOD and the intersection of different proposition subsets [35], and it cannot be applied to incomplete FOD.
Definition 10.
As an improvement on Deng entropy, Cui et al.’s entropy was proposed in [35]. When compared with Deng entropy, the improved entropy in [35] takes the influence of the size of the FOD and the intersection of different proposition subsets into account. Cui et al.’s entropy is defined as [35]:
E C u i ( m ) = A X m ( A ) l o g 2 ( m ( A ) 2 A 1 e B X B A A B 2 X 1 ) ,
where | A | represents the cardinality of the proposition A, X is the frame of discernment, | X | denotes the certain element number in the frame of discernment, and A B is the cardinality of the intersection of A and B. Although Cui et al.’s entropy is optimized for Deng entropy, according to [45], Cui et al.’s entropy still has some obvious problems, such as its lack of subadditivity, additivity, and monotonicity.

3. The Improved Belief Entropy

In this part, we define a new belief entropy for incomplete and uncertain information measuring based on Deng entropy named Open Deng entropy (ODE). On this basis, a sensor data fusion method is proposed and its advantages as compared with other methods are discussed in Section 4.

3.1. The Open Deng Entropy

The Open Deng entropy (ODE) is defined as follows:
E o d e = ( A X ) ( A ϕ ) m ( A ) l o g 2 ( m ( A ) 2 A 1 e m ( ϕ ) X ) ,
where X is the frame of discernment, | X | represents the number of elements identified in the FOD, | A | denotes the element number in proposition A, the open world characteristic factor of D–S evidence theory is a newly proposed parameter. Through the open world characteristic factor, the ODE can include the non-zero mass function of the empty set and the uncertain information expressed by the possible imperfection of the FOD. The basis of the open world characteristic factor is as follows.
  • The parameter m ( ϕ ) represents the value of mass function of empty set, and parameter X is the potential of the FOD. In the evidence theoretical framework, the two have clear physical meanings.
  • When the information space degenerates from the open world to the closed world, the value of the empty set mass function is 0, which keeps good compatibility with the improved Deng entropy method.
Property 1.
semantic consistency with evidence theory. ODE is defined based on mass function, the frame of discernment and its potential in the evidence theory, propositional subset of the FOD, and its potential and empty set, which does not involve the loss of semantic consistency with the evidence theory caused by mass function and probability function conversion in the closed world described in literature [40], so the ODE satisfies the semantic consistency with the evidence theory.
Property 2.
non-negative. In the open world, the focal element proposition A defined by the classical evidence theory can also represent the empty set with incomplete information propositions in the open world, and its corresponding mass function value satisfies 1 > m ( A ) > 0 . If and only if m ( A ) = 1 , which is, when the mass function is the Bayes probability, E o d e ( m ) = 0 . Regardless of whether the value of the BPA of the empty set is zero, which is, whether it is in the open world or the closed world, m ( A ) 2 A 1 e m ( ϕ ) X is always not greater than 1. That is, l o g 2 ( m ( A ) 2 A 1 e m ( ϕ ) X ) is never greater than 0. Therefore, the Open Deng entropy satisfies the value non-negative characteristic.
Property 3.
probabilistic consistency. When proposition A is a subset of a single element, the ODE is reduced to E d ( m ) = A X m ( A ) l o g 2 m ( A ) 2 A 1 , which is fully compatible with the characteristic of Thomas Bayes probabilistic information of Shannon entropy measurement and has probability consistency. When proposition A is the empty set representing incomplete information under the assumption of open world, the confidence uncertainty of the mass function of the empty set and the size of the FOD affect the expression of probability consistency.
The above three properties are completely consistent with Deng entropy. ODE and the improved entropy in [35] are both improved based on Deng entropy, but there are some differences between them. Cui et al.’s entropy is an improvement of Deng entropy when considering the influence of the size of the FOD and the intersection of different proposition subsets [35]. In contrast, the ODE improves Deng entropy by taking into account not only the size of the FOD, but also the non-zero mass function of empty set, so that the ODE can be applied to incomplete FOD, which shown in Example 3 and Section 4. It is important to note that the ODE, like Deng entropy and Cui et al.’s entropy, does not satisfy additivity, monotonicity, etc. With the addition of the non-zero mass function of empty set and incomplete FOD, information uncertainty in the open world becomes more complex. Whether ODE needs to satisfy the additivity, monotonicity, and other properties of closed world confidence entropy proposed by researchers requires further study by more scholars. At the same time, inspired by Cui et al.’s entropy, the influence of the intersection of different proposition subsets can be taken into account in the future development of ODE.

3.2. Numerical Example and Discussion

Example 1.
In the frame of discernment X = a , the BPAS are as follows:
m ( a ) = 1.0 , m ( ϕ ) = 0 .
In this example, the mass function of the empty set is 0, which shows that the mass function is distributed in the closed world. Shannon entropy H, Deng entropy E d , and ODE E o d e are calculated, as follows:
H ( m ) = 0 , E d ( m ) = 0 , E o d e ( m ) = 0 .
Example 2.
In the frame of discernment X = a , b , c , d , the given mass function is as follows:
m ( a ) = 0.25 , ( b ) = 0.25 , m ( c ) = 0.25 , m ( d ) = 0.25 , m ( ϕ ) = 0 .
In this example, the mass function of the empty set is 0, which indicates that the mass function is distributed in the closed world. Shannon entropy H, Deng entropy E d , and ODE E o d e are calculated, as follows:
H ( m ) = 2.0 , E d ( m ) = 2.0 , E o d e ( m ) = 2.0 .
From the measurement results of evidence uncertainty in the above two examples, it can be found that the mass function of the empty set is 0, which is, under the condition of the closed world, the ODE is reduced to the Deng entropy, and the calculated results are consistent with the results of the Deng entropy and Shannon entropy measurements. However, the mass function of the empty set in the open world is not zero, so Shannon entropy and Deng entropy are no longer applicable. At this time, we can only adopt the method of this chapter.
Example 3.
In a changing FOD | X | , the given mass function is as follows:
m ( a ) = 0.2 , m ( b ) = 0.3 , m ( ϕ ) = 0.5 .
The BPA of an empty set is 0.5, which is non-zero, which indicates that the mass function is allocated under open world conditions. The uncertainty measurement results of Shannon entropy H, Deng entropy E d and Open Deng entropy E o d e varied with the changing FOD | X | , as shown in Table 1 and Figure 1. The measurement results show that, even if we regard the empty set proposition as a special uncertainty proposition with non-zero mass function assignment, Shannon entropy H can be used to calculate this example, the measurement results cannot reflect the change of potential in the FOD. Because the BPA of the empty set is non-zero, the Deng entropy cannot be applied in this example. Obviously, the Open Deng entropy can be used to E o d e ( m ) indicate that, as the FOD | X | expands, the value of the measurement of evidence uncertainty gradually increases.

4. Application in Sensor Data Fusion with Incomplete Information

This section proposes a conflict data fusion method that is based on the uncertainty of Open Deng entropy measurement information to illustrate the applicability and effectiveness of Open Deng entropy in information fusion. Figure 2 designs the framework of open world uncertain information fusion method based on Open Deng entropy. Detailed process description of steps in Figure 2 are as follows.
Step 1: in the open world, there is a lot of uncertain information in the practical application of BPA modeling. To address the uncertain information systematically and objectively, in the framework of Dempster–Shafer evidence theory, the first step is to use BPA to model the uncertain information.
Step 2: use Open Deng entropy to measure the uncertain information of BPA before further processing the data, it is necessary to use a reasonable and applicable uncertainty measure to measure the uncertainty of the information modeled by BPA in step 1. In this method, the uncertain information is measured by the Open Deng entropy. The uncertainty that corresponds to ODE is calculated, as follows:
E o d e = ( A X ) ( A ϕ ) m ( A ) l o g 2 ( m ( A ) 2 A 1 e m ( ϕ ) X )
Step 3: calculate the weight of each evidence function and modify the mass function based on the weight. The weight of each evidence function can be calculated according to the value of the ODE. The specific formula is as follows:
w i = E o d e ( m i ) i = 1 n E o d e ( m i )
As the data preprocessing before evidence fusion, the weighted mass function of each proposition should be calculated by weight. The weight mass function mass is calculated, as follows:
m w ( A ) = i = 1 n w i m i ( A )
Step 4: data fusion using Dempster’s combination rule. This method use Open Deng entropy to transform and measure the conflict between different evidences, and the combination rule of Dempster is used to complete the data fusion. The combination result of each proposition A can be obtained through ( n 1 ) Dempster’s combination rule:
m ( A ) = ( ( ( ( m w m w ) 1 m w ) 2 m w ) n 2 m w ) n 1 ( A ) , n 2
Step 5: apply the method to engineering applications that need decision analysis.
The fault diagnosis experiment of motor rotor in literature [41] is taken as an application example, and its fault characteristics are extended to make it have the characteristics of open world. Among them, there are three fault modes in the rotor of the motor, F 1 means the rotor is unbalanced, F 2 means the rotor is out of alignment, and F 3 means that the support is loose. Three vibration acceleration sensors were placed in different installation positions in order to collect vibration signals. The frequency amplitude of acceleration vibration at three different frequencies of F r e q 1 , F r e q 2 and F r e q 3 is known as the fault characteristic variable. F 1 , F 2 , F 3 incomplete framework for fault identification. After modification of the data in the literature modeling results [41], it is expanded from the closed world to the open world. Table 2 shows the failure data reported by sensors at different frequencies.

4.1. Uncertainty Measure of BPAs with ODE

Different sources of information, such as the different sensors in this example, can yield data of different reliability. Therefore, the uncertainty of the mass function of evidence modeled can be measured by the proposed Open Deng entropy. For example, for the evidence modeling results of accelerated vibration frequencies F r e q 1 , F r e q 2 , and F r e q 3 , the uncertainty measurement results are shown in Table 3 according to the entropy measurement formula of the open world described in Equation (16).
As for the uncertainty measurement results that are mentioned in Table 3, for the acceleration vibration frequency F r e q 1 and evidence E o d e ( m s 1 ) , the calculation equation is as follows:
E o d e ( m s 1 ) = 0.8176 l o g 2 ( 0.8176 2 1 1 e 0.0268 3 ) 0.0003 l o g 2 ( 0.0003 2 1 1 e 0.0268 3 ) 0.1553 l o g 2 ( 0.1553 2 1 1 e 0.0268 3 ) = 0.8919

4.2. Mass Function Data Modification Based on ODE

The uncertainty measurement results presented in Table 3 are used for evidence data modification. Using the ODE calculation results as the weighting factor of each sensor report. After normalization, the weights of each group with a small acceleration vibration frequency of F r e q 1 are calculated, as follows:
w s 1 = E o d e m s 1 / i = 1 3 E o d e m s i = 0.4191 ,
w s 2 = 0.3382 , w s 3 = 0.2427 .
Table 4 shows the calculation results of evidence weight under each frequency.
Based on the weight factor in Table 4, it is applied to the following mass functiondata modification formula:
m w ( · ) = i = 1 3 w s i m s i .
For the example of acceleration vibration frequency F r e q 1 , the modified mass function is calculated:
m w F 2 = 0.5923 ,
m w F 3 = 0.0005 ,
m w F 1 , F 2 = 0.0904 ,
m w ( ϕ ) = 0.3201 .
The calculated results are shown in Table 5 for the modified mass function under different vibration acceleration frequencies.

4.3. Data Fusion Based on Generalized Rules of Evidence Combination

In the open world, since the mass function of the empty set is no longer 0, the classical Dempster combination rule under the hypothesis of the closed world is no longer applicable, so the generalized evidence combination rule [9] is adopted for evidence fusion.
Two generalized evidence combination rules are needed to fuse the revised three groups of the same mass function values. The calculation results of frequency F r e q 1 are as follows:
m F 2 = m w m w 1 m w 2 F 2 = 0.9909 ,
m F 3 = 0 , m F 1 , F 2 = 0.0023 , m ( ) = 0.0328 .
Table 6 and Figure 3 show the fusion results at different frequencies.
The fusion results of Open Deng entropy and generalized evidence combination rule show that F 2 has the highest confidence support level under any test frequency condition. Therefore, we can determine the fault type to be F 2 . Moreover, according to Table 6 and Figure 3, by comparing different methods, we can clearly see that the data fusion results of the proposed method are consistent with those of other literature, which verifies its effectiveness. In addition, the data fusion results of this method have a higher level of confidence support for the fault conclusion, which is more conducive to the application in practical engineering.

5. Conclusions

In this paper, an uncertainty measurement method that is based on Deng entropy named ODE is proposed. This method is not only compatible with Deng entropy, but it can effectively quantify the uncertainty of closed and open world. Meanwhile, this method takes into account the sources of uncertain information in the Dempster–Shafer evidence theory framework that are not considered by other existing methods, including the uncertain information brought by the incomplete FOD and the non-zero mass function of empty set. In addition, the proposed method takes into account the sources of uncertain information in the Dempster–Shafer evidence theory framework that are not considered in some existing methods, including the uncertain information brought by the incomplete FOD and the non-zero mass function of empty set. An information fusion method is designed based on the ODE in order to verify the validity and applicability of ODE. Examples and applications verify the rationality and validity of the method. In addition, the limitations and problems of this method are discussed in the open world.
There are still some open issues worthy for further discussion on the ODE. The first problem is that the proposed ODE only considers the mass function of a non-zero empty set as the characteristic factor in the calculation formula, and it does not measure the uncertainty information of the mass function of a non-zero empty set separately. The second problem is that the ODE satisfies the nature of Deng entropy. However, it is also not fully satisfied the characteristics of “set consistency”, “sub-additivity”, and “additivity”. The following work should address more reasonable properties in the open world assumption.

Author Contributions

Conceptualization, B.Y., D.G. and Y.T.; Data curation, B.Y.; Formal analysis, Y.L.; Funding acquisition, Y.L.; Methodology, B.Y., D.G. and Y.T.; Project administration, Y.T.; Software, B.Y. and D.G.; Supervision, Y.L.; Validation, D.G., Y.T. and Y.L.; Visualization, B.Y. and D.G.; Writing—original draft, B.Y., D.G.; Writing—review & editing, Y.T. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Chongqing Technology Innovation and Application Development Project (Grant No. cstc2019jscx-dxwtBX0012) and the SRTP of Chongqing University (Grant No. 02250051071001).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Deng, Z.; Peng, Z.; Qi, W.; Liu, J.; Yuan, G. Sequential covariance intersection fusion Kalman filter. Inf. Sci. 2012, 189, 293–309. [Google Scholar] [CrossRef]
  2. Dou, Y.; Ran, C.; Gao, Y. Weighted measurement fusion Kalman estimator for multisensor descriptor system. Int. J. Syst. Sci. 2015, 47, 2722–2732. [Google Scholar] [CrossRef]
  3. Zhou, K.; Martin, A.; Pan, Q.; Liu, Z. SELP: Semi-supervised evidential label propagation algorithm for graph data clustering. Int. J. Approx. Reason. 2018, 92, 139–154. [Google Scholar] [CrossRef] [Green Version]
  4. Liu, Z.G.; Zhang, Z.; Liu, Y.; Dezert, J.; Pan, Q. A new pattern classification improvement method with local quality matrix based on K-NN. Knowl.-Based Syst. 2019, 164, 336–347. [Google Scholar] [CrossRef]
  5. Sabahi, F.; Akbarzadeh-T, M.R. Introducing validity in fuzzy probability for judicial decision-making. Int. J. Approx. Reason. 2014, 55, 1383–1403. [Google Scholar] [CrossRef]
  6. Chan, F.T.S.; Bhagwat, R.; Chan, H.K. The effect of responsiveness of the control-decision system to the performance of FMS. Comput. Ind. Eng. 2014, 72, 32–42. [Google Scholar] [CrossRef]
  7. Dempster, A.P. Upper and Lower Probabilities Induced by a Multivalued Mapping. Ann. Math. Stat. 1967, 38, 325–339. [Google Scholar] [CrossRef]
  8. Shafer, G. A Mathematical Theory of Evidence; Princeton University Press: Princeton, NJ, USA, 1976; Volume 42. [Google Scholar]
  9. Deng, Y. Generalized evidence theory. Appl. Intell. 2015, 43, 530–543. [Google Scholar] [CrossRef] [Green Version]
  10. Su, X.; Li, L.; Qian, H.; Mahadevan, S.; Deng, Y. A new rule to combine dependent bodies of evidence. Soft Comput. 2019, 23, 9793–9799. [Google Scholar] [CrossRef]
  11. Jiang, W.; Xie, C.; Zhuang, M.; Tang, Y. Failure mode and effects analysis based on a novel fuzzy evidential method. Appl. Soft Comput. 2017, 57, 672–683. [Google Scholar] [CrossRef]
  12. Liu, Z.; Liu, Y.; Dezert, J.; Cuzzolin, F. Evidence combination based on credal belief redistribution for pattern classification. IEEE Trans. Fuzzy Syst. 2020, 28, 618–631. [Google Scholar] [CrossRef] [Green Version]
  13. Meng, J.; Fu, D.; Tang, Y. Belief-peaks clustering based on fuzzy label propagation. Appl. Intell. 2020, 50, 1259–1271. [Google Scholar]
  14. Fu, C.; Chang, W.; Yang, S. Multiple criteria group decision making based on group satisfaction. Inf. Sci. 2020, 518, 309–329. [Google Scholar] [CrossRef]
  15. Xiao, F. A multiple-criteria decision-making method based on D numbers and belief entropy. Int. J. Fuzzy Syst. 2019, 21, 1144–1153. [Google Scholar] [CrossRef]
  16. Deng, X.; Jiang, W. An evidential axiomatic design approach for decision making using the evaluation of belief structure satisfaction to uncertain target values. Int. J. Intell. Syst. 2018, 33, 15–32. [Google Scholar] [CrossRef]
  17. Song, Y.; Wang, X.; Wu, W.; Quan, W.; Huang, W. Evidence combination based on credibility and non-specificity. Pattern Anal. Appl. 2018, 21, 167–180. [Google Scholar] [CrossRef]
  18. Li, R.; Li, H.; Tang, Y. An improved method to manage conflict data using elementary belief assignment function in the evidence theory. IEEE Access 2020, 8, 37926–37932. [Google Scholar] [CrossRef]
  19. Dubois, D.; Liu, W.; Ma, J.; Prade, H. The basic principles of uncertain information fusion. An organised review of merging rules in different representation frameworks. Inf. Fusion 2016, 32, 12–39. [Google Scholar] [CrossRef]
  20. Jing, M.; Tang, Y. A new base basic probability assignment approach for conflict data fusion in the evidence theory. Appl. Intell. 2020. [Google Scholar] [CrossRef]
  21. Cao, S.; Dehmer, M. Degree-based entropies of networks revisited. Appl. Math. Comput. 2015, 261, 141–147. [Google Scholar] [CrossRef]
  22. Xie, W.; Schultz, M.D.; Lister, R.; Hou, Z.; Rajagopal, N.; Ray, P.; Whitaker, J.W.; Tian, S.; Hawkins, R.D.; Leung, D.; et al. Epigenomic analysis of multilineage differentiation of human embryonic stem Cells. Cell 2013, 153, 1134–1148. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Jan, N.; Zedam, L.; Mahmood, T.; Rak, E.; Ali, Z. Generalized dice similarity measures for q-rung orthopair fuzzy sets with applications. Complex Intell. Syst. 2020. [Google Scholar] [CrossRef]
  24. Garg, H.; Kumar, K. A novel possibility measure to interval-valued intuitionistic fuzzy set using connection number of set pair analysis and its applications. Neuraln Comput. Appl. 2020, 32, 3337–3348. [Google Scholar] [CrossRef]
  25. Ullah, K.; Mahmood, T.; Ali, Z.; Jan, N. On some distance measures of complex Pythagorean fuzzy sets and their applications in pattern recognition. Complex Intell. Syst. 2020, 6, 15–27. [Google Scholar] [CrossRef] [Green Version]
  26. Zedam, L.; Bouremel, H.; De Baets, B. Left- and right-compatibility of order relations and fuzzy tolerance relations. Fuzzy Sets Syst. 2019, 360, 65–81. [Google Scholar] [CrossRef]
  27. Garg, H.; Kumar, K. Group decision making approach based on possibility degree measure under linguistic interval-valued intuitionistic fuzzy set environment. J. Ind. Manag. Optim. 2020, 16, 445–467. [Google Scholar] [CrossRef] [Green Version]
  28. Athira, T.M.; John, S.J.; Garg, H. A novel entropy measure of Pythagorean fuzzy soft sets. Aims Math. 2020, 5, 1050–1061. [Google Scholar] [CrossRef]
  29. Li, Y.; Garg, H.; Deng, Y. A new uncertainty measure of discrete z-numbers. Int. J. Fuzzy Syst. 2020, 22, 760–776. [Google Scholar] [CrossRef]
  30. Yager, R.R. Entropy and specificity in a mathematical theory of evidence. Int. J. Gen. Syst. 1983, 9, 291–310. [Google Scholar] [CrossRef]
  31. Deng, Y. Deng entropy. Chaos Solitons Fractals 2016, 91, 549–553. [Google Scholar] [CrossRef]
  32. Kang, B.; Deng, Y. The maximum Deng entropy. IEEE Access 2019, 7, 120758–120765. [Google Scholar] [CrossRef]
  33. Qin, M.; Tang, Y.; Wen, J. An improved total uncertainty measure in the evidence theory and its application in decision making. Entropy 2020, 22, 487. [Google Scholar] [CrossRef]
  34. Zhou, D.; Tang, Y.; Jiang, W. A modified belief entropy in Dempster-Shafer framework. PLoS ONE 2017, 12, e0176832. [Google Scholar] [CrossRef] [PubMed]
  35. Cui, H.; Liu, Q.; Zhang, J.; Kang, B. An improved Deng entropy and its application in pattern recognition. IEEE Access 2019, 7, 18284–18292. [Google Scholar] [CrossRef]
  36. Zheng, H.; Tang, Y. A novel failure mode and effects analysis model using triangular distribution-based basic probability assignment in the evidence theory. IEEE Access 2020, 8, 66813–66827. [Google Scholar] [CrossRef]
  37. Wu, D.; Tang, Y. An improved failure mode and effects analysis method based on uncertainty measure in the evidence theory. Qual. Reliab. Eng. Int. 2020, 36, 1786–1807. [Google Scholar] [CrossRef]
  38. Zheng, H.; Tang, Y. Deng entropy weighted risk priority number model for failure mode and effects analysis. Entropy 2020, 22, 280. [Google Scholar] [CrossRef] [Green Version]
  39. Xiao, F. Multi-sensor data fusion based on the belief divergence measure of evidences and the belief entropy. Inf. Fusion 2019, 46, 23–32. [Google Scholar] [CrossRef]
  40. Jirousek, R.; Shenoy, P.P. A new definition of entropy of belief functions in the Dempster–Shafer theory. Int. J. Approx. Reason. 2018, 92, 49–65. [Google Scholar] [CrossRef] [Green Version]
  41. Tang, Y.; Zhou, D.; Chan, F.T.S. An extension to Deng’s entropy in the open world assumption with an application in sensor data fusion. Sensors 2018, 18, 1902. [Google Scholar] [CrossRef] [Green Version]
  42. Zhou, X.; Tang, Y. A note on incomplete information modeling in the evidence theory. IEEE Access 2019, 7, 166410–166414. [Google Scholar] [CrossRef]
  43. Shannon, C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27, 379–423. [Google Scholar] [CrossRef] [Green Version]
  44. Abellán, J. Analyzing properties of Deng entropy in the theory of evidence. Chaos Solitons Fractals 2017, 95, 195–199. [Google Scholar] [CrossRef]
  45. Moral-García, S.; Abellán, J. Critique of modified Deng entropies under the evidence theory. Chaos Solitons Fractals 2020, 140, 110112. [Google Scholar]
  46. Jiang, W.; Xie, C.; Zhuang, M.; Shou, Y.; Tang, Y. Sensor data fusion with z-numbers and its application in fault iagnosis. Sensors 2016, 16, 1509. [Google Scholar] [CrossRef]
  47. Tang, Y.; Zhou, D.; He, Z.; Xu, S. An improved belief entropy-based uncertainty management approach for sensor data fusion. Int. J. Distrib. Sens. Netw. 2017, 13, 155014771771849. [Google Scholar] [CrossRef]
Figure 1. Uncertainty measuring results in Example 3.
Figure 1. Uncertainty measuring results in Example 3.
Entropy 22 00993 g001
Figure 2. Sensor data fusion framework based on ODE.
Figure 2. Sensor data fusion framework based on ODE.
Entropy 22 00993 g002
Figure 3. Sensor data fusion results with different methods.
Figure 3. Sensor data fusion results with different methods.
Entropy 22 00993 g003
Table 1. Uncertainty measurement results of different methods in Example 3.
Table 1. Uncertainty measurement results of different methods in Example 3.
Uncertainty Measure X = 2 X = 3 X = 5 X = 7 X = 9
E d m -----
H m 1.48551.48551.48551.48551.4855
E o d e m 0.80510.86530.91330.93400.9454
Table 2. Data for fault diagnosis modeled as BPAs [46].
Table 2. Data for fault diagnosis modeled as BPAs [46].
F r e q 1 F r e q 2 F r e q 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 2 } { F 1 } { F 2 } { F 1 , F 2 }
m s 1 · 0.81760.00030.15530.02680.62290.37710.36660.45630.11850.0586
m s 2 · 0.56580.00090.06460.36870.76600.23410.27930.41510.26520.0404
m s 3 · 0.24030.00040.01410.74520.85980.14020.28970.43310.24700.0302
Table 3. Measurement results of uncertainty in sensor report based on Open Deng entropy (ODE).
Table 3. Measurement results of uncertainty in sensor report based on Open Deng entropy (ODE).
E ode · F r e q 1 F r e q 2 F r e q 3
E o d e m s 1 0.89190.31241.5732
E o d e m s 2 0.71980.20841.9500
E o d e m s 3 0.51660.12941.9164
Table 4. BPAS weighting factor based on ODE after normalization.
Table 4. BPAS weighting factor based on ODE after normalization.
w si Freq 1 Freq 2 Freq 3
w s 1 0.41910.48050.2892
w s 2 0.33820.32050.3585
w s 3 0.24270.19900.3523
Table 5. Modified mass function based on ODE.
Table 5. Modified mass function based on ODE.
Freq 1 Freq 2 Freq 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 2 } { F 1 } { F 2 } { F 1 , F 2 }
m w · 0.59230.00050.09040.32010.71590.28410.30820.43340.21640.0420
Table 6. Sensor data fusion results with different methods.
Table 6. Sensor data fusion results with different methods.
Freq 1 Freq 2 Freq 3
{ F 2 } { F 3 } { F 1 , F 2 } { F 2 } { F 1 } { F 2 } { F 1 , F 2 }
Jiang et al.’s method [46]0.88610.00020.0582-0.9621-0.33840.59040.0651-
Tang et al.’s method [47]0.88910.00030.0427-0.9784-0.33030.64590.0238-
The propose method0.99090.00000.00230.03280.97710.02290.32850.64660.02480.0001

Share and Cite

MDPI and ACS Style

Yang, B.; Gan, D.; Tang, Y.; Lei, Y. Incomplete Information Management Using an Improved Belief Entropy in Dempster-Shafer Evidence Theory. Entropy 2020, 22, 993. https://doi.org/10.3390/e22090993

AMA Style

Yang B, Gan D, Tang Y, Lei Y. Incomplete Information Management Using an Improved Belief Entropy in Dempster-Shafer Evidence Theory. Entropy. 2020; 22(9):993. https://doi.org/10.3390/e22090993

Chicago/Turabian Style

Yang, Bin, Dingyi Gan, Yongchuan Tang, and Yan Lei. 2020. "Incomplete Information Management Using an Improved Belief Entropy in Dempster-Shafer Evidence Theory" Entropy 22, no. 9: 993. https://doi.org/10.3390/e22090993

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop