Next Article in Journal
Measuring the Construction Efficiency of Zero-Waste City Clusters Based on an Undesirable Super-Efficiency Model and Kernel Density Estimation Method
Previous Article in Journal
How Does Interactive Narrative Design Affect the Consumer Experience of Mobile Interactive Video Advertising?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Evaluating Information Risk Propagation in Complex Public Opinion Environments Based on the Improved Grey Relational Analysis—Decision Making Trial and Evaluation Laboratory Method

1
School of Marxism, University of Electronic Science and Technology of China, Chengdu 611731, China
2
International College, Krirk University, Bangkok 10220, Thailand
*
Author to whom correspondence should be addressed.
Systems 2023, 11(9), 472; https://doi.org/10.3390/systems11090472
Submission received: 10 August 2023 / Revised: 5 September 2023 / Accepted: 12 September 2023 / Published: 13 September 2023
(This article belongs to the Section Systems Practice in Social Science)

Abstract

:
The propagation of information risk in complex public opinion environments not only leads to severe direct reputational losses for companies but also results in significant economic damages. Therefore, during the nascent stage of information risk, identifying potential propagation pathways, determining key dissemination channels, and taking timely measures become crucial. To address this issue, this paper proposes a multi-criteria decision-making method for evaluating information risk propagation in complex public opinion environments. In this method, this paper utilizes probabilistic hesitant fuzzy sets to express the evaluation information, and provide several distance and similarity measurement methods for probabilistic hesitant fuzzy elements. To ensure the rationality of the evaluation indicator weights, this study first applies these distance measurement methods to improve the Grey Relational Analysis—Decision Making Trial and Evaluation Laboratory (GRA-DEMATEL) method for determining the objective weights of evaluation indicators. Next, this paper uses the Delphi method to establish the subjective weights of each evaluation indicator. Finally, by employing a weight synthesis operator, this paper combines the subjective and objective weights to obtain the final indicator weights. Additionally, this paper utilizes the similarity measurement methods for probabilistic hesitant fuzzy elements to improve the combined compromise solution (CoCoSo) method in evaluating and ranking potential information risk propagation pathways. Furthermore, this paper incorporates the “Probability Splitting Algorithm” to handle probabilistic hesitant fuzzy elements, enabling their application in these methodologies. Finally, based on a case study of information risk propagation in the catering industry, we conducted a sensitivity analysis and effectiveness verification of the proposed approach. The results demonstrate the effectiveness of the method and its ability to address real-world issues.

1. Introduction

With the rapid development of the internet, the general public now has access to numerous channels to express their opinions and emotions, utilizing features such as clicks, likes, or shares to convey their sentiments and attitudes. Online platforms such as blogs, forum posts, short videos, and more have become avenues for people to share their viewpoints and express their emotions. Public opinion has evolved into an openly expressed collective voice, encompassing opinions, emotions, and attitudes that are no longer confined to individual views. It has emerged as a prominent force shaping discussions and debates, no longer relegated to mere potential influence [1]. However, it is essential to note that the diversity of online public opinion content prevents it from entirely representing a consistent consensus among the masses. Additionally, emotions and attitudes expressed on online platforms are susceptible to manipulation, leading to variations in public opinion. With the rise of “We Media”, certain influential online figures with a large number of followers, known as “internet celebrities” or “online influencers,” may, at times, intentionally distort hot events and public opinion for personal purposes. This distortion can deviate from the true public sentiment, mislead the public, and create biases [2]. In such a complex public opinion environment, companies are susceptible to negative press and public dissatisfaction, which can have adverse effects on their brand image and reputation. Furthermore, information risk can lead to a decrease in a company’s competitiveness, a reduction in market share, and a breakdown in investor confidence, adversely affecting the company’s sustainable development. In the complex public opinion environment, information risk propagation involves multiple aspects and dimensions and exhibits sudden characteristics. This implies that when evaluating information risk propagation, we face significant uncertainty and challenges. Therefore, research on the evaluation of information risk propagation in complex environments becomes highly necessary. Through the assessment of information risk propagation, companies can proactively identify potential dissemination pathways before negative public opinion evolves into a major issue. By taking targeted and effective measures, they can prevent significant economic and reputational losses to the organization.
However, when evaluating the propagation of information risks, traditional singular assessment methods fail to encompass all relevant factors. In such a context, a multi-criteria approach becomes a crucial evaluation method. This method takes into account multiple key criteria or indicators in the process of information propagation, thereby enabling a comprehensive analysis and assessment of the likelihood and extent of risk dissemination from various perspectives. By comprehensively considering criteria such as propagation speed, information accuracy, and scope of influence, we can better grasp the essence of information risk propagation and formulate effective risk management strategies. Therefore, we will employ a multi-criteria group decision-making approach to evaluate the pathways of information risk propagation. This method allows us to consider the potential dissemination pathways of information risk from multiple dimensions by integrating the opinions of expert groups, thereby conducting the evaluation. Currently, it has been applied to various evaluation issues, such as evaluations in the pharmaceutical sector [3], military matters [4], energy problems [5], and more. Multi-criteria group decision making is a crucial and emerging decision strategy that addresses decision problems by considering the preferences of multiple experts. However, for each expert, effectively evaluating the subject matter is a challenging task. Moreover, uncertainty always plays a dominant role in any decision process concerning the evaluation of objects [6]. To address this problem, Torra [7] proposed hesitant fuzzy sets. This fuzzy set utilizes a series of numbers ranging from 0 to 1 to describe information in decision making, effectively capturing the uncertainty inherent in the decision-making process. However, the hesitant fuzzy set has also encountered a fatal limitation in practical applications, namely, the potential loss of information [8].
To address this limitation, the concept of probability hesitant fuzzy sets (PHFS) emerged [9]. This type of hesitant fuzzy set presents repeated evaluation information in a probabilistic form, ensuring the integrity of assessment information. Furthermore, Xu and Zhou [9] also developed the score function, deviation function, comparison rules, and basic operations for probability hesitant fuzzy sets. Zhang et al. [10] provided the weighted average operator and weighted geometric operator for probability hesitant fuzzy sets. Subsequently, Jiang and Ma [11] proposed the Frank weighted average operator and weighted geometric operator under probability hesitant fuzzy sets. They applied these operators to a multi-attribute group decision-making method for evaluating the efficiency of listed companies. Fang [8] introduced the hybrid entropy and hybrid cross-entropy measures for probability hesitant fuzzy sets, applying them to multi-attribute decision making. Wang et al. [12] presented the axiom definition of PHF entropy for PHFS and explored the relationship between distance measures and entropy measures. Finally, they developed a probabilistic hesitant fuzzy multi-criteria decision-making (PHF-MCDM) model capable of addressing completely unknown attribute weights and used this method to assess the survival of the Yangtze finless porpoise.
In this study, to address uncertainty and ensure the incorporation of evaluation information from all experts, this paper will utilize probability hesitant fuzzy sets as the representation tool for evaluation data. Additionally, this paper will propose a composite evaluation method to evaluate information risk communication in complex public opinion environments. In this method, this paper employs a combination of the Delphi method and GRA-DEMATEL to determine the weights of each evaluation criterion. Additionally, this paper utilizes an improved CoCoSo approach based on similarity to evaluate the various potential pathways of information propagation. Overall, the contributions of this study can be summarized as follows:
(a)
Introduced the “Probability Splitting Algorithm” to handle probability hesitant fuzzy sets and proposed Dice similarity and Jaccard similarity in the context of probability hesitant fuzzy sets. Based on these two similarity measures, two distance measurement methods for probability hesitant fuzzy elements were proposed.
(b)
Improved the GRA-DEMATEL method using Dice distance and Jaccard distance in the framework of probability hesitant fuzzy sets to calculate the weights of evaluation criteria. Additionally, a combination of objective and subjective weights was used to derive comprehensive weights for each evaluation criterion.
(c)
Improved the standardization process of the traditional CoCoSo method using similarity measures to effectively handle probability hesitant fuzzy information. Presented a novel multi-criteria group decision-making and evaluation method.
(d)
Summarized information propagation pathways in complex public opinion environments and identified relevant evaluation criteria, providing a theoretical reference and research basis for future related studies.
The remaining sections of this study are organized as follows: In Section 2, a review of relevant theoretical literature is presented. Section 3 introduces new distance measurement and similarity measurement methods in the context of probability hesitant fuzzy sets and proposes the evaluation method used in this paper. In Section 4, potential information risk propagation pathways and corresponding evaluation criteria are identified through a literature review. Section 5 presents a real-life case study to apply the proposed methods in this paper, and the rationality of the methods is validated through a discussion and analysis. In Section 6, the research conclusions, limitations, and future research directions are provided.

2. Literature Review

2.1. Complex Public Opinion Environment and Information Risk Propagation

Internet public opinion, also known as online sentiment, is a form of social discourse popular on the internet, where people express different views on societal issues [13]. It represents influential and biased opinions of the public on hot and trending topics in real life. With the rapid development of the internet, the role and impact of internet public opinion have become increasingly prominent. As a result, scholars have started to pay more attention to the study of internet public opinion. Deng et al. [14] used information correlation to classify negative online public sentiment and used this classification to predict the risks associated with negative online public sentiment. Ding [1] studied the influencing factors of internet public opinion and explored the psychological effects of these factors in shaping public sentiment. Peng [2] elaborated on the concept, connotation, causal map, and formation mechanism of misleading public sentiment from the perspective of misleading information. He et al. [15] employed stochastic evolutionary game theory to reveal the impact of the distribution structure of netizen clusters on the evolution of negative online public sentiment. Jin et al. [16] focused on the evolution of netizen emotions and constructed a dynamic model for the polarization of online public sentiment groups, conducting simulation research from three dimensions: emotion awakening, emotion interference, and emotion release. From these studies, it can be observed that existing research on internet public sentiment mainly focuses on exploring certain mechanisms behind public sentiment. However, there is limited research that specifically investigates information risk propagation in complex public opinion environments and evaluates such risk propagation. However, risk management plays an important role in reducing corporate risk [17]. Therefore, this paper will evaluate the evaluation of information risk communication in complex public opinion environments from the perspective of information risk communication.

2.2. Information Risk Evaluation Based on Multi-Criteria Decision-Making Methods

Due to the ability of multi-criteria decision-making (MCDM) methods to evaluate and make decisions about objectives from multiple dimensions, the utilization of such methods for a risk assessment and analysis has garnered attention from scholars in recent years. For instance, Bozanic et al. [18] utilized triangular interval fuzzy numbers to modify the AHP method and apply this approach to risk assessment. Hua et al. [19] combined MCDM with a Failure Mode and Effects Analysis (FMEA) to enhance the performance of FMEA, allowing for more flexible expression of risk information. Jasiński et al. [20] employed MCDM techniques to assess the supply security of raw materials used in automotive manufacturing, based on supply risk evaluation criteria. Under a circular economy context, Yazdani et al. [21] employed a multi-criteria decision-making framework for agricultural product risk management. Su et al. [22] used a multi-criteria group decision-making approach for risk assessment of live e-commerce platforms. In addition, scholars have also applied multi-criteria decision-making methods to various other evaluation problems. For example, Deivanayagampillai et al. [23] employed a multi-criteria decision-making method called Single Value Neutrosophic TODIM to study the causal relationships among obstacles in Industry 5.0 adoption. Saraswat and Digalwar [5] applied an integrated fuzzy multi-criteria decision-making method with Shannon entropy to evaluate energy substitution options. In order to enhance the performance of the healthcare sector, Torkayesh et al. [3] proposed a multi-criteria decision-making method that integrates the best worst method (BWM), Level-Based Weight Assessment (LBWA), and CoCoSo for the evaluation of healthcare departments. Abdel-Basset et al. [24] used a hybrid multi-criteria decision-making method to assess sustainable bioenergy production technologies.
In these multi-criteria evaluation methods, the ranking of alternatives in the CoCoSo method proposed by Yazdani et al. [25] is based on a compromise strategy obtained through the application of the Weighted Sum Model (WSM) and Weighted Product Model (WPM). This compromise strategy serves as the final criterion function for ranking the alternative solutions. When the ratings of alternative solutions in the initial decision matrix are consistent, the combination of compromise strategies produces objective evaluation results. In recent years, this method has been widely applied. Ecer and Pamucar [26] used it for sustainable supplier selection. Deveci et al. [27] applied the method for real-time traffic management in the prioritization of autonomous vehicles. Ghoushchi et al. [28] utilized the method for wind turbine fault mode assessment. Inspired by these studies, this paper will incorporate the probability hesitant fuzzy sets and improve the CoCoSo method to evaluate potential pathways of information risk propagation.

2.3. Weight Determination Methods

When evaluating the propagation of information risks, apart from considering the factors influencing information risk propagation and utilizing multi-criteria decision-making methods to assess these factors, it is also essential to account for the importance of these factors, which is reflected in their respective weights. Different weights assigned to these factors will directly influence the final evaluation outcome. Existing weight determination methods can be classified into three categories: objective weighting methods, subjective weighting methods, and methods that combine both objective and subjective approaches [29]. Objective weighting methods commonly include the entropy weighting method [30], maximum deviation method [31], GRA-DEMATEL method [19], and more. Subjective weighting methods include the AHP method [32], Delphi method [33], and others. The combined objective and subjective weighting methods, as the name implies, combine the approaches of both objective and subjective weighting, such as the BWM-LBWA method [3]. DEMATEL is a classical approach in multi-criteria decision making [34], and Paul et al. [35] used a fuzzy DEMATEL method to evaluate criteria weights. Mao et al. [36] proposed a fuzzy DEMATEL method to deal with the ambiguity of evaluation in the decision-making process and to determine the weights of the evaluation criteria. Gandomi et al. [37] used DEMATEL to determine the inter-relationships between the criteria. The main advantages of a Grey Relational Analysis (GRA) are that it is not limited by sample size and normal distribution of data, and its calculation process is simple and easy to understand [38]. It is often used to enhance certain classical multi-criteria decision-making methods. Silva et al. [39] proposed a multi-criteria decision-making model composed of the “CRITIC (Criteria Importance through Intercriteria Correlation)” method and a Grey Relational Analysis (GRA), aiming to select the best alternatives to include in an investment portfolio. Jagatheswari et al. [40] introduced an improved TOPSIS method based on a Grey Relational Analysis (GRATOPSIS) as a collaborative execution strategy, used to evaluate the trustworthiness provided with each mobile node in a network to ensure Quality of Service (QoS). Zhou et al. [41] constructed a Fuzzy Fermate optimization model based on a Grey Relational Analysis to calculate the weights of criteria in multi-criteria decision making. A Grey Relational Analysis (GRA) can replace subjective pairwise comparisons with grey relational coefficients, addressing the limitations of DEMATEL. In this context, GRA and DEMATEL are combined to leverage their strengths and calculate the weights of risk factors based on objective risk information. This approach ensures a fairer and more effective consideration of the correlations among risk factors. The GRA-DEMATEL approach inherits the capability of the DEMATEL model to identify critical features in the decision-making process, while also harnessing the advantages of GRA to overcome challenges associated with extensive risk factors. This includes the substantial workload and implementation difficulties in pairwise comparisons when dealing with a large number of risk factors, as well as the issues of ensuring consistency in pairwise comparisons and the significant changes in the overall relationship matrix due to minor differences in the direct relationship matrix [42]. Therefore, it is an effective method for calculating objective weights for indicators. With the Delphi method in determining the subjective weights, experts need to be anonymous and go through several rounds of discussion to determine the consistent weights [43]. This makes the determined subjective weights more scientific. Inspired by Torkayesh et al. [3], after combining the advantages of GRA-DEMATEL and the Delphi method, we combine them to determine the weights of evaluation indicators.

3. Methodology

3.1. A Brief Review of Probabilistic Hesitant Fuzzy Sets

In this section, we will provide a brief review of some fundamental concepts of probabilistic hesitant fuzzy sets, laying the theoretical groundwork for subsequent sections.
Definition 1.
Ref. [44] Let Φ be a non-empty finite set. The probabilistic hesitant fuzzy set (PHFS) with respect to Φ is represented as follows:
P H F S = ϕ , h ϕ p ϕ ϕ Φ
where  h ϕ p ϕ = ζ α p α , α = 1 , 2 , 3 , , l ; it is referred to as an element of the probabilistic hesitant fuzzy set (PHFS), and  h ϕ p ϕ  is termed as the probabilistic hesitant fuzzy element. In the expression  h ϕ p ϕ , l denotes the total number of elements in the PHFS;  ζ α  represents the possible membership degree of  ϕ Φ ; and  p α  indicates the probability of  ζ α  occurring, satisfying the normalization condition (i.e.,  p α 0 , 1 ) and  α = 1 l p α 1 . In this study,  α = 1 l p α = 1 .
Definition 2.
Ref. [45] Let  h ϕ = ζ α p α , α = 1 , 2 , 3 , , l  be a probabilistic hesitant fuzzy element. The scoring function (SF) and deviation degree (DD) are computed as follows:
S F h ϕ = α = 1 l ζ α p α
D D h ϕ = α = 1 l ζ α S F h ϕ 2 p α
According to the scoring function and deviation degree of probabilistic hesitant fuzzy elements, for any two probabilistic hesitant fuzzy elements  h a  and  h b , the following relationship exists:
(a)
If  S F h a > S F h b , then  h a h b ;
(b)
If  S F h a = S F h b , then
If  D D h a > D D h b , then  h a h b ; if  D D h a = D D h b , then  h a h b .
Definition 3.
Refs. [9,46] For any three probabilistic hesitant fuzzy elements  h ,  h a , and  h b , with the existence of parameter  l > 0  and constant c, the following computation rules hold:
(1)
h ϕ c = α = 1 , 2 , , l 1 ζ α p α ,  h ϕ l = a = 1 , 2 , 3 , , l ζ α l p α
(2)
l h ϕ = a = 1 , 2 , 3 , , l 1 1 ζ α l p α ,  h ϕ c = α = 1 , 2 , , l ζ α c p α
(3)
h a h b = α 1 = 1 , 2 , 3 , l , α 2 = 1 , 2 , 3 , l ζ α 1 + ζ α 2 ζ α 1 ζ α 2 p α 1 p α 2
(4)
h a h b = α 1 = 1 , 2 , 3 , l , α 2 = 1 , 2 , 3 , l ζ α 1 ζ α 1 p α 1 p α 2

3.2. Some New Similarity and Distance Measures for Probabilistic Hesitant Fuzzy Sets

In this section, we extend the Jaccard similarity [47] and Dice similarity [48] to define Jaccard distance and Dice distance for probabilistic hesitant fuzzy sets (PHFS). The distance formulas are introduced based on the work of Jin et al. [49], who applied these distance measures in the context of interval-valued spherical fuzzy environments to compute distances between interval-valued spherical fuzzy sets. Their research demonstrated that these distance measures can prevent information loss and reduce biased computation results. As a result, we adopt these distance measures to calculate the distance between two probabilistic hesitant fuzzy elements.
In practical decision-making environments, it is indeed common to encounter situations where two probabilistic hesitant fuzzy elements have different lengths. To address this issue, this paper introduces the “Probability Splitting Algorithm” to handle such cases and ensure that the PHFS used in the distance calculation have consistent lengths. The core idea of this algorithm is to find the minimum probability from the probabilistic hesitant fuzzy element and then expand the element with fewer probabilities based on this minimum probability. The specific calculation process is illustrated in Example 1, and the detailed algorithm can be referred to in the works of Fang [8] and Lin et al. [50].
Example 1.
Let there be three probabilistic hesitant fuzzy sets:  h ϕ 1 = 0.3 0.2 , 0.5 0.1 , 0.7 0.2 , 0.8 0.5 ,  h ϕ 2 = 0.5 0.3 , 0.7 0.3 , 0.8 0.4 , and  h ϕ 3 = 0.6 0.4 , 0.8 0.6 . By applying the Probability Splitting Algorithm, we can expand these sets as follows:
h ϕ 1 = 0.3 0.2 , 0.5 0.1 , 0.7 0.1 , 0.7 0.1 , 0.8 0.1 , 0.8 0.4
h ϕ 2 = 0.5 0.2 , 0.5 0.1 , 0.7 0.1 , 0.7 0.1 , 0.7 0.1 , 0.8 0.4
h ϕ 3 = 0.6 0.2 , 0.6 0.1 , 0.6 0.1 , 0.8 0.1 , 0.8 0.1 , 0.8 0.4
Definition 4.
Let there be two probabilistic hesitant fuzzy elements,  h ϕ 1 p ϕ 1 = ζ α p α , α = 1 , 2 , 3 , , l  and  h ϕ 2 p ϕ 2 = ζ b p b , b = 1 , 2 , 3 , , l . The Jaccard similarity and distance between them are defined as follows:
S J a c c a r d = i = 1 L ζ i a ¯ ¯ ζ i b ¯ ¯ ζ i a ¯ ¯ 2 + ζ i b ¯ ¯ 2 ζ i a ¯ ¯ ζ i b ¯ ¯ p ¯ ¯ i
d J a c c a r d h ϕ 1 ¯ , h ϕ 2 ¯ = 1 S J a c c a r d
where  h ϕ 1 ¯  and  h ϕ 2 ¯  represent the probabilistic hesitant fuzzy elements obtained after applying the Probability Splitting Algorithm. The elements  ζ i a ¯ ¯  and  ζ i b ¯ ¯  denote elements within the processed probabilistic hesitant fuzzy sets, and  p ¯ ¯ i  represents the probabilities associated with these elements. L represents the length of the processed probabilistic hesitant fuzzy elements.
Theorem 1.
The Jaccard distance between probabilistic hesitant fuzzy elements satisfies the following property:
(1)
0 < d J a c c a r d h ϕ 1 , h ϕ 2 1 ,
(2)
d J a c c a r d h ϕ 1 , h ϕ 2 = d J a c c a r d h ϕ 2 , h ϕ 1 ,
(3)
if  h ϕ 1 = h ϕ 2 , then  d J a c c a r d h ϕ 1 , h ϕ 2 = 0 .
Proof. 
(1) For any two probabilistic hesitant fuzzy elements h ϕ 1 and h ϕ 2 , their internal elements ζ i a and ζ i b always lie within the interval 0 , 1 . Therefore, according to the Cauchy–Schwarz inequality, we have ζ i a ¯ ¯ 2 + ζ i b ¯ ¯ 2 2 ζ i a ¯ ¯ ζ i b ¯ ¯ , ζ i a ¯ ¯ 2 + ζ i b ¯ ¯ 2 ζ i a ¯ ¯ ζ i b ¯ ¯ ζ i a ¯ ¯ ζ i b ¯ ¯ , and ζ i a ¯ ¯ ζ i b ¯ ¯ ζ i a ¯ ¯ 2 + ζ i b ¯ ¯ 2 ζ i a ¯ ¯ ζ i b ¯ ¯ 1 , then 0 < d J a c c a r d h ϕ 1 ¯ , h ϕ 2 ¯ 1 and 0 < d J a c c a r d h ϕ 1 , h ϕ 2 1 . (2) and (3) clearly hold and the proof is sketchy. □
Definition 5.
Let there be two probabilistic hesitant fuzzy elements,  h ϕ 1 p ϕ 1 = ζ α p α , α = 1 , 2 , 3 , , l  and  h ϕ 2 p ϕ 2 = ζ b p b , b = 1 , 2 , 3 , , l . The Dice similarity and distance between them are defined as follows:
S D i c e = i = 1 L 2 ζ i a ¯ ¯ ζ i b ¯ ¯ ζ i a ¯ ¯ 2 + ζ i b ¯ ¯ 2 p ¯ ¯ i
d D i c e h ϕ 1 ¯ , h ϕ 2 ¯ = 1 S D i c e
where,  h ϕ 1 ¯  and  h ϕ 2 ¯  represent the probabilistic hesitant fuzzy elements obtained after applying the Probability Splitting Algorithm. The elements  ζ i a ¯ ¯  and  ζ i b ¯ ¯  denote elements within the processed probabilistic hesitant fuzzy sets, and  p ¯ ¯ i  represents the probabilities associated with these elements. L represents the length of the processed probabilistic hesitant fuzzy elements.
Theorem 2.
The Dice distance between probabilistic hesitant fuzzy elements satisfies the following property:
(1)
0 d D i c e h ϕ 1 , h ϕ 2 1 ,
(2)
d D i c e h ϕ 1 , h ϕ 2 = d D i c e h ϕ 2 , h ϕ 1 ,
(3)
if  h ϕ 1 = h ϕ 2 , then  d D i c e h ϕ 1 , h ϕ 2 = 0 .
The proof is the same as Theorem 1.

3.3. Weight Determination Method Combining Subjective and Objective Approaches

Weight determination has always been an important research direction in fuzzy evaluation. This paper proposes the following weight determination method based on considering both subjective and objective weights. The method is divided into three stages. In the first stage, evaluators need to assign subjective weights to each evaluation criterion based on their own experiences and risk attitudes. To ensure the scientificity and rationality of the weights, this paper adopts the Delphi method to determine the subjective weights. The second stage is the objective weighting stage. In this stage, this paper will use the GRA-DEMATEL method to determine the weights of each evaluation criterion based on the evaluation data provided by experts. The third stage involves the integration of subjective and objective weights.
(1) Stage 1: Subjective Weight Assignment
In this stage, the evaluators invite experts to use the Delphi method to determine the weights of the evaluation criteria. Let there be m evaluation scenarios ( E v a i , i = 1 , 2 , 3 , , m ), and n evaluation indicators ( I n d j , j = 1 , 2 , 3 , , n ). After the Delphi method evaluation, the following subjective weights are obtained:
W s = w j , j = 1 , 2 , 3 , , n
(2) Stage 2: Objective Weight Assignment
As a relatively new method for weight determination, GRA-DEMATEL combines the advantages of a Grey Relational Analysis, which is not restricted by sample size and normal distribution of data, and overcomes the subjectivity in determining the direct correlation matrix in DEMATEL. Therefore, this paper uses this method to determine the weights of each evaluation indicator. However, since the evaluation data we are dealing with are probabilistic hesitant fuzzy numbers, this study will utilize the distance calculation method proposed in Section 3.3 to improve the grey relational coefficient.
Definition 6.
Let the evaluation matrix based on probabilistic hesitant fuzzy numbers be denoted as P. It can be rewritten as  P G r a y = P 1 G , P 2 G , P 3 G , , P n G , where  P j G = h 1 j G , h 2 j G , h 2 j G , , h m j G T  is a column vector. By reorganizing the evaluation matrix, we obtain n sequences. Let one of these sequences,   P t G = h 1 t G , h 2 t G , h 2 t G , , h m t G T , be the behavior characteristic sequence, and the remaining n-1 sequences,  P 1 G = h 11 G , h 21 G , h 21 G , , h m 1 G T , ...,  P t 1 G = h 1 t 1 G , h 2 t 1 G , h 2 t 1 G , , h m t 1 G T ,  P t + 1 G = h 1 t + 1 G , h 2 t + 1 G , h 2 t + 1 G , , h m t + 1 G T , ...,  P n G = h 1 n G , h 2 n G , h 2 n G , , h m n G T , be the related factors. Thus, the direct correlation matrix,  D R M = ħ t j n × n , can be calculated using the following formula:
ħ t j = 1 m s = 1 m min j , j t   min s D P s t G , P s j G + c   max j , j t   max s D P s t G , P s j G D P s t G , P s j G + c max j , j t   max s D P s t G , P s j G
where  D P s t G , P s j G  represents the distance calculation formula proposed in this paper. Since the related factor sequences are different when calculating the values of  ħ i j  and  ħ j i , we can easily obtain  D R M = ħ t j n × n , which is generally a non-symmetric matrix, and  c  denotes the resolution coefficient, which is usually set as  c = 0.5 . Due to the fact that when  j = t , the distance  D P s t G , P s j G  equals 0, therefore, in the correlation matrix, we set the elements on the diagonal to 0.
Based on Definition 6, we can easily obtain the direct correlation matrix for the evaluation results. Next, by further processing the direct correlation matrix, we can calculate the objective weights of each evaluation indicator.
Step 1: Normalize the direct correlation matrix to obtain D R M ¯ = ħ t j ¯ n × n .
ħ t j ¯ = ħ t j max max t ħ t j , max j ħ t j
Step 2: Calculate the total direct correlation matrix T R M ¯ = T t j ¯ n × n .
T R M = lim N D R M ¯ + D R M ¯ 2 + + D R M ¯ N = D R M ¯ E D R M ¯ 1
where E represents the identity matrix.
Step 3: Calculate the sums of each row and column.
R o w t = j = 1 n ħ t j ,   C o l j = t = 1 n ħ t j
Step 4: Calculate the objective weights of each evaluation criterion based on Formulas (8) and (9).
w j o = R o w j + C o l j j = 1 n R o w j + C o l j
(3) Stage 3: Integration of Subjective and Objective Weights
Subjective weighting is based on expert judgments and is highly subjective. Therefore, it may not fully reflect the true weights of each evaluation criterion. On the other hand, objective weighting is calculated based on evaluation data using objective methods. The weights obtained from this method are entirely based on objective data but may overlook some subjective factors. As a result, they may not completely represent the true weights of the evaluation criteria. To address this issue, this paper uses a method that combines subjective and objective approaches to handle the weights. Drawing from the studies of Yazdani et al. [51] and Torkayesh et al. [3], this study proposes the following weight aggregation operators:
w j = w i s w i o i = 1 n w i s w i o

3.4. PHFS-CoCoSo Method Based on Similarity

Building upon the ideas of Simple Additive Weighting (SAW), Weighted Aggregated Sum Product Assessment (WASPAS), and Multiplicative Exponential Weighting (MEW) methods, Yazdani et al. [25] proposed the CoCoSo method and compared it with these three approaches, providing reliable results. However, the traditional CoCoSo method deals with precise numerical information. Although there are some related studies in fuzzy environments, they improve the CoCoSo method by introducing fuzzy operators to process the data [26,27]. In contrast to these studies, here, this paper preprocesses the data using distance measures and directly uses probabilistic hesitant fuzzy numbers for the decision matrix. The specific steps are as follows:
Step 1: Let there be m evaluation schemes and n evaluation criteria. We have the following evaluation matrix based on probabilistic hesitant fuzzy sets.
E M = h 11 P h 12 P h 1 n P h 21 P h 22 P h 2 n P . . . . . . . . . h m 1 P h m 2 P h m n P
Step 2: Normalize the evaluation matrix to obtain D E M .
D E M = S 11 S 12 S 1 n S 21 S 22 S 2 n . . . . . . . . . S m 1 S m 2 S m n
where S i j ( i = 1 , 2 , , m , j = 1 , 2 , , n ) represents the standardized evaluation information after normalization. It is determined with the following equation:
S i j = S h i j P , h j S h j + , h j ; for   benefit   index S h i j P , h j + S h j + , h j ; for   non - benefit   index
where h j = i = 1 l min min i = 1 , 2 , 3 , , m h i j P and h j + = i = 1 l max max i = 1 , 2 , 3 , , m h i j P ; S represents the similarity between two probabilistic hesitant fuzzy sets.
Step 3: Calculate the sum of weighted comparability ( W C i ) and power-weighted comparability sequences ( P W C S i ) for each alternative scheme according to the following equation:
W C i = j = 1 n w j S i j ,   P W C S i = j = 1 n w j S i j
Step 4: Based on the arithmetic mean of the sums of scores obtained from the Weighted Sum Method (WSM) and Weighted Product Method (WPM), the relative score compared to the best alternative scheme for WSM and WPM, and the balanced compromise score of WSM and WPM models, three aggregation scores are defined to calculate the relative weights of evaluation schemes. Here, although the value of δ is between 0 and 1, the threshold is typically set at 0.50.
A A S i a = W C i + P W C S i i = 1 m W C i + P W C S i A A S i b = W C i min i W C i + P W C S i min i P W C S i A A S i c = δ W C i + 1 δ P W C S i δ max i W C i + 1 δ max i P W C S i ; 0 δ 1
Step 5: Calculate the overall score ( E v a l u a t i o n i ) based on the following formula and rank the evaluation schemes according to the overall score.
E v a l u a t i o n i = A A S i a × A A S i b × A A S i c 1 3 + 1 3 A A S i a + A A S i b + A A S i c
Based on the methods presented in the previous sections, this paper provides the following evaluation process, as shown in Figure 1:

4. Evaluation of Information Risk Propagation in Complex Public Opinion Environments

In order to evaluate the information risk propagation in complex public opinion environments, this section will present some potential channels for information risk propagation and construct relevant indicators to assess these propagation channels. The purpose is to assist enterprises in identifying potential propagation channels and determining the most significant ones in a reasonable and timely manner when information risks arise. By using the methods and evaluations presented in this paper, enterprises can promptly discover potential propagation channels and identify the most critical ones. This will enable them to determine response measures promptly and avoid significant losses.

4.1. Information Risk Propagation Channels

Today, the rapid speed and convenience of information dissemination and interaction, coupled with reduced costs, have brought tremendous benefits to human society. However, there is a prevalence of misinformation that spreads widely on various information platforms and media at a low cost and with little effort. Leveraging the astonishing speed and global reach of the internet, misinformation can easily deceive people, manipulate public opinion, and cause significant harm. In this context, this study defines information risk in complex public opinion environments as the potential risks individuals, organizations, or society face in a diverse and rapidly spreading information environment, along with the negative impacts that these risks may bring. Information risk propagation in this paper refers to the dissemination of these risks. By summarizing existing literature, this paper has identified the following potential channels for information risk propagation, as shown in Table 1.

4.2. Construction of Evaluation Indicators

In the current era of advanced internet technology, information risks often spread and disseminate through various potential channels. Therefore, it is of great importance to evaluate these potential dissemination pathways and identify the main routes of information propagation. This assessment directly impacts how decision makers can take effective measures to address these information risks and avoid significant losses. In this context, this paper considers the characteristics of information risk propagation in a complex public opinion environment, such as the lack of barriers to dissemination, micro-content, micro-formats, real-time nature, interactivity, and vitality. Additionally, we take into account the networked distribution patterns of internet users. Based on these factors and referencing previous scholarly research, this paper proposes five indicators for evaluating information propagation pathways. The specific details are presented in Table 2.

5. Case Study

In China, there is a well-known restaurant chain brand with over 900 outlets. This brand is highly favored by consumers for providing delicious food and a pleasant dining experience. It places great emphasis on food safety and hygiene standards, establishing a positive reputation within the industry. The brand strictly controls the procurement, storage, and processing of ingredients to ensure consumers enjoy fresh, safe, and hygienic cuisine. Additionally, the brand values employee training and management to ensure staff possess good hygiene awareness and professional skills, delivering high-quality catering services. Over the years, the brand’s unique cuisine and professional dining experience have continuously attracted new customers, building a large base of loyal consumers.
However, recently, the brand faced a public relations crisis due to a food safety incident. On 1 January 2023, a consumer posted a video on social media exposing food safety issues observed during their visit to one of the brand’s outlets. The video showed poor hygiene conditions in the food preparation area, with improper food storage and the presence of cockroaches. The consumer’s video quickly gained widespread attention on social media platforms, being widely shared and commented on. Other consumers also began sharing their negative experiences and concerns about food safety issues at the brand’s outlets. Soon, the company’s management became aware of the situation and started collecting relevant information. According to available data, the consumer’s video was viewed and shared over 20,000 times on social media. Numerous bloggers wrote more than 60 papers about the brand’s food safety issues. The total number of posts and comments related to the brand’s food safety problem on social media exceeded 10,000.
In order to prevent the situation from escalating further, the management of the company decided to form an expert group to analyze the incident and determine appropriate response measures. Now, based on the evaluation criteria from Section 4.2, the potential dissemination pathways mentioned in Section 4.1 are assessed to facilitate the formulation of response strategies. Due to the urgency and uncertainty of the situation, the expert group’s evaluation information will be presented using probability hesitant fuzzy sets. The specific evaluation information is shown in Table 3.
Stage 1: After conducting four rounds of anonymous evaluation using the Delphi method, the final subjective weights for the five evaluation indicators are determined as follows:
W s = 0.15 , 0.3 , 0.1 , 0.25 , 0.2
Stage 2: Use GRA-DEMATEL to determine the weights of individual evaluation indicators.
Step 2.1: Based on Definition 6, the evaluation information is rewritten, and the direct correlation matrix is obtained according to Formula (6) as shown in (18).
D R M = 0 . 0.5312 0.6528 0.697 0.73 0.5312 0 . 0.5322 0.5422 0.5469 0.6493 0.6847 0 . 0.7098 0.7397 0.8021 0.716 0.7222 0 . 0.7363 0.6745 0.6806 0.7217 0.7396 0 .
Step 2.2: Calculate the normalized direct correlation matrix using Formula (7) as shown in (19).
D R M ¯ = 0 . 0.2033 0.2483 0.2592 0.2652 0.1999 0 . 0.2024 0.2017 0.1987 0.2333 0.246 0 . 0.255 0.2657 0.2695 0.2405 0.2426 0 . 0.2474 0.2395 0.2417 0.2562 0.2626 0 .
Step 2.3: Calculate the total correlation matrix using Formula (8) as shown in (20).
T R M = 4.29802 4.42396 4.52222 4.63519 4.63238 3.80804 3.60521 3.83116 3.92036 3.91278 4.54996 4.51496 4.38644 4.69699 4.69698 4.5747 4.51195 4.58309 4.49532 4.687 4.55629 4.51419 4.59259 4.70412 4.48935
Step 2.4: Calculate the sums of rows and columns, and the objective weights of each evaluation indicator using Formulas (9) and (10). The results are shown in Table 4.
Stage 3: Calculate the comprehensive weights.
According to the subjective weights obtained using the Delphi method in Stage 1 and the objective weights obtained using GRA-DEMATEL in Stage 2, the comprehensive weights are calculated using Formula (11). The results are shown in Table 5.
Stage 4: Rank potential information risk propagation pathways using the similarity-based PHFS-CoCoSo method.
Using the similarity-based PHFS-CoCoSo method, the normalized evaluation matrix under the probability hesitant fuzzy set is obtained as shown in Equation (21). Based on Equations (15)–(17), the evaluation results for W C i , P W C S i , A A S i a , A A S i b , and A A S i c , as well as the comprehensive evaluation results E v a l u a t i o n i , are calculated and presented in Table 6.
Based on the results from Table 6, we can observe that the short video platform is the primary information risk communication channel for the restaurant company in this public opinion incident. Next in line are social media platforms, online forums and blogs, news media, and traditional media. It is not surprising that the short video platform emerged as the main communication channel for this event. Currently, China has a large number of short video users. Compared to other platforms, short video platforms have lower entry requirements for users, as they only need to upload videos taken on their mobile phones. Additionally, videos spread quickly, making the short video platform the most significant channel for this event’s propagation. The restaurant company needs to take timely measures against these potential communication channels’ ranking to prevent the event from becoming a hot topic and causing irreparable damage to the company’s reputation.

6. Discussion

6.1. Sensitivity Analysis

The proposed method in this paper involves two parameters, namely coefficient c and δ. Among them, coefficient c will affect the objective weights of individual evaluation indicators, thereby influencing the evaluation results, while coefficient δ directly affects the final evaluation results. Therefore, in this section, we will explore the impact of different values of c and δ on the evaluation results. Regarding parameter c, as its value changes from 0 to 1, the weights of each evaluation indicator undergo minor fluctuations. However, the ranking of all indicators’ weights remains unchanged, indicating that the weight determination method in this paper exhibits good stability when considering both subjective and objective factors. The results are shown in Figure 2. From Figure 3, it can be observed that due to the small changes in weights, the variations in the potential dissemination pathways are also minimal. Among all potential dissemination pathways, only pathways E v a 2 and E v a 3 exhibit slight changes in their rankings. The reason for this variation is that the difference in evaluation data between pathways E v a 2 and E v a 3 is small, leading to minor changes in weights and subsequent alterations in the rankings.
Parameter δ influences the final evaluation results by affecting the value of Q in Formula (16). From Figure 4a, it can be observed that as δ varies, the change trend is significant. When δ < 6 , the rankings among different potential dissemination pathways remain unchanged despite the variation in δ; however, when δ 6 , the rankings among potential dissemination pathways change. From Figure 4b, it can be seen that the variations among potential dissemination pathways also follow the same trend as δ, with δ = 6 as the dividing line. This is because the value of A A S i c directly affects the evaluation results; hence, A A S i c and the evaluation results exhibit the same change trend.

6.2. Effectiveness Analysis

In this section, we will verify the effectiveness of the proposed evaluation method for information risk propagation pathways in complex public opinion environments from the following three aspects: First, the improved CoCoSo method with similarity measurement is used to standardize the probabilistic hesitant fuzzy evaluation information. Therefore, when applying different similarity measurement methods to this approach with the same parameters, c and δ, the evaluation results should not have significant deviations. Although different similarity measurement methods may have slight differences in emphasis for the same dataset, the resulting deviations should not be substantial, meaning that the evaluation results will not fluctuate significantly. Second, for a decision matrix, changing the evaluation value of one scheme should not alter the ranking of other schemes. Therefore, this paper will verify the effectiveness of the method by changing the evaluation results of potential propagation pathways in the evaluation matrix. Third, when decomposing the same evaluation problem into multiple sub-problems, using the same method to evaluate these sub-problems should yield consistent evaluation results with the original evaluation.
Based on the evaluation data in Section 5, this paper demonstrates the effectiveness of the proposed method from the three aspects mentioned above. For the first aspect, this study uses Jaccard similarity and Dice similarity as the similarity measurement methods in Formula (14). This paper can observe that although the similarity values and evaluation results are different, the final ranking of potential propagation pathways remains consistent. This does not affect the overall ranking of the potential propagation pathways. For the second aspect, this paper replaces the evaluation values of E v 1 in the original evaluation matrix with 0.1 while keeping the probabilities unchanged. The results are presented in Table 7. From the results in Table 7, we can see that changing the evaluation information of one option does not influence the ranking of other potential propagation pathways. Although the rankings of E v 2 and E v 3 changed after the replacement, this is because E v 2 and E v 3 have very similar evaluation results in the original evaluations. Therefore, after replacing the evaluation result of E v 1 , the weights undergo a slight change, leading to a minor shift in their positions. For the third aspect, this paper divided the original evaluation matrix into two sub-evaluation matrices consisting of E v 1 , E v 3 , E v 5 and E v 2 , E v 4 . This paper also split the subjective weights into W 1 s = 0.15 , 0.1 , 0.2 and W 2 s = 0.3 , 0.25 , then recalculated to obtain W 1 s s = 0.33 , 0.22 , 0.45 and W 2 s s = 0.55 , 0.45 . As shown in Figure 5, the final evaluation results are E v 5 E v 1 E v 3 E v 2 E v 4 , E v 5 E v 1 E v 3 and E v 2 E v 4 . The evaluation results are consistent with the original decision matrix’s ranking. In conclusion, it can be demonstrated that the evaluation method proposed in this paper is effective.

7. Conclusions

The widespread and rapid development of the internet has led to an unprecedented speed of information dissemination. Through various online platforms and social media, information can spread rapidly, with low cost and convenience. However, this has also resulted in information overload and the dissemination of false information. Misleading content, rumors, and inaccurate information can spread instantly, impacting the public and giving rise to the formation and spread of public opinion. In this context, it becomes crucial to evaluate and respond to the dissemination of information risks. Based on the preceding analysis, this study identified five potential pathways for information risk dissemination and determined five evaluation indicators to assess these potential pathways. Considering the need for timely and targeted response measures during information risk events, which are characterized by uncertainty and urgency, this study proposed a probabilistic hesitant fuzzy evaluation model for information risk dissemination. In this evaluation model, new distance and similarity measurement methods for probabilistic hesitant fuzzy elements were introduced. These distance measurement methods were used to improve the GRA-DEMATEL method and determine the objective weights of the evaluation indicators. The similarity measurement method was utilized to enhance the CoCoSo method and evaluate and rank the various potential information risk dissemination pathways. In computing these distances and similarities, the varying lengths of different probabilistic hesitant fuzzy elements were taken into account, and the “Probability Splitting Algorithm” was introduced to handle probabilistic hesitant fuzzy elements. Additionally, considering that the objective weight determination method only relies on known evaluation data to determine the weights of each evaluation indicator, lacking the subjective judgment of evaluation experts, the Delphi method was incorporated to determine the subjective weights of each evaluation indicator. These subjective weights and objective weights were then combined using a weight aggregation operator to obtain the comprehensive weights. Finally, the effectiveness and reliability of the proposed method were further confirmed through a sensitivity analysis and validity analysis. Overall, the results demonstrate that the proposed evaluation method is reliable and effective in assessing information risk dissemination pathways in a complex public opinion environment.
This study involved extensive research on information risk dissemination pathways in complex environments and provided some potential information risk dissemination pathways and evaluation indicators; we also proposed a probabilistic hesitant fuzzy evaluation model based on an improved CoCoSo method and a combination of subjective and objective weights. In these methods, we also extended some new distance and similarity measurement methods for probabilistic hesitant fuzzy elements. However, the identified potential information risk dissemination pathways in this study tend to focus on macro-level dissemination pathways, and the determined evaluation indicators are not comprehensive and specific enough. Therefore, in future research, we will further refine these potential information risk dissemination pathways and incorporate more literature to provide more comprehensive multidimensional and hierarchical evaluation indicators. Additionally, Equation (11) also has some limitations, as evidenced with the fact that after aggregation, certain aggregated values exceed the maximum value participating in the aggregation. While this is a recognized and commonly used aggregation method, in future research, we aim to further refine the approach for aggregating subjective and objective weights.

Author Contributions

Conceptualization, Z.L. and J.S.; methodology, Y.X.; software, J.S. and Z.L.; formal analysis, Z.L.; resources, J.S.; writing—original draft preparation, Z.L. and Y.X.; writing—review and editing, J.S. All authors have read and agreed to the published version of the manuscript.

Funding

This work is supported by the Science and Technology Research Program of Chongqing Municipal Education Commission (Grant No. KJQN202101617).

Data Availability Statement

The data used to support the findings of this study are included within the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Ding, B. Analysis of Factors Influencing Public Opinion and Study of Psychological Effects in Public Opinion. Tianjin Soc. Sci. 2018, 6, 33–39. [Google Scholar] [CrossRef]
  2. Peng, Z. Misleading Public Opinion Research from the Perspective of Disinformation. Inf. Stud. Theory Appl. 2023, 46, 59–113. [Google Scholar]
  3. Torkayesh, A.E.; Pamucar, D.; Ecer, F.; Chatterjee, P. An integrated BWM-LBWA-CoCoSo framework for evaluation of healthcare sectors in Eastern Europe. Socio-Econ. Plan. Sci. 2021, 78, 101052. [Google Scholar] [CrossRef]
  4. Erdal, H.; Kurtay, K.G.; Dagistanli, H.A.; Altundas, A. Evaluation of Anti-Tank Guided Missiles: An integrated Fuzzy Entropy and Fuzzy CoCoSo multi criteria methodology using technical and simulation data. Appl. Soft Comput. 2023, 137, 110145. [Google Scholar] [CrossRef]
  5. Saraswat, S.K.; Digalwar, A.K. Evaluation of energy alternatives for sustainable development of energy sector in India: An integrated Shannon’s entropy fuzzy multi-criteria decision approach. Renew. Energy 2021, 171, 58–74. [Google Scholar] [CrossRef]
  6. Garg, H.; Krishankumar, R.; Ravichandran, K.S. Decision framework with integrated methods for group decision-making under probabilistic hesitant fuzzy context and unknown weights. Expert Syst. Appl. 2022, 200, 117082. [Google Scholar] [CrossRef]
  7. Torra, V. Hesitant Fuzzy Sets. Int. J. Intell. Syst. 2010, 25, 529–539. [Google Scholar] [CrossRef]
  8. Fang, B. Some uncertainty measures for probabilistic hesitant fuzzy information. Inf. Sci. 2023, 625, 255–276. [Google Scholar] [CrossRef]
  9. Xu, Z.; Zhou, W. Consensus building with a group of decision makers under the hesitant probabilistic fuzzy environment. Fuzzy Optim. Decis. Mak. 2016, 16, 481–503. [Google Scholar] [CrossRef]
  10. Zhang, S.; Xu, Z.; He, Y. Operations and integrations of probabilistic hesitant fuzzy information in decision making. Inf. Fusion 2017, 38, 1–11. [Google Scholar] [CrossRef]
  11. Jiang, F.; Ma, Q. Multi-attribute group decision making under probabilistic hesitant fuzzy environment with application to evaluate the transformation efficiency. Appl. Intell. 2018, 48, 953–965. [Google Scholar] [CrossRef]
  12. Wang, Y.; Jia, X.; Zhang, L. Evaluation of the survival of Yangtze finless porpoise under probabilistic hesitant fuzzy environment. Int. J. Intell. Syst. 2022, 37, 7665–7684. [Google Scholar] [CrossRef]
  13. Shan, X.; Qi, J.; Cao, Y.; Chen, H. Research on the Formation Path of Online Public Opinion Crisis of Listed Companies. Inf. Stud. Theory Appl. 2023, 1–11. [Google Scholar]
  14. Deng, J.; Wu, L.; Qi, J.; Xu, X.; Liu, Y. Risk Classification and Prediction of Negative Network Public Opinion Based on Information Correlation. Inf. Sci. 2022, 40, 38–43. [Google Scholar] [CrossRef]
  15. He, Q.; Luo, X.; Wang, X. Stochastic Evolutionary Game Analysis of Resolving Negative Network Public Opinion in Emergencies. Econ. Manag. 2023, 37, 20–29. [Google Scholar]
  16. Jin, D.; Xia, Y.; Zhu, P. The Mechanism of Network Public Opinion Group Polarization Dynamics from the Perspective of Emotional Evolution. Inf. Sci. 2023, 41, 57–65. [Google Scholar] [CrossRef]
  17. Trivedi, S. A risk management framework for life insurance companies. J. Corp. Gov. Insur. Risk Manag. 2022, 9, 89–111. [Google Scholar] [CrossRef]
  18. Bozanic, D.; Tešić, D.; Komazec, N.; Marinković, D.; Puška, A. Interval fuzzy AHP method in risk assessment. Rep. Mech. Eng. 2023, 4, 131–140. [Google Scholar] [CrossRef]
  19. Hua, Z.; Jing, X.; Martínez, L. An ELICIT information-based ORESTE method for failure mode and effect analysis considering risk correlation with GRA-DEMATEL. Inf. Fusion 2023, 93, 396–411. [Google Scholar] [CrossRef]
  20. Jasiński, D.; Cinelli, M.; Dias, L.C.; Meredith, J.; Kirwan, K. Assessing supply risks for non-fossil mineral resources via multi-criteria decision analysis. Resour. Policy 2018, 58, 150–158. [Google Scholar] [CrossRef]
  21. Yazdani, M.; Gonzalez, E.; Chatterjee, P. A multi-criteria decision-making framework for agriculture supply chain risk management under a circular economy context. Manag. Decis. 2019, 59, 1801–1826. [Google Scholar] [CrossRef]
  22. Su, J.; Wang, D.; Zhang, F.; Xu, B.; Ouyang, Z. A Multi-Criteria Group Decision-Making Method for Risk Assessment of Live-Streaming E-Commerce Platform. J. Theor. Appl. Electron. Commer. Res. 2023, 18, 1126–1141. [Google Scholar] [CrossRef]
  23. Deivanayagampillai, N.; Jacob, K.; Manohar, G.V.; Broumi, S. Investigation of industry 5.0 hurdles and their mitigation tactics in emerging economies by TODIM arithmetic and geometric aggregation operators in single value neutrosophic environment. Facta Univ. Ser. Mech. Eng. 2023. [Google Scholar] [CrossRef]
  24. Abdel-Basset, M.; Gamal, A.; Chakrabortty, R.K.; Ryan, M. Development of a hybrid multi-criteria decision-making approach for sustainability evaluation of bioenergy production technologies: A case study. J. Clean. Prod. 2021, 290, 125805. [Google Scholar] [CrossRef]
  25. Yazdani, M.; Zarate, P.; Kazimieras Zavadskas, E.; Turskis, Z. A combined compromise solution (CoCoSo) method for multi-criteria decision-making problems. Manag. Decis. 2019, 57, 2501–2519. [Google Scholar] [CrossRef]
  26. Ecer, F.; Pamucar, D. Sustainable supplier selection: A novel integrated fuzzy best worst method (F-BWM) and fuzzy CoCoSo with Bonferroni (CoCoSo’B) multi-criteria model. J. Clean. Prod. 2020, 266, 121981. [Google Scholar] [CrossRef]
  27. Deveci, M.; Pamucar, D.; Gokasar, I. Fuzzy Power Heronian function based CoCoSo method for the advantage prioritization of autonomous vehicles in real-time traffic management. Sustain. Cities Soc. 2021, 69, 102846. [Google Scholar] [CrossRef]
  28. Ghoushchi, S.J.; Jalalat, S.M.; Bonab, S.R.; Ghiaci, A.M.; Haseli, G.; Tomaskova, H. Evaluation of Wind Turbine Failure Modes Using the Developed SWARA-CoCoSo Methods Based on the Spherical Fuzzy Environment. IEEE Access 2022, 10, 86750–86764. [Google Scholar] [CrossRef]
  29. Wang, W.; Deng, X.; Xu, H. A new index weight calculation method of group DEMATEL based on the three-dimensional density operator. Chin. J. Manag. Sci. 2021, 29, 179–190. [Google Scholar] [CrossRef]
  30. Zou, Z.H.; Yun, Y.; Sun, J.N. Entropy method for determination of weight of evaluating indicators in fuzzy synthetic evaluation for water quality assessment. J. Environ. Sci. 2006, 18, 1020–1023. [Google Scholar] [CrossRef]
  31. Chen, C.; Pai, P.; Hung, W. An Integrated Methodology using Linguistic PROMETHEE and Maximum Deviation Method for Third-party Logistics Supplier Selection. Int. J. Comput. Intell. Syst. 2010, 3, 438–451. [Google Scholar] [CrossRef]
  32. Podvezko, V. Application of AHP Technique. J. Bus. Econ. Manag. 2009, 10, 181–189. [Google Scholar] [CrossRef]
  33. Luo, Z.; Zhou, Z.; Hao, Y.; Feng, J.; Gong, Y.; Li, Y.; Huang, Y.; Zhang, Y.; Li, S. Establishment of an indicator framework for the transmission risk of the mountain-type zoonotic visceral leishmaniasis based on the Delphi-entropy weight method. Infect. Dis. Poverty 2022, 11, 122. [Google Scholar] [CrossRef]
  34. Taherdoost, H.; Madanchian, M. Understanding Applications and Best Practices of DEMATEL: A Method for Prioritizing Key Factors in Multi-Criteria Decision-Making. J. Manag. Sci. Eng. Res. 2023; in progress. [Google Scholar] [CrossRef]
  35. Paul, T.K.; Jana, C.; Pal, M.; Simic, V. Sustainable carbon-dioxide storage assessment in geological media using modified Pythagorean fuzzy VIKOR and DEMATEL approach. Int. J. Hydrogen Energy 2023, 48, 9474–9497. [Google Scholar] [CrossRef]
  36. Mao, Q.; Chen, J.; Lv, J.; Guo, M.; Xie, P. Selection of plastic solid waste treatment technology based on cumulative prospect theory and fuzzy DEMATEL. Environ. Sci. Pollut. Res. Int. 2023, 30, 41505–41536. [Google Scholar] [CrossRef]
  37. Gandomi, M.; Pirooz, M.D.; Nematollahi, B.; Nikoo, M.R.; Varjavand, I.; Etri, T.; Gandomi, A.H. Multi-criteria decision-making optimization model for permeable breakwaters characterization. Ocean Eng. 2023, 280, 114447. [Google Scholar] [CrossRef]
  38. Tutak, M.; Brodny, J. Progress towards the innovation potential of the European union member states using grey relational analysis and multidimensional scaling methods. Decis. Mak. Appl. Manag. Eng. 2023, 6, 186–218. [Google Scholar] [CrossRef]
  39. Silva, N.F.; dos Santos, M.; Gomes, C.F.S.; de Andrade, L.P. An integrated CRITIC and Grey Relational Analysis approach for investment portfolio selection. Decis. Anal. J. 2023, 8, 100285. [Google Scholar] [CrossRef]
  40. Jagatheswari, S.; Ramalingam, P.; Chandra Priya, J. Improved grey relational analysis-based TOPSIS method for cooperation enforcing scheme to guarantee quality of service in MANETs. Int. J. Inf. Technol. 2022, 14, 887–897. [Google Scholar] [CrossRef]
  41. Zhou, L.; Wan, S.; Dong, J. A Fermatean Fuzzy ELECTRE Method for Multi-Criteria Group Decision-Making. Informatica 2022, 33, 181–224. [Google Scholar] [CrossRef]
  42. Li, P.; Xu, Z.; Wei, C.; Bai, Q.; Liu, J. A novel PROMETHEE method based on GRA-DEMATEL for PLTSs and its application in selecting renewable energies. Inf. Sci. 2022, 589, 142–161. [Google Scholar] [CrossRef]
  43. Yang, X.; Xu, Z.; Xu, J. Large-scale group Delphi method with heterogeneous decision information and dynamic weights. Expert Syst. Appl. 2023, 213, 118782. [Google Scholar] [CrossRef]
  44. Zhou, W.; Xu, Z. Probability Calculation and Element Optimization of Probabilistic Hesitant Fuzzy Preference Relations Based on Expected Consistency. IEEE Trans. Fuzzy Syst. 2018, 26, 1367–1378. [Google Scholar] [CrossRef]
  45. Gao, J.; Xu, Z.; Liao, H. A Dynamic Reference Point Method for Emergency Response Under Hesitant Probabilistic Fuzzy Environment. Int. J. Fuzzy Syst. 2017, 19, 1261–1278. [Google Scholar] [CrossRef]
  46. Li, J.; Wang, Z.-x. Consensus Building for Probabilistic Hesitant Fuzzy Preference Relations with Expected Additive Consistency. Int. J. Fuzzy Syst. 2018, 20, 1495–1510. [Google Scholar] [CrossRef]
  47. Jaccard, P. Distribution de la flore alpine dans le bassin des Dranses et dans quelques régions voisines. Bull. Soc. Vaudoise Sci. Nat. 1901, 37, 241–272. [Google Scholar]
  48. Dice, L.R. Measures of the Amount of Ecologic Association between Species. Ecology 1945, 26, 297–302. [Google Scholar] [CrossRef]
  49. Jin, C.; Ran, Y.; Wang, Z.; Zhang, G. Prioritization of key quality characteristics with the three-dimensional HoQ model-based interval-valued spherical fuzzy-ORESTE method. Eng. Appl. Artif. Intell. 2021, 104, 104271. [Google Scholar] [CrossRef]
  50. Lin, M.; Zhan, Q.; Xu, Z. Decision making with probabilistic hesitant fuzzy information based on multiplicative consistency. Int. J. Intell. Syst. 2020, 35, 1233–1261. [Google Scholar] [CrossRef]
  51. Yazdani, M.; Torkayesh, A.E.; Chatterjee, P. An integrated decision-making model for supplier evaluation in public healthcare system: The case study of a Spanish hospital. J. Enterp. Inf. Manag. 2020, 33, 965–989. [Google Scholar] [CrossRef]
  52. Wu, L.; Yang, Y. The strategy of psychological restraint on risk amplification of information in online public opinion events. J. Northwest Norm. Univ. (Soc. Sci.) 2019, 56, 108–115. [Google Scholar]
  53. Liu, Z.; Ma, L. The Integrated Application of Internet Public Opinion Information under the Big Data Framework of Smart Information Service. Inf. Sci. 2022, 40, 84–89. [Google Scholar] [CrossRef]
  54. Li, C.; Wu, F.; Sun, Q. Research on information spreading effects in the social interaction context. J. Ind. Eng. Eng. Manag. 2023, 37, 22–34. [Google Scholar]
  55. Bi, H.; Tian, H. Analysis and reflection on the Phenomenon of “Quasi—reversal” in Public Opinion: Taking the “Wanzhou Bus Falling into the river Incident” as an Example. J. Intell. 2019, 38, 103–110. [Google Scholar]
  56. Di, Z.; Mingchen, L. Communication Mechanism of Network Language Information from the Perspective of Information Ecology. Inf. Sci. 2021, 39, 28–34. [Google Scholar] [CrossRef]
  57. Djerf-Pierre, M.; Shehata, A. Still an Agenda Setter: Traditional News Media and Public Opinion During the Transition From Low to High Choice Media Environments. J. Commun. 2017, 67, 733–757. [Google Scholar] [CrossRef]
  58. Li, L.; Xiao, X.; Wang, U. Research on Government Guidance to Online Public Opinion in the Era of Micro—Video. J. Xiangtan Univ. (Philos. Soc. Sci.) 2021, 45, 80–84. [Google Scholar] [CrossRef]
  59. Hajli, M.N.; Sims, J.; Featherman, M.; Love, P.E.D. Credibility of information in online communities. J. Strateg. Mark. 2014, 23, 238–253. [Google Scholar] [CrossRef]
  60. Song, S.; Zhang, Y.; Yu, B. Interventions to support consumer evaluation of online health information credibility: A scoping review. Int. J. Med. Inf. 2021, 145, 104321. [Google Scholar] [CrossRef]
  61. Glenski, M.; Weninger, T.; Volkova, S. Propagation From Deceptive News Sources Who Shares, How Much, How Evenly, and How Quickly? IEEE Trans. Comput. Soc. Syst. 2018, 5, 1071–1082. [Google Scholar] [CrossRef]
  62. Tian, Z.-W.; Wang, L.; Liu, C. Information Dissemination Mechanism Analysis and Model Construction of Micro-blog Based on Complex Network. Inf. Sci. 2015, 33, 15–21. [Google Scholar] [CrossRef]
  63. Denizci Guillet, B.; Mattila, A.; Gao, L. The effects of choice set size and information filtering mechanisms on online hotel booking. Int. J. Hosp. Manag. 2020, 87, 102379. [Google Scholar] [CrossRef]
  64. Woo-Young, C. Online civic participation, and political empowerment: Online media and public opinion formation in Korea. Media Cult. Soc. 2016, 27, 925–935. [Google Scholar] [CrossRef]
  65. Chen, H.; Zhao, X. Modeling and Simulation Research of Interactive Public Opinion Evolution under Multi-Agent Interventions. Processes 2022, 10, 1379. [Google Scholar] [CrossRef]
  66. You, G.; Gan, S.; Guo, H.; Dagestani, A.A. Public Opinion Spread and Guidance Strategy under COVID-19: A SIS Model Analysis. Axioms 2022, 11, 296. [Google Scholar] [CrossRef]
  67. Feng, Z. Hot news mining and public opinion guidance analysis based on sentiment computing in network social media. Pers. Ubiquitous Comput. 2018, 23, 373–381. [Google Scholar] [CrossRef]
Figure 1. Evaluation process.
Figure 1. Evaluation process.
Systems 11 00472 g001
Figure 2. Weights at different resolutions.
Figure 2. Weights at different resolutions.
Systems 11 00472 g002
Figure 3. Ranking of scenarios under different weights.
Figure 3. Ranking of scenarios under different weights.
Systems 11 00472 g003
Figure 4. Evaluation results under different values of parameter δ.
Figure 4. Evaluation results under different values of parameter δ.
Systems 11 00472 g004
Figure 5. Comparison between sub-schemes and original scheme.
Figure 5. Comparison between sub-schemes and original scheme.
Systems 11 00472 g005
Table 1. Potential Information Risk Propagation Channels.
Table 1. Potential Information Risk Propagation Channels.
ChannelsMarkContentReferences
Social media platforms E v 1 Social media platforms such as Facebook, Twitter, and Weibo have become the main channels for information dissemination. Users can spread information through various means, including posting messages, sharing links, and commenting, which may include various types of content, such as real, false, or misleading information.Wu and Yang [52]
Liu and Ma [53]
Li et al. [54]
News media E v 2 News agencies and media play a crucial role in information dissemination. They spread information through reporting, interviews, commentary, and other means. However, at times, media can also engage in inaccurate reporting, sensationalism, or biased coverage, leading to risks in information propagation.Bi and Tian [55]
Online forums and blogs E v 3 Online forums and blogs provide platforms for discussion and communication, but they also come with information dissemination risks. Users can spread information through posting threads, comments, and replies, including false information, malicious attacks, and hate speech, among other things.Wu and Yang [52]
Traditional media E v 4 Traditional media, including television, radio, newspapers, and magazines, still play a significant role in information dissemination. These media channels deliver information to the public through news reports, opinion articles, television programs, and more.Di and Mingchen [56]
Djerf-Pierre and Shehata [57]
Short video platforms E v 5 Short video platforms have become increasingly popular in recent years, providing a quick and engaging way for users to share and consume information. These platforms, such as TikTok and Instagram Reels, allow users to create and share short videos, making them a powerful tool for information dissemination. However, similar to other social media platforms, there is a risk of spreading misinformation, false content, and potentially harmful messages through short video content.Li et al. [58]
Table 2. Evaluation Indicators for Information Risk Propagation Pathways.
Table 2. Evaluation Indicators for Information Risk Propagation Pathways.
IndicatorsMarkContentReferences
Trustworthiness and reliability I n d 1 When evaluating information dissemination pathways, the primary criteria to consider are their trustworthiness and reliability. The dissemination pathways should be based on credible sources, authoritative institutions, or reliable platforms to ensure the authenticity and accuracy of the information.Hajli et al. [59]; Song et al. [60]
Dissemination speed and breadth I n d 2 In the complex public opinion environment, information dissemination tends to be rapid and extensive. When evaluating dissemination pathways, it is important to consider their speed of propagation and the breadth of their influence. Some pathways may have the ability to spread rapidly, while others may have a more significant impact within specific social circles or target audiences.Glenski et al. [61]
Tian et al. [62]
Information filtering mechanisms I n d 3 When evaluating communication channels, it is essential to consider their information filtering mechanisms. Some channels may have robust information screening and quality control mechanisms, which can reduce the dissemination of false, misleading, or harmful information. On the other hand, other channels may be relatively loose, making it easier for low-quality and inaccurate information to spread.Denizci Guillet et al. [63]
Participation and interactivity I n d 4 In complex public opinion environments, it is important to consider the level of participation and interactivity when evaluating communication channels. Some channels may actively encourage user engagement, interaction, and information sharing, thereby promoting information dissemination. On the other hand, other channels may be more passive, with information dissemination primarily controlled by media or organizations.Woo-Young [64]
Chen and Zhao [65]
Social impact and public opinion orientation I n d 5 When evaluating communication pathways, it is essential to consider their social impact and public opinion orientation. Some pathways may have a significant influence on public opinion, social emotions, and attitudes, which in turn can affect the public’s decision making and behavior. Assessing the public opinion orientation of communication pathways helps understand their impact on society.You et al. [66]
Feng [67]
Table 3. Evaluation Information for the Catering Company Regarding the Emergency Incident.
Table 3. Evaluation Information for the Catering Company Regarding the Emergency Incident.
I n d 1 I n d 2 I n d 3 I n d 4 I n d 5
E v 1 {0.8|0.2, 0.9|0.6, 0.95|0.2}{0.7|0.1, 0.8|0.4, 0.9|0.4, 0.95|0.1}{0.9|0.6, 0.95|0.4}{0.85|0.2, 0.9|0.4, 0.95|0.4}{0.8|0.1, 0.9|0.6, 0.95|0.3}
E v 2 {0.9|0.7, 0.95|0.3}{0.6|0.3, 0.7|0.4, 0.8|0.2, 0.9|0.1}{0.8|0.4, 0.85|0.4, 0.9|0.2}{ 0.8|0.1, 0.9|0.5, 0.95|0.4}{0.8|0.4, 0.9|0.4, 0.95|0.2}
E v 3 {0.8|0.2, 0.9|0.8}{0.5|0.2, 0.6|0.4, 0.7|0.4}{0.9|0.5, 0.95|0.5}{ 0.8|0.2, 0.9|0.6, 0.95|0.2}{0.7|0.1, 0.8|0.2, 0.9|0.5, 0.95|0.2}
E v 4 {0.8|0.1, 0.9|0.7, 0.95|0.2}{0.5|0.3, 0.6|0.4, 0.65|0.3}{0.7|0.2, 0.8|0.4, 0.85|0.4}{0.6|0.3, 0.7|0.5, 0.8|0.2}{0.7|0.2, 0.8|0.4, 0.9|0.4}
E v 5 {0.9|0.9, 0.95|0.1}{0.85|0.6, 0.9|0.4 }{0.9|0.2, 0.95|0.8}{0.9|0.4, 0.95|0.6}{0.85|0.1, 0.9|0.4, 0.95|0.5}
Table 4. Sums of Rows and Columns, and Objective Weights of Evaluation Indicators.
Table 4. Sums of Rows and Columns, and Objective Weights of Evaluation Indicators.
The i-th Row/Column/Indicator12345
Sums of Rows22.5117619.0775522.8453222.8520522.85653
Sums of Columns21.7870121.5702621.915522.4519622.41849
Objective Weights of Evaluation Indicators0.20110.184520.203190.205660.20553
Table 5. Comprehensive Weights for Each Evaluation Indicator.
Table 5. Comprehensive Weights for Each Evaluation Indicator.
Indicator I n d 1 I n d 2 I n d 3 I n d 4 I n d 5
The Subjective Weights0.150.30.10.250.2
The Objective Weights0.20110.184520.203190.205660.20553
The Comprehensive Weights0.152070.279070.102440.25920.20722
Table 6. The results of W C i , P W C S i , A A S i a , A A S i b , A A S i c , and E v a l u a t i o n i .
Table 6. The results of W C i , P W C S i , A A S i a , A A S i b , A A S i c , and E v a l u a t i o n i .
E v 1 E v 2 E v 3 E v 4 E v 5
W C i 1.026841.051241.062921.088741.01894
P W C S i 0.964070.934010.923450.889150.97476
A A S i a 0.200410.199840.199950.199100.20069
A A S i b 2.092002.082152.081742.068502.09628
A A S i c 0.964820.962080.962620.958510.96618
E v a l u a t i o n i 1.220581.214801.215001.206951.22321
Ranking24351
Table 7. Evaluation Results Before and After Data Change.
Table 7. Evaluation Results Before and After Data Change.
E v 1 E v 2 E v 3 E v 4 E v 5
Original Evaluation Results1.220581.214801.215001.206951.22321
Original Rankings24351
Modified Evaluation Results2.8489454.4359251.9950243.2627862.10789
Modified Ranking52341
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Luo, Z.; Xue, Y.; Su, J. Evaluating Information Risk Propagation in Complex Public Opinion Environments Based on the Improved Grey Relational Analysis—Decision Making Trial and Evaluation Laboratory Method. Systems 2023, 11, 472. https://doi.org/10.3390/systems11090472

AMA Style

Luo Z, Xue Y, Su J. Evaluating Information Risk Propagation in Complex Public Opinion Environments Based on the Improved Grey Relational Analysis—Decision Making Trial and Evaluation Laboratory Method. Systems. 2023; 11(9):472. https://doi.org/10.3390/systems11090472

Chicago/Turabian Style

Luo, Zhanyang, Yumei Xue, and Jiafu Su. 2023. "Evaluating Information Risk Propagation in Complex Public Opinion Environments Based on the Improved Grey Relational Analysis—Decision Making Trial and Evaluation Laboratory Method" Systems 11, no. 9: 472. https://doi.org/10.3390/systems11090472

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop