Next Article in Journal
How Social Support Affects Resilience in Disadvantaged Students: The Chain-Mediating Roles of School Belonging and Emotional Experience
Previous Article in Journal
Can the Cans: Determinants of Container Deposit Behavior before and after Introduction of a Container Refund Scheme
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Temporal and Spatial Analysis of Negative Emotions in China during the COVID-19 Pandemic

1
School of Sociology, Wuhan University, Wuhan 430072, China
2
School of Philosophy and Sociology, Jilin University, Changchun 130012, China
*
Author to whom correspondence should be addressed.
Behav. Sci. 2024, 14(2), 113; https://doi.org/10.3390/bs14020113
Submission received: 15 December 2023 / Revised: 28 January 2024 / Accepted: 31 January 2024 / Published: 3 February 2024

Abstract

:
This research aims to explore the spatiotemporal distribution patterns of negative emotions in mainland China during different stages of the COVID-19 pandemic and the external factors influencing this clustering. Using Baidu Index data for 91 negative emotion keywords, a retrospective geographic analysis was conducted across Chinese provinces from 14 October 2019 to 7 July 2022. Four spatial analysis methods (Global Moran’s Index, Local Moran’s Index, Bivariate Global Moran’s Index, and Bivariate Local Moran’s Index) are employed to identify potential clustering patterns and influencing factors of negative emotions at different stages. The results indicate that the COVID-19 pandemic significantly intensified the clustering effect of negative emotions in China, particularly with a more pronounced radiation effect in northwestern provinces. Spatial positive correlations are observed between pandemic-related Baidu indices (pandemic Baidu index, government Baidu index, nucleic acid Baidu index) and negative emotions. These findings contribute to understanding the spatiotemporal distribution characteristics of negative emotions in China post the COVID-19 outbreak and can guide the allocation of psychological resources during emergencies, thereby promoting social stability.

1. Introduction

The COVID-19 pandemic is an unprecedented catastrophe that has not only profoundly altered the human way of life but has also exacerbated negative emotions among people [1]. Since the outbreak of the pandemic, depression, boredom, anger, anxiety, and panic have become prevalent negative emotions [2,3,4]. A national survey in China revealed that during the outbreak of the COVID-19 pandemic, 27.9% of the survey participants reported symptoms of depression, and 31.6% exhibited symptoms of anxiety, significantly surpassing the pre-pandemic survey data [5]. Compared to positive emotions, negative emotions exhibit a strong contagion and are prone to forming spatial clusters within a short period [6]. In other words, the level of negative emotions in certain areas becomes significantly higher than in others [7], resulting in more severe collective negative emotional issues [8].
There are significant differences in medical conditions and economic levels across China, so there are also large differences in the spatiotemporal distribution of negative emotions [9,10]. In the early stages of the pandemic, Xu found that individuals located far from Wuhan were more susceptible to related information and felt frightened than residents in the epicenter [11]. Meanwhile, during the mid-term of the pandemic, Deng et al. suggested that strict physical measures, such as enforcing social distancing and home isolation, could reduce offline communication, thereby increasing anxiety and depression [12]. Regions repeatedly affected by the pandemic tend to develop higher resilience against rumors, displaying lower levels of negative emotions [13,14]. However, in non-affected areas, the uncertainty about the future often amplifies concerns about becoming the “next infected person” [15]. Negative emotions may generate a “spillover” effect, further influencing the emotional state of surrounding areas [16]. Individuals may undergo brief emotional reactions in crises, but social emotions are more complex. The accumulation of these momentary emotions over time can give rise to more enduring social and emotional trends [7], especially in prolonged crises where emotional shifts may span multiple stages—from initial shock to gradual adaptation [17]. This complexity requires a longer timeframe for comprehension. Therefore, targeted research on social negative emotions in different temporal and spatial contexts is necessary to better comprehend the dynamic changes in societal emotion. Despite existing research focusing on relatively short time frames, for instance, Ning et al. examined risk perception and negative emotions among Chinese residents from 14 January to 22 February 2020 using online questionnaires [18]. Rossell measured changes in negative emotions among Australian adults from April 1 to 4 April 2020, using social media data [13]. Given the prolonged duration of the COVID-19 pandemic and its enduring impact on human society, we emphasize the need to introduce a longer time frame for a more comprehensive understanding of the evolving societal emotional trends. This exploration not only aids in a deeper understanding of long-term societal adaptation to emergencies but also provides substantial guidance for future psychological health interventions and policy formulations.
Research indicates that the pandemic has brought significant uncertainty to society, encompassing uncertainties in the development trends of the outbreak [19], individual health status [20], and the effectiveness of government policies [21]. According to the Uncertainty Theory, uncertainty serves as a crucial cognitive mechanism that triggers alertness and negative emotions [20,22]. To reduce the sense of uncertainty, individuals tend to seek more information when faced with unknown situations [23]. However, the process of information acquisition and perception may amplify individual risk perception, subsequently increasing negative emotions [24]; therefore, some scholars advocate for heightened attention to infodemic [25]. People’s attention to the pandemic includes two types of information: information about the pandemic itself (including the virus’s transmission trends) and information about how to deal with the pandemic (encompassing government prevention policies and information about nucleic acid testing) [26]. Nevertheless, delays, inconsistencies, and falsehoods in relevant information often aggravate a sense of uncertainty and negative emotions. Firstly, pandemic information updates rapidly, but the accuracy and consistency of that information are not always guaranteed, which often includes unverified data, outdated advice, or direct misinformation [27]. Consequently, this contributes to an increase in anxiety and panic [28]. Secondly, due to the highly dynamic nature of the pandemic, people need timely responses from the government. This implies that policies may undergo frequent changes, even to the extent of being inconsistent. Thus, even when based on the latest authoritative information, it may lead to public feelings of uncertainty and unease [18]. Thirdly, public nucleic acid testing is a crucial tool to determine whether individuals have contracted COVID-19, and the results directly impact personal daily life [29]. Nucleic acid tests are widely used to detect the presence of the virus in individuals. The testing helps identify both symptomatic and asymptomatic cases, allowing for timely isolation and treatment. Once a positive nucleic acid result is detected, individuals and their respective locations may face stricter lockdown measures and stigmatization, leading to more severe negative emotions [30]. Research has indicated the impact of information on the pandemic, government, and nucleic acid tests on negative emotions. However, whether these influences vary across different regions and time periods remains unconfirmed. To fill this gap, we will explore the relationship between external information and negative emotions from a temporal and spatial perspective.
In China, Baidu is the most popular search tool, with over 795 million users, and the user penetration rate of Baidu searches exceeds 90% [31]. Baidu Index is a systematic data-sharing platform based on the Baidu search engine, providing a vast amount of search behavior data. Through the Baidu Index, one can obtain the frequency of user attention to a specific keyword within a specific time period [32]. During the pandemic, due to the unknown nature of the virus and social isolation, people chose to search for relevant information on Baidu and expressed their emotions by asking questions to the search engine, such as “How to deal with anxiety caused by COVID-19?” A higher Baidu index for related keywords indicates a higher level of public attention to a particular event. An increasing number of scholars are using the Baidu Index to study social emotions [33,34], especially negative emotions during the COVID-19 pandemic [31,35,36].
In this study, we use the Baidu Index to obtain data on negative emotions. Specifically, the research conducts a phased analysis of the Baidu index for negative emotions among Chinese internet users using Moran’s Index. Global and Local Moran’s Index are adopted to assess the spatial autocorrelation of negative emotions. Additionally, we utilize Bivariate Moran’s Index to analyze the spatial relationships between negative emotions and influencing factors such as the pandemic Baidu index, government Baidu index, and nucleic acid Baidu index. This approach provides valuable insights for future preparedness in similar health crises, contributing to the maintenance of long-term psychological well-being for individuals and society. Accurately identifying the distribution characteristics of negative emotions is crucial for a deeper understanding of the changing trends in people’s emotions during crisis events and society’s response to disasters. Furthermore, this research can effectively guide the allocation of psychological resources, ensuring timely and targeted support in different regions and periods and meeting future mental health needs.
The specific research questions of our research are as follows:
Q1: During the COVID-19 pandemic, is there spatial clustering of negative emotions at different stages?
Q2: During the COVID-19 pandemic, is there a spatial radiation effect of negative emotions across different provinces?
Q3: During the COVID-19 pandemic, is there a spatial correlation between external factors (such as pandemic information, government information, and nucleic acid testing information) and negative emotions at different stages?

2. Materials and Methods

2.1. Data Source

This study is a retrospective spatiotemporal analysis of negative emotions in 31 provinces, municipalities, and autonomous regions in mainland China. We obtained provincial Baidu indices of 91 negative emotion keywords and 18 influencing factor keywords from the Baidu Index platform. The reliability of the keywords was assessed by seven individuals, including five doctoral students in social psychology and two experts in social psychology, with a reliability score of 0.856. The data collection period for Baidu Index spans from 14 October 2019 to 7 July 2022.
To ensure the scholarly and everyday applicability of our word selection, this study consulted established emotion vocabularies and widely recognized psychological scales known for their authority and reliability. Furthermore, we maximized the functionality of Baidu Index’s knowledge graph, supplementing it with commonly used daily expressions to ensure our word choices strike a balance between academic precision and alignment with daily language (such 52 hertz means lonely). We first identify 10 categories of emotions by the emotional ontology library of Dalian University of Technology [37], the Chinese version of Self-Rating Anxiety Scale [38], the Chinese version of the Self-rating Depression Scale [39], and the Chinese version of the Kessler Psychological Distress Scale [40], then supplement with specific emotional vocabulary by Baidu Index’s knowledge graph. In the end, 91 keywords were selected (relevant keywords are shown in Appendix A).
Similarly, we have referenced the existing literature and utilized Baidu Knowledge Graph technology to enhance the dictionary of influencing factors [10,35,41]: government, pandemic, and nucleic acid (relevant keywords are provided in Appendix B).

2.2. Data Processing

2.2.1. Standardization and Time-Slice Processing

Due to significant differences in population among provinces, we standardized the data by dividing it by the number of Baidu users in each province. We take 20 January 2020 as a crucial time point when the Chinese official media officially announced the occurrence of “human-to-human transmission” of the novel coronavirus and implemented a series of emergency measures. Therefore, this study uses 20 January 2020 as a time division point, labeling data before this date as “pre-pandemic” and after this date as “post-pandemic” to contrast and analyze the emotional impact of the novel coronavirus on Chinese society.
To identify whether there are phased differences in the sentiment of netizens “post-pandemic”, we perform time-slice processing with a division standard of 180 days. Currently, there is no standardized analysis time window for the spatiotemporal analysis of negative societal emotions. In this study, we choose a 180-day timeframe for the following reasons: Firstly, unlike past sudden events such as heavy rain or typhoons, the COVID-19 pandemic has persisted for several years, indicating a more prolonged impact on society. By opting for a longer timeframe, we aim to gain a more comprehensive understanding of the long-term trends and adaptation processes of societal emotions. Secondly, varying regions exhibit significant differences in the development trends of the pandemic. Additionally, the pandemic situation is not the sole factor influencing negative emotions [42]. Utilizing a 180-day timeframe enables us to capture long-term emotional trends in different regions and better account for other variables that may impact societal emotions, such as external information influences. This approach contributes to establishing a more comprehensive analytical framework to explain the spatiotemporal variations in societal emotions across different regions.
Thus, we categorized the “post-pandemic” data into five stages: the first stage from 20 January 2020 to 16 July 2020; the second stage from 17 July 2020 to 13 January 2021; the third stage from 14 January 2021 to 12 July 2021; the fourth stage from 13 July 2021 to 8 January 2022; and the fifth stage from 9 January 2022 to 7 July 2022.

2.2.2. Moran’s Index Analysis

To identify spatial clustering patterns of negative emotions, we employed a series of spatial statistical methods, including Global Moran’s Index, Local Moran’s Index, Bivariate Global Moran’s Index, and Bivariate Local Moran’s Index.
Firstly, we used the Global Moran’s Index to assess the overall spatial autocorrelation of negative emotions. The index typically ranges between −1 and 1, with values below 0 indicating spatial dispersion, values above 0 suggesting spatial clustering, and values close to 0 implying an essentially random spatial distribution.
Next, through the Local Moran’s Index, we conducted an analysis of the spatial local clustering patterns of negative emotions in each specific province. This analysis is typically represented in a visual format. The Local Moran index not only allows for local clustering analysis but also includes outlier detection. It is noteworthy that when the Local Moran’s Index of a province is significantly greater than 0, and its intensity of negative emotions is consistent with surrounding provinces, it can be defined as “high-high” adjacent. Conversely, if it is a low value and surrounded by other low-value provinces, it is defined as “low-low” adjacent; a high-value province surrounded by low-value provinces is “high-low” adjacent, while a low-value province surrounded by high-value provinces is “low-high” adjacent. If the local Moran index is less than 0, it usually indicates that the spatial distribution of negative emotions in that area has spatial heterogeneity or an atypical pattern.
Finally, we employ the Bivariate Global Moran’s Index and Bivariate Local Moran’s Index to explore the spatial correlation between negative emotions and their influencing factors. The Bivariate Moran’s Index incorporates independent variables into the Moran’s Index. When the Bivariate Global Moran’s Index is positive, it indicates a spatial positive correlation between the two variables; conversely, it suggests a negative correlation when the index is negative. In the Bivariate Local Moran’s Index, “high-high” adjacent means both variables are above the mean and exhibit positive correlation in a certain area, while “low-low” adjacent signifies the opposite. “high-low” adjacent implies that the independent variable is above the mean, the dependent variable is above the mean, and they exhibit spatial negative correlation, whereas “low-high” adjacent indicates the opposite.
The Global Moran’s Index is calculated as follows:
G l o b a l M o r a n s   I = i = 1 n j = 1 n w i j x i x ¯ x j x ¯ S 2 i = 1 n j = 1 n w i j
In Formula (1) x i is the emotions index value of i province, x ¯ is the mean value of the emotion index value of 31 provinces, S 2 is the variance of the emotion index value, w i j is the spatial matrix (we choose the most commonly used adjacent spatial weight matrix).
The Local Moran’s Index is calculated as follows:
L o c a l M o r a n s   I = ( x i x ¯ ) S 2 j i n w i j ( x j x ¯ )
The Bivariate Global Moran’s Index is calculated as follows:
B - G l o b a l M o r a n s   I = i = 1 n j = 1 n w i j ( x i x ¯ ) ( y j y ¯ ) S 2 i = 1 n j = 1 n w i j
In Formula (3) x i is the independent variable, x ¯ is the mean of the independent variable, y j is the dependent variable, y ¯ is the mean of the dependent variable, and S 2 is the variance of all samples.
The Bivariate Local Moran’s Index is calculated as follows:
B - L o c a l M o r a n s   I = z i j = 1 n w i j z j
In Formula (4), z i and z j represent the standardized values of the independent and dependent variables, respectively.

3. Results

3.1. The Spatial Clustering of the Negative Emotion Index at Each Stage

We analyzed the spatial autocorrelation of ten negative emotions across different provinces in China before and after the COVID-19 pandemic and aggregated these emotions to form the Total Negative Emotions (TNE). The results are shown in Table 1.
Before the pandemic, the Global Moran’s index of TNE did not exhibit significant spatial clustering effects. However, under the influence of the pandemic, four out of five stages show significant spatial clustering of TNE, with index values ranging from 0.150 to 0.183. This confirms the spatial clustering of negative emotions in China caused by the COVID-19 pandemic. This clustering is not random but influenced by the proximity of neighboring provinces. For each stage, in the first stage, all ten emotions show significant clustering effects, with “disappointment” (the Global Moran’s index is 0.257) being the most pronounced. In the second stage, the clustering effects of most emotions are further strengthened, except for “sadness”, “disappointment”, and “confusion”, which show weakened effects. In the third stage, only the Global Moran’s index of “disappointment” increases, and other emotions’ indexes decline. In the fourth stage, the clustering effect of TNE is not pronounced, but some emotions still maintain significant levels, such as “sadness”, “loneliness”, “fear”, “disappointment”, and “disgust”. Finally, in the fifth stage, the clustering effect of TNE remains significant, and the Global Moran’s indices of “anxiousness” and “depression” reach their peak.
The Global Moran’s index confirms the clustering effect of negative emotions brought about by the COVID-19 pandemic on Chinese society. It indicates that the closer the geographical locations of different provinces in China, the more closely aligned their levels of negative emotions. The levels of clustering for various negative emotions generally range from 0.088 to 0.257. In the early stage of the pandemic, the clustering effect mainly reflects disappointment, while in the fifth phase, it mainly manifests as anxiousness. Disappointment is more directed towards external factors [43], expecting changes in the external environment and distancing from sources of stress that trigger negative emotions [44]. On the other hand, anxiousness is directed towards oneself, as people are unable to take effective measures to cope with the crisis, leading to a sense of withdrawal [45]. As the pandemic progresses, people gradually realize that the novel coronavirus cannot be eliminated in the short term. Although the virus’s impact shifts from a threat to life to a threat to survival, the cumulative economic damage and psychological torment increasingly result in spatially clustered forms of anxiousness.

3.2. Radiation Effect of Negative Emotions

The Local Moran’s index maps of different stages of TNE drawn by ArcGIS 10.7 are shown in Figure 1. Overall, the emotional clustering in various provinces is mainly characterized by low-low adjacent and high-high adjacent. The southeastern regions of China consistently remain in a state of low-low adjacent, while the northwestern regions fall into the category of high-high adjacent. Xinjiang has the highest occurrence of high-high adjacent among provinces, persisting from the first stage to the fifth stage. Following Xinjiang are Tibet and Qinghai, which exhibit high-high adjacent in the first and third stages, respectively. These three provinces are in the remote northwest of China, with lower levels of economic development and internet penetration. Despite this, negative emotions in these areas surpass the national average, and they exert a positive radiative effect on neighboring provinces.
In contrast, provinces in the east, such as Anhui, and southern provinces, like Jiangxi and Guangxi, consistently show a pattern of low-low clustering in the distribution of negative emotions. This implies that the negative emotions in these three provinces consistently remain at a lower level and exert a negative radiative effect on neighboring provinces. Other provinces exhibiting low-low adjacent, such as Shandong and Guizhou, are also situated in the eastern or southern parts of China.
It is worth noting that Gansu Province is also located in the northwest region, but negative emotions exhibit a low-high clustering phenomenon. Specifically, the negative emotions in Gansu Province are lower than those in the neighboring Xinjiang and Qinghai provinces. Scholars have offered explanations for this phenomenon. Compared to Xinjiang and Qinghai, the capital of Gansu Province is geographically closer to the first epicenter of the pandemic, Wuhan, and is more likely to be influenced by authoritative news. This proximity allows for the acquisition of information, enabling a positive attitude towards future events [45]. Although emotions fluctuate, they generally remain at a positive level. The lowest frequency of occurrence is the high-low clustering type, which is only observed in the second stage in Chongqing. Based on this observation, we referenced the findings of Wang and Tang, indicating a significant correlation between heightened negative emotions in Chongqing compared to other regions and the unemployment rate [46]. As China’s newest directly administered municipality, Chongqing’s economy relies on the tertiary industry. The pandemic has led to substantial fluctuations in the unemployment rate, particularly impacting the tertiary sector. According to the China Statistical Yearbook, Chongqing had a pre-pandemic unemployment rate of 2.62%, notably lower than that of surrounding areas. However, with the pandemic’s onset, the unemployment rate spiked to 4.49%, the highest in the southwestern region. Post-2021, the unemployment rate gradually returned to pre-pandemic levels. The unemployment rate’s fluctuation aligns with the corresponding trend in the accumulation of negative emotions, revealing a highly negative correlation (detailed unemployment rate data in Appendix C).

3.3. Spatial Correlation Analysis of Factors Influencing Negative Emotions

Table 2 reveals the dynamic relationship between public negative emotions and three factors: the Government Baidu Index (GBI), the Nucleic Acid Baidu Index (NABI), and the Pandemic Baidu Index (PBI).
Firstly, the Bivariate Global Moran’s index coefficients of GBI and TNE is not significant before the pandemic. However, during Phases II, III, and IV of the pandemic, these coefficients exhibit spatial significance.
Similarly, NABI and TNE exhibit significant correlations in Phases I, III, and IV of the pandemic, with correlation coefficients consistently exceeding 0.2.
Furthermore, for PBI and TNE, the Bivariate Global Moran’s index coefficients are significant in all pandemic phases except the first, which also shows a fluctuating upward trend in correlation coefficients.
Table 2’s results indicate the varied influence of information factors on social negative emotions across different pandemic stages. Figure 2, Figure 3 and Figure 4 visually illustrate these relationships across provinces, providing a clearer understanding of the intricate dynamics.

3.3.1. The Spatial Correlation Analysis between the GBI and the TNE

The Bivariate Local Moran’s Index maps of GBI and TNE are shown in Figure 2. This correlation is mainly characterized by the low-low adjacent of low GBI and low TNE and the high-high adjacent of high GBI and high TNE. The high-low adjacent of high GBI and low TNE and the low-high adjacent of low GBI and high TNE are concentrated in the western region.
For specific provinces, the eastern and southern provinces show lower levels of government attention in all three phases. However, the northwestern provinces exhibit higher government attention during the third and fifth phases compared to other provinces. GBI is derived from Baidu users actively searching for government-related keywords. From a psychological perspective, external risks reduce people’s confidence in their preferences and choices, making them more likely to trust external actors (government). Consequently, the negative emotions caused by the pandemic increase people’s attention to the government [47]. Therefore, provinces with higher levels of negative emotions, such as Xinjiang, Qinghai, and Tibet, are likely to increase searches for government information.

3.3.2. Spatial Correlation Analysis between NABI and TNE

The Bivariate Local Moran’s Index maps of NABI and TNE are shown in Figure 3. Nucleic acid testing is widely used in China to determine whether individuals are infected with the novel coronavirus. However, the recurrent nature of the COVID-19 pandemic has led to frequent nucleic acid testing, resulting in changing emotional attitudes among Chinese residents towards these tests.
Examining the specific geographical distribution, southeastern provinces still exhibit a low-low clustering of both low NABI and low TNE. In the northwest region, there are significant spatial variations in correlation patterns. For instance, Xinjiang province transitions from a high NABI and high TNE in the second and fifth stages to a low NABI and high TNE in the third and fourth stages. This phenomenon may be related to the local epidemic situation in Xinjiang. It is observed that when Xinjiang province is at a low-risk level (cumulative confirmed cases ranging from 20 to 199), there is increased attention to nucleic acid information. However, during periods of extremely low risk (cumulative confirmed cases fewer than 19), there is less search activity related to nucleic acid information [11].

3.3.3. Spatial Correlation Analysis of the PBI and TNE

The Bivariate Local Moran’s Index maps of PBI and TNE are shown in Figure 4. The correlation coefficients show minimal variations across different stages. The predominant clusters include the LL type (low PBI-low TNE), LH type (low PBI-high TNE), and HH type (high PBI-high TNE). Like the spatial distribution of other influencing factors, LL is mainly distributed in the eastern and southern provinces of China, such as Shandong, Anhui, Jiangxi, Hunan, Guangxi, and Guizhou. HH is primarily concentrated in Xinjiang and Tibet, while LH is distributed in Gansu and Qinghai. There is significant regional variation in the Baidu index related to COVID-19 in the northwest region, with higher indices in Xinjiang and Tibet and lower indices in Gansu and Qinghai. By the fifth stage, a high COVID-19 search index is only present in Xinjiang, possibly due to its proximity to multiple countries and increased susceptibility to imported cases [48].

4. Conclusions and Discussion

Unlike natural disasters, the impact of the COVID-19 pandemic on individuals is more covert. Beyond physical health, the negative effects on people’s mental and emotional well-being deserve greater attention. Exploring the patterns of negative emotional changes in the context of the pandemic can assist health policymakers in adopting more targeted approaches to address potential future issues. This study utilizes the Baidu Index to construct a Chinese Negative Emotion index, analyzing the negative emotional impact of the COVID-19 pandemic on Chinese society to identify spatial clusters of negative emotions at different stages. The study finds a prolonged clustering of negative emotions in Chinese society following the outbreak of the COVID-19 pandemic. The eastern and southern provinces predominantly exhibit low clustering of negative emotions, while the northwestern provinces show high clustering. Before the outbreak, the four phases reflected a clustering effect directed outward in the form of disappointment. In the fifth stage, the clustering effect of anxiousness becomes more apparent. Additionally, the study observes positive spatial correlations between the government Baidu index, nucleic acid Baidu index, pandemic Baidu index, and negative emotions at different stages.
This research emphasizes the evolution of social emotions, using the Baidu Index to comprehensively understand the temporal patterns of negative emotions in major provinces of mainland China. Notably, the southeastern provinces consistently maintained lower levels of negative emotions since the outbreak, while the northwestern provinces, especially Xinjiang, exhibit emotions consistently higher than the national average. In addressing Xinjiang’s unique circumstances, four possible explanations are considered: its unique geographical location, lower GDP, limited economic and medical resources, and the prolonged lockdown leading to a surge in residents’ negative emotions. Among various influencing factors, the study finds that the high levels of negative emotions in the early stages were related to the search volume for pandemic-related topics. However, as the pandemic progressed, the spatial correlation between negative emotions and search volumes for government, nucleic acid, and pandemic information strengthened, especially in remote northwest regions. This suggests that policymakers should provide more information support to alleviate the high levels of negative emotions in northwestern provinces.

5. Limitations and Policy Suggestions

The study has limitations, primarily in the choice of data. Provincial-level data are analyzed instead of more detailed city-level or administrative unit data. While provincial data provide an overview of emotional differences, analyzing data at the city or lower administrative levels could offer more nuanced insights for future research. Baidu Index is used to construct the negative emotion index, and though it covers most words, there might be some newly coined terms not included, potentially limiting the analysis. Additionally, there is controversy about the classification of pandemic stages. We adopt a 180-day time slice in this study, which might result in some information being overlooked. Future research could explore alternative time frames. Finally, due to the gender analysis feature of the Baidu Index being available only for keywords with large search volumes, this study does not account for gender-related factors. However, there may be differences in negative emotions experienced by different genders during the pandemic. Future research could explore incorporating gender disparities into consideration.
Based on our research findings, we propose the following three policy suggestions: Firstly, the government should address social negative emotions at different stages, focusing on public disappointment in the early stage of the pandemic and shifting attention to interventions for anxiousness later. Secondly, we suggest strengthening mental health services in remote western areas, accompanied by additional government information support (such as medical information and policy information), to effectively tackle persistent emotional challenges. Lastly, in the face of unforeseen events, ensure transparency and timely communication of information and enhance online management to combat misinformation. These policy recommendations aim to better address societal emotional needs across different stages and regions.

Author Contributions

Conceptualization, Y.D. and L.W.; methodology, Y.D.; software, Y.D.; validation, L.W. and Z.P.; formal analysis, Y.D.; resources, B.L.; writing—original draft preparation, Y.D.; writing—review and editing, L.W., Z.P. and B.L.; funding acquisition, L.W. and B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Research scholars interested in working with the data used in this study are asked to contact the corresponding author with a short description of the planned study. According to our data-sharing policies, we then require (1) a data management plan, (2) a signed data-sharing and confidentiality agreement, and (3) ethical clearance from an institutional Ethics Committee.

Acknowledgments

We would like to express our gratitude to Baidu Index for providing the data used in this study.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

Table A1. Negative emotions words dictionary.
Table A1. Negative emotions words dictionary.
CategoriesEmotionsWords
1SadnessSadness, Sorrow, Grief, Unhappiness, Melancholy, Heartache, Pain, Mourning,
Gloominess, Dejection, Despondency [37]
2AngerAnger, Rage, Fury, Indignation, Resentment, Exasperation, Wrath, Ire [37]
3LonelyLoneliness, Solitude, Isolation, Lonesomeness, Autism, Solitary,
Misunderstood, Desolate, 52 Hertz, Alone [37]
4FearFear, Anxiety, Confusion, Nervousness, Terror, Panic, Worry, Unease, Dread [37]
5AnxiousnessAnxiety, Heartburn, Anxiety, Hair Loss, Anxiety Disorder, Distress, Irritation,
Restlessness, Agitation, Vexation, Haggard, Distress, Headache, Very Annoyed [38]
6DisappointmentDisappointment, Disillusionment, Despair, Frustration, Hopelessness, Defeated [37]
7DisgustDisgust, Dislike, Hatred, Loathing, Resentment [37]
8HelplessnessHelplessness, Wry Smile, Heartbreak, Powerlessness, Speechless, At A Loss,
Bewildered, Powerless [37]
9DepressionDepression, Melancholy, Depression, Insomnia [36,39]
10ConfusionDoubt, skepticism, Perplexity, Confusion, Bewilderment, Uncertainty,
Ignorance, What, Where, How, What Is, How About
Curiosity, Wonder, Confusion, Puzzlement, Strange [37]

Appendix B

Table A2. Influencing factors words dictionary.
Table A2. Influencing factors words dictionary.
CategoriesInfluencing FactorsWords
1GovernmentGovernment, Department, Ministry of Health, Health Bureau, National Health and Family Planning Commission, National Health Commission, Ministry of Health of the People’s Republic of China [41]
2PandemicCOVID-19, Virus, COVID-19 Pandemic, Epidemic, COVID, Novel Coronavirus, Pneumonia, Novel Pneumonia, Novel Coronavirus Pneumonia [35]
3Nucleic AcidNucleic Acid, Nucleic Acid Testing [10]

Appendix C

Table A3. Unemployment rate of Chongqing, Sichuan, Hubei, Hunan, Guizhou, and Shaanxi.
Table A3. Unemployment rate of Chongqing, Sichuan, Hubei, Hunan, Guizhou, and Shaanxi.
YearProvincesUnemployment Rate (%)Sources
2019Chongqing2.62The China Statistical Yearbook of 2020
https://www.stats.gov.cn/sj/ndsj/2020/indexch.htm (accessed on 15 December 2023)
Sichuan3.31
Hubei2.24
Hunan2.73
Guizhou3.11
Shaanxi3.23
2020Chongqing4.49The China Statistical Yearbook of 2021
https://www.stats.gov.cn/sj/ndsj/2021/indexch.htm (accessed on 15 December 2023)
Sichuan3.63
Hubei3.35
Hunan2.74
Guizhou 3.75
Shaanxi3.63
2021Chongqing2.92The China Statistical Yearbook of 2022
https://www.stats.gov.cn/sj/ndsj/2022/indexch.htm (accessed on 15 December 2023)
Sichuan3.6
Hubei2.99
Hunan2.29
Guizhou4.45
Shaanxi3.47

References

  1. Xiong, J.; Lipsitz, O.; Nasri, F.; Lui, L.M.W.; Gill, H.; Phan, L.; Chen-Li, D.; Iacobucci, M.; Ho, R.; Majeed, A.; et al. Impact of COVID-19 Pandemic on Mental Health in the General Population: A Systematic Review. J. Affect. Disord. 2020, 277, 55–64. [Google Scholar] [CrossRef]
  2. Donizzetti, A.R. The Relationship between Physical Activity and Psychosocial Well-Being during and after COVID-19 Lockdown. Behav. Sci. 2023, 13, 986. [Google Scholar] [CrossRef]
  3. Giusti, L.; Mammarella, S.; Del Vecchio, S.; Salza, A.; Casacchia, M.; Roncone, R. Deepening Depression in Women Balancing Work–Life Responsibilities and Caregiving during the COVID-19 Pandemic: Findings from Gender-Specific Face-to-Face Street Interviews Conducted in Italy. Behav. Sci. 2023, 13, 892. [Google Scholar] [CrossRef]
  4. Tillman, G.; March, E.; Lavender, A.P.; Braund, T.A.; Mesagno, C. Disordered Social Media Use during COVID-19 Predicts Perceived Stress and Depression through Indirect Effects via Fear of COVID-19. Behav. Sci. 2023, 13, 698. [Google Scholar] [CrossRef]
  5. Wang, S.; Zhang, Y.; Guan, Y.; Ding, W.; Meng, Y.; Hu, H.; Liu, Z.; Zeng, X.; Wang, M. A Nationwide Evalua-tion of the Prevalence of and Risk Factors Associated with Anxiety, Depression and Insomnia Symptoms during the Return-to-Work Period of Coronavirus Disease 2019 in China. Soc. Psychiatry Psychiatr. Epidemiol. 2021, 56, 2275–2286. [Google Scholar] [CrossRef]
  6. Hoang, C. Negative Emotions and Coping Behaviors of Passenger in the Airline Industry, Vietnam. J. Asian Financ. Econ. Bus. 2020, 7, 865–874. [Google Scholar] [CrossRef]
  7. Dai, D.; Wang, R. Space-Time Surveillance of Negative Emotions after Consecutive Terrorist Attacks in London. Int. J. Environ. Res. Public Health 2020, 17, 4000. [Google Scholar] [CrossRef]
  8. Israelashvili, J. More Positive Emotions During the COVID-19 Pandemic Are Associated with Better Resilience, Especially for Those Experiencing More Negative Emotions. Front. Psychol. 2021, 12, 648112. [Google Scholar] [CrossRef]
  9. Ho, C.S.; Chee, C.Y.; Ho, R.C. Mental Health Strategies to Combat the Psychological Impact of COVID-19 Beyond Paranoia and Panic. Ann. Acad. Med. Singapore 2020, 49, 1–3. [Google Scholar]
  10. Ruan, Y.; Huang, T.; Zhou, W.; Zhu, J.; Liang, Q.; Zhong, L.; Tang, X.; Liu, L.; Chen, S.; Xie, Y. The Lead Time and Geographical Variations of Baidu Search Index in the Early Warning of COVID-19. Sci. Rep. 2023, 13, 14705. [Google Scholar] [CrossRef]
  11. Mingxing, X.; Rui, Z.; Lilin, R.A.O.; Yi, K.; Shuwen, Y.; Yang, D.; Jianglong, L.I.; Shu, L.I. Suggestions on properly coping with the “psychological typhoon eye effect” in the current COVID-19 epidemic. Proc. Chin. Acad. Sci. USA 2020, 35, 273–282. [Google Scholar]
  12. Deng, S.; Wang, W.; Xie, P.; Chao, Y.; Zhu, J. Perceived Severity of COVID-19 and Post-Pandemic Consumption Willingness: The Roles of Boredom and Sensation-Seeking. Front. Psychol. 2020, 11, 567784. [Google Scholar] [CrossRef] [PubMed]
  13. Rossell, S.L.; Neill, E.; Phillipou, A.; Tan, E.J.; Toh, W.L.; Van Rheenen, T.E.; Meyer, D. An Overview of Current Mental Health in the General Population of Australia during the COVID-19 Pandemic: Results from the COLLATE Project. Psychiatry Res. 2021, 296, 113660. [Google Scholar] [CrossRef] [PubMed]
  14. Henderson, A.S.; Montgomery, I.M.; Williams, C.L. PSYCHOLOGICAL IMMUNISATION: A Proposal for Preventive Psychiatry. Lancet 1972, 299, 1111–1113. [Google Scholar] [CrossRef] [PubMed]
  15. Gao, H.; Chen, X.; Zou, Y. Bull’s Eye or Typhoon Eye? Psychological Distress and Associated Factors in Wuhan and Surrounding Areas during the COVID-19 Pandemic. Glob. Ment. Health 2022, 9, 193–201. [Google Scholar] [CrossRef] [PubMed]
  16. Morality and Media in the 21st Century—A Panel in Celebration of the Work of Professor Roger Silverstone—LSE Research Online. Available online: https://eprints.lse.ac.uk/21507/ (accessed on 13 December 2023).
  17. Besser, A.; Flett, G.L.; Nepon, T.; Zeigler-Hill, V. Personality, Cognition, and Adaptability to the COVID-19 Pandemic: Associations with Loneliness, Distress, and Positive and Negative Mood States. Int. J. Ment. Health Addict. 2022, 20, 971–995. [Google Scholar] [CrossRef] [PubMed]
  18. Ning, L.; Niu, J.; Bi, X.; Yang, C.; Liu, Z.; Wu, Q.; Ning, N.; Liang, L.; Liu, A.; Hao, Y.; et al. The Impacts of Knowledge, Risk Perception, Emotion and Information on Citizens’ Protective Behaviors during the Outbreak of COVID-19: A Cross-Sectional Study in China. BMC Public Health 2020, 20, 1751. [Google Scholar] [CrossRef] [PubMed]
  19. Han, P.K.J.; Scharnetzki, E.; Scherer, A.M.; Thorpe, A.; Lary, C.; Waterston, L.B.; Fagerlin, A.; Dieckmann, N.F. Communicating Scientific Uncertainty About the COVID-19 Pandemic: Online Experimental Study of an Uncertainty-Normalizing Strategy. J. Med. Internet Res. 2021, 23, e27832. [Google Scholar] [CrossRef]
  20. Wang, F.; Pan, F.; Tang, Y.-Y.; Huang, J.H. Editorial: Uncertainty Induced Emotional Disorders during the COVID-19. Front. Psychol. 2022, 13, 943966. [Google Scholar] [CrossRef]
  21. Oldeweme, A.; Märtins, J.; Westmattelmann, D.; Schewe, G. The Role of Transparency, Trust, and Social Influence on Uncertainty Reduction in Times of Pandemics: Empirical Study on the Adoption of COVID-19 Tracing Apps. J. Med. Internet Res. 2021, 23, e25893. [Google Scholar] [CrossRef]
  22. Afifi, W.A.; Afifi, T.D. Uncertainty and Coping during COVID-19. In Communicating COVID-19: Interdisciplinary Perspectives; Lewis, M., Govender, E., Holland, K., Eds.; Springer International Publishing: Cham, Switzerland, 2021; pp. 325–344. ISBN 978-3-030-79735-5. [Google Scholar]
  23. Kramer, M.W. Motivation to Reduce Uncertainty: A Reconceptualization of Uncertainty Reduction Theory. Manag. Commun. Q. 1999, 13, 305–316. [Google Scholar] [CrossRef]
  24. Dillard, J.P.; Yang, C.; Huang, Y. Feeling COVID-19: Intensity, Clusters, and Correlates of Emotional Responses to the Pandemic. J. Risk Res. 2022, 25, 1288–1305. [Google Scholar] [CrossRef]
  25. Zarocostas, J. How to Fight an Infodemic. Lancet 2020, 395, 676. [Google Scholar] [CrossRef]
  26. Mourad, A.; Srour, A.; Harmanani, H.; Jenainati, C.; Arafeh, M. Critical Impact of Social Networks Infodemic on Defeating Coronavirus COVID-19 Pandemic: Twitter-Based Study and Research Directions. IEEE Trans. Netw. Serv. Manag. 2020, 17, 2145–2155. [Google Scholar] [CrossRef]
  27. Liu, J.C.J.; Tong, E.M.W. The Relation Between Official WhatsApp-Distributed COVID-19 News Exposure and Psychological Symptoms: Cross-Sectional Survey Study. J. Med. Internet Res. 2020, 22, e22142. [Google Scholar] [CrossRef]
  28. Lin, D.; Friedman, D.B.; Qiao, S.; Tam, C.C.; Li, X.; Li, X. Information Uncertainty: A Correlate for Acute Stress Disorder during the COVID-19 Outbreak in China. BMC Public Health 2020, 20, 1867. [Google Scholar] [CrossRef]
  29. Shi, W.; Zeng, F.; Zhang, A.; Tong, C.; Shen, X.; Liu, Z.; Shi, Z. Online Public Opinion during the First Epidemic Wave of COVID-19 in China Based on Weibo Data. Humanit. Soc. Sci. Commun. 2022, 9, 1–10. [Google Scholar] [CrossRef]
  30. Sun, M.; Li, X.; Yao, J.; Huang, X.; Kang, Y.; Li, Z. Psychological Status of Medical Staff Dedicated to Nucleic Acid Collection in COVID-19 Epidemic during Closed-Loop Management: A Cross-Sectional Study. Front. Public Health 2023, 11, 1131971. [Google Scholar] [CrossRef] [PubMed]
  31. Chen, H.; Zhang, K.; Li, H.; Li, M.; Li, S. Trends in Online Searching toward Suicide Pre-, during, and Post the First Wave of COVID-19 Outbreak in China. Front. Psychiatry 2022, 13, 947765. [Google Scholar] [CrossRef] [PubMed]
  32. Huang, X.; Zhang, L.; Ding, Y. The Baidu Index: Uses in Predicting Tourism Flows—A Case Study of the Forbidden City. Tour. Manag. 2017, 58, 301–306. [Google Scholar] [CrossRef]
  33. Yu, H.-Z.; Fu, T.; Zhou, J.-N.; Ke, P.; Wang, Y.-X. More Depression-Related Public Concern after the Suicide of a Pop Star in China: Evidence from the Online Big Data Platform. Front. Psychiatry 2021, 12, 629904. [Google Scholar] [CrossRef] [PubMed]
  34. Fang, J.; Gozgor, G.; Lau, C.-K.M.; Lu, Z. The Impact of Baidu Index Sentiment on the Volatility of China’s Stock Markets. Financ. Res. Lett. 2020, 32, 101099. [Google Scholar] [CrossRef]
  35. Fang, J.; Zhang, X.; Tong, Y.; Xia, Y.; Liu, H.; Wu, K. Baidu Index and COVID-19 Epidemic Forecast: Evidence from China. Front. Public Health 2021, 9, 685141. [Google Scholar] [CrossRef] [PubMed]
  36. Chen, H.; Zhang, K. Insight into the Psychological Problems on the Epidemic of COVID-19 in China by Online Searching Behaviors. J. Affect Disord. 2020, 276, 1093–1094. [Google Scholar] [CrossRef] [PubMed]
  37. Xu, L.; Lin, H.; Zhao, J. Construction and analysis of emotional corpus. J. Chin. Inf. Sci. 2008, 22, 116–122. [Google Scholar]
  38. Zung, W.W.K. Self-Rating Anxiety Scale. APA PsycTest Cit. Descr. 2013. [Google Scholar]
  39. Zung, W.W.K. A Self-Rating Depression Scale. Arch. Gen. Psychiatry 1965, 12, 63–70. [Google Scholar] [CrossRef]
  40. Derogatis, L.R. Symptom Checklist-90-Revised, Brief Symptom Inventory, and BSI-18. In Handbook of Psychological Assessment in Primary Care Settings; Routledge: London, UK, 2017; ISBN 978-1-315-65840-7. [Google Scholar]
  41. Gong, X.; Han, Y.; Hou, M.; Guo, R. Online Public Attention during the Early Days of the COVID-19 Pandemic: Infoveillance Study Based on Baidu Index. JMIR Public Health Surveill 2020, 6, e23098. [Google Scholar] [CrossRef]
  42. Gong, W.; Zhu, M.; Chen, H. The evolution mechanism of social emotions under major epidemics—Analysis based on big data such as Twitter and GDELT. Soc. Res. 2023, 38, 203–225+230. [Google Scholar]
  43. Wubben, M.J.J.; Cremer, D.D.; van Dijk, E. How Emotion Communication Guides Reciprocity: Establishing Cooperation through Disappointment and Anger. J. Exp. Soc. Psychol. 2009, 45, 987–990. [Google Scholar] [CrossRef]
  44. Pretus, C.; Ray, J.L.; Granot, Y.; Cunningham, W.A.; Van Bavel, J.J. The Psychology of Hate: Moral Concerns Differentiate Hate from Dislike. Eur. J. Soc. Psychol. 2023, 53, 336–353. [Google Scholar] [CrossRef]
  45. Figueredo, A.J.; Sefcek, J.A.; Vasquez, G.; Brumbach, B.H.; King, J.E.; Jacobs, W.J. Evolutionary Personality Psychology. In The Handbook of Evolutionary Psychology; John Wiley & Sons, Ltd.: New York, NY, USA, 2015; pp. 851–877. ISBN 978-0-470-93937-6. [Google Scholar]
  46. Wang, G.-Y.; Tang, S.-F. Perceived Psychosocial Health and Its Sociodemographic Correlates in Times of the COVID-19 Pandemic: A Community-Based Online Study in China. Infect. Dis. Poverty 2020, 9, 59–68. [Google Scholar] [CrossRef] [PubMed]
  47. Zang, W. Research on the Unemployment Risk of Migrant Population in China’s Megacities during the COVID-19 Epidemic. Urban Dev. Res. 2022, 29, 116–123+132. [Google Scholar]
  48. Schraff, D. Political Trust during the Covid-19 Pandemic: Rally around the Flag or Lockdown Effects? Eur. J. Political Res. 2021, 60, 1007–1017. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Clustering impact of TNE at various phases.
Figure 1. Clustering impact of TNE at various phases.
Behavsci 14 00113 g001
Figure 2. Spatial correlation between GBI and TNE at various phases.
Figure 2. Spatial correlation between GBI and TNE at various phases.
Behavsci 14 00113 g002
Figure 3. Spatial correlation between NABI and TNE at various phase.
Figure 3. Spatial correlation between NABI and TNE at various phase.
Behavsci 14 00113 g003
Figure 4. Spatial correlation between PBI and TNE at various phases.
Figure 4. Spatial correlation between PBI and TNE at various phases.
Behavsci 14 00113 g004
Table 1. Spatial agglomeration of different negative emotions.
Table 1. Spatial agglomeration of different negative emotions.
Pre-PandemicPhase IPhase IIPhase IIIPhase IVPhase V
TNEMoran’s I0.0490.170 **0.183 *0.150 **0.1510.148 **
Z-Value0.7833.6352.0473.5751.0683.365
SadnessMoran’s I0.0760.209 **0.174 *0.1540.164 *0.111 **
Z-Value1.1393.8952.0333.7051.9793.182
AngerMoran’s I0.0450.124 **0.193 *0.088 *0.1520.088 *
Z-Value0.7502.7762.0122.5121.0902.381
LonelinessMoran’s I0.0920.182 **0.204 *0.159 **0.179 *0.144 **
Z-Value1.1473.7212.2753.5822.0703.300
FearMoran’s I0.1220.101 **0.123 **0.116 *0.193 *0.148 **
Z-Value1.3822.7042.6103.1502.0453.641
AnxiousnessMoran’s I−0.0300.133 **0.173 *0.125 **0.1260.232 ***
Z-Value0.0033.0681.9703.1001.4074.547
DisappointmentMoran’s I0.1080.257 **0.180 *0.207 **0.196 *0.160 **
Z-Value1.5124.2372.0714.0012.2113.854
DisgustMoran’s I0.0760.112 **0.222 *0.110 **0.210 *0.212 **
Z-Value0.9972.6992.2173.0012.1464.400
HelplessnessMoran’s I0.0740.145 **0.199 *0.148 **0.1820.143 **
Z-Value0.9803.3472.1763.5512.0493.478
DepressionMoran’s I−0.0110.133 **0.159 *0.105 **0.1450.231 **
Z-Value0.2264.1361.9633.9731.8904.523
ConfusionMoran’s I0.0190.168 **0.1380.1490.0850.088 *
Z-Value0.5313.5341.6913.3801.1641.972
Significance values: *** p < 0.01, ** p < 0.05, * p < 0.1.
Table 2. Spatial clustering of different influencing factors of TNE.
Table 2. Spatial clustering of different influencing factors of TNE.
Influencing Factors of TNEMoran’s IZ-Value
Pre-pandemicGBI0.0340.733
Phase IGBI0.0490.672
NABI0.0310.325
PBI0.240 **3.230
Phase IIGBI0.088 *1.965
NABI0.141 *2.144
PBI0.0471.303
Phase IIIGBI0.253 **3.345
NABI0.166 *1.988
PBI0.240 **3.350
Phase IVGBI0.0751.264
NABI0.131 *1.393
PBI0.0240.860
Phase VGBI0.119 **4.114
NABI0.202 **2.538
PBI0.221 **2.770
Significance values: ** p < 0.05, * p < 0.1.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ding, Y.; Wu, L.; Peng, Z.; Liu, B. Temporal and Spatial Analysis of Negative Emotions in China during the COVID-19 Pandemic. Behav. Sci. 2024, 14, 113. https://doi.org/10.3390/bs14020113

AMA Style

Ding Y, Wu L, Peng Z, Liu B. Temporal and Spatial Analysis of Negative Emotions in China during the COVID-19 Pandemic. Behavioral Sciences. 2024; 14(2):113. https://doi.org/10.3390/bs14020113

Chicago/Turabian Style

Ding, Yating, Lin Wu, Zijian Peng, and Bo Liu. 2024. "Temporal and Spatial Analysis of Negative Emotions in China during the COVID-19 Pandemic" Behavioral Sciences 14, no. 2: 113. https://doi.org/10.3390/bs14020113

APA Style

Ding, Y., Wu, L., Peng, Z., & Liu, B. (2024). Temporal and Spatial Analysis of Negative Emotions in China during the COVID-19 Pandemic. Behavioral Sciences, 14(2), 113. https://doi.org/10.3390/bs14020113

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop