1. Introduction
The Internet’s embedded values of freedom, equality, and democracy raise expectations for its political influence [
1], sparking heated academic debates. However, scholars’ opinions are surprisingly divided into two distinct groups in terms of the political influence of the Internet in China. One side argues for the power-decentralization trend brought about by the Internet, which empowers public political participation [
2,
3,
4]. On the contrary, the other group claims that the Internet strengthens the central power of political leaders without pushing forward government reform [
5,
6,
7]. A consensus cannot be easily reached among studies on the political implications of the Internet in China.
Although disagreements exist, certain consensuses are established in online politics. There is a changing trend in online politics from constructing an internal network system to focusing on the external network system, which is characterized by two major characteristics: the government’s response to the needs of netizens and citizens’ influence on government through feedback mechanisms [
1]. Similarly, this trend echoes in the analysis of the third stage of Chinese digital government development—the interaction between state and society—after the initial two stages, including internal office automation and inter-governmental information exchange [
4]. Among diverse kinds of communications between the government and the public, government response to the public has strong potential for improvement. The traditional political communication between Chinese government officials and the public is seriously insufficient, as political information is noisy, heavily lost, distorted, and has low sensitivity and unbalanced feedback adjustments [
8]. The application of the Internet in this communication process enables direct interactions between government officials and the public, which may potentially improve the ineffective traditional communication situation.
This research contributes to understanding the logic, operation, and function of the Chinese political system in the process of e-government response, especially when facing pressure from the environment. “E-government response” in this paper refers to how the government responds to public inquiries through digital communication channels such as official websites. The study interprets a common type of ineffective response—the topic of the e-government response does not match the topic of the initial public inquiry—as evidence that the political system is under stress. By analyzing the e-government’s varied perception of different types of pressure when responding to public inquiries, this study partially validates the applicability of the classical political system theory in the context of Chinese e-government response. Furthermore, practical suggestions to improve the effectiveness of e-government response are raised based on the critical discussions of the theory and the empirical evidence.
2. Literature Review
The concept of “government response” did not originate in China but rather in Western countries as a response to their governments’ legitimacy crisis, which arose as a result of the economic depression from 1960s to 1970s [
9]. Scholars raise definitions of this concept from different perspectives including public policy, public demand, and government-citizen interaction. In the Western democratic context, some scholars define this concept as public expressions, which include opinion polls, demonstrations, elections, and letter campaigns, that are adopted by the government for public policies [
10,
11]. It can also be perceived as the government’s response to public demands in order to align with the people’s preferences [
12]. In the Chinese context, this concept is understood as the process by which the government interacts with citizens [
9]. Due to the specific focus of this article, we define e-government response as governmental replies to public inquiries with the aim of solving public concerns through official websites.
The importance of government response to public opinion can be unpacked from three major perspectives including modern politics, political legitimacy, and public rights. The continuous response of the government to the opinions of citizens is regarded as the basic characteristic of the modern political system [
13]. This significance can also be explained from the perspective of political legitimacy, as more people will be loyal to the state if most public requests are responded to specifically and sufficiently by the political system [
14]. In contemporary China, where politics and administration are integrated, responsiveness is regarded as the most fundamental basis of legitimacy [
9]. It is even incorporated into “the Main Evaluation Criteria for Chinese Democratic Governance” [
8]. From the perspective of public rights, an effective government response ensures citizens’ rights of communication, information access, and disclosure [
9]. All of these demonstrate the significance of government’s response to public opinion.
It is conducive to explaining the relevant phenomenon if we can understand the motivation of the Chinese government response. Scholars attempt to explain the motivation of the Chinese government’s response to online public opinion in terms of authoritarian resilience and fear of potential public protests. The responsiveness of the Chinese government is understood as an initiative reflecting authoritarian resilience [
15]. Another way to understand the response motivation is that the authority is fearful of the public’s collective action in response to official inaction [
16] and the potential public protests when the media follows up [
17]. The understanding of the Chinese government response becomes more complex as the attitude of the government towards online public opinion is ambivalent, with official emphasis on online public opinion during foreign affairs [
18], online censorship [
19], and manipulations [
20,
21] coexisting.
Research on Chinese e-government responses focuses on limited perspectives without demonstrating whether and when government responses effectively solve public concerns. Scholars explore the influence of different factors on whether the government responds or not and the policy impact generated by online expressions. Based on the analysis of government response data from the Message Board for Leaders of the Renmin Net, it was found that both social identities of netizens and policy categories of public messages influence whether the government responds or not [
22]. Through conducting an online field experiment, the claim of a collective action organization and the reference to upper levels of government are more effective in generating government responsiveness at the county level compared with tabbing as a sign of loyalty to the Chinese Communist Party [
23]. Regarding the policy impact of online public opinion, scholars argue that the stronger official stress on policies of social welfare was triggered by online expressions through content comparison between public expressions on the Message Board for Leaders and Government Work Reports [
24]. However, existing studies have rarely investigated if the official replies effectively address the public concerns reflected online. If not, a typical situation of an ineffective response is when the topic of the government response does not align with the topic of the initial public message posted online (da fei suo wen), which is referred to as an “unmatched government response” in the following discussions. Very few studies have investigated the reason why the government generates an e-government response in which the topic does not match the initial inquiry.
This kind of unmatched government response does not fully process inputs and reflects the information loss or distortion in transmission. It can to some extent reflect the sensitivity of the political system to certain pressures or stimuli in the form of expedient measures. By obscuring formal responses, it aims at dispelling possible public dissatisfaction caused by temporarily unresolved public demands. Instead of a substantial response, an unmatched government response is a pro-forma response that meets the official requirement of response rate but does not substantially solve the problem. If the official response specifically and accurately addresses public concerns and establishes a clear connection between the political system and the social system, the unmatched government response forms a vague link between these two systems. Although it may meet the time requirement and ensure the response rate as stated in the official documents [
25], specific public inquiries are not substantially resolved. The study of it may help to explain the regularity of the political system’s sensitivity to pressure and stimulus. A typical example of an unmatched government response appears on the official website of the Beijing Municipal Government an astonishing 1160 times from 2019 to 2020. It seems to work as a panacea in the officials’ eyes for all public inquiries relevant to the lottery policy of car numbers, no matter what specific questions are initially proposed by the public:
“In order to alleviate traffic congestion, reduce energy consumption and reduce environmental pollution, and achieve a reasonable and orderly growth in the number of passenger cars, the city of Beijing has implemented a policy of regulating the number of passenger cars since 2011 and has achieved remarkable results. The increased number of passenger cars has been effectively controlled, which plays an important role in alleviating urban traffic congestion and improving the atmospheric environment. According to the “Beijing Interim Provisions on the Control of the Number of Passenger Cars” (Government Order No. 227), “the Decision of the Beijing Municipal People’s Government on Amending the Beijing Municipal Government’s Interim Provisions on the Control of the Number of Passenger Cars” (Municipal Government Order No. 276) and its implementation rules, the city’s passenger car quotas are configured in an open, fair and just way. In the process of policy implementation, the city’s passenger car quota management integrates the opinions and suggestions of the city’s people’s congress representatives, members of the Chinese People’s Political Consultative Conference and the general public to continuously improve control measures. The city has adjusted the total number of quotas and allocation methods for passenger cars, increased the chances of long-term lottery applicants to win the lottery, increased support for new energy passenger cars, and further ensured the orderly progress of the number of passenger cars. In the next step, we will extensively listen to opinions and suggestions from all walks of life, consider the actual problems encountered in the regulation and control of passenger cars, and strive to study and improve relevant policies for the regulation and control of passenger cars”.
This article focuses on the official website of the Beijing Municipal Government, which is called “the Window of the Capital”. As a local online platform, it closely links residents of Beijing and government officials through digital connections with 83 government departments and affiliated institutions. This extensive network of connections is beneficial in addressing public concerns in a targeted manner. The process of response there forms its own political system and, at the same time, works as a political sub-system within the whole Chinese political system of response. The inputs and outputs of this website illustrate the response operation logic of a typical political sub-system at the city level, if not the whole political system. The reason to choose this case is because of its outstanding performance in facilitating interactions between government departments and citizens, which offers the opportunity of revealing the operation logic of the political system based on a representative political sub-system. The Window of the Capital has been ranked first among peer local government websites for the past 12 consecutive years for government online interaction with citizens. It used the Internet early on to interact with netizens through the use of an integrated platform. The operation of this local platform reflects the innovation and autonomy of a representative political sub-system in the digital response context. The study of this political sub-system is not only much more feasible than direct exploration of the entire system, but it also mirrors the function logic of the political system to some extent.
3. Theory and Research Questions
The process of e-government response is a political phenomenon containing both typical input and output, which should be systematically approached and perceived. The political system theory regards politics as a system within the environment, which exerts influence on the “input” containing requirements and support for the political system. After processing the input, the authority within the political system generates output for the general environment, from which feedback can be returned to the political system. The reaction of the political system to the environment reflects the way in which the system functions [
26]. The political system theory is well suited for explaining the phenomenon of the unmatched e-government response, as the process contains both typical input and output, which are key factors of this theory. The online public message is a specific form of input, which mainly refers to interest expression here. In the eyes of Edward Almond, interest expression is regarded as both input and an important function of the political system [
27]. The e-government response process can be regarded as a special function of boundary maintenance between the political system and the social system. The traditional output of the political system theory is public policy, which is defined by its macroscopic nature. In China, public policy as the traditional output lacks evaluation and feedback that are visible for both the political system and the social system. In the context of online response, the output of the political system is official replies, with the new feature of being specific and targeted and containing the possibility of being evaluated by the public. With the new dynamics of the boundary maintenance, the political system may encounter problems with output effectiveness. A typical problem is that the topics of some government responses as “output” do not align with the topics of the corresponding initial public messages posted online as “input”. An example of the general and ineffective response to the inquiry about the car number lottery policy is mentioned earlier in the section above. One of the typical situations of output failure is when the output does not conform to the actual situation or is inconsistent with the requirements of the system members [
26]. Through this understanding, the mismatch between the topics of the government response and the public message is a typical situation of “the output failure” [
28] as well as the disfunction of the political system.
The investigation of the causes of political system dysfunction naturally leads to the following research questions: Why does the political system generate output failure in the online response process, where the topic of the government response does not align with the topic of the initial corresponding public message? Which factors can influence the possibility of generating an e-government response in which the topic does not match the initial inquiry? The exploration of these questions is conducive to understanding how the Chinese political system copes with the changing environment of the digital response context so as to effectively address or just ineffectively respond to public concerns. The investigation of the influencing factors may reveal the specific types of inputs from the environment to which the political system is most sensitive or least responsive. This may further inspire the reform and modification of the political system from the perspective of online responses for a better state–society relationship.
The application of information and communication technology (ICT) to government response not only alters the information channel but may also change the political system’s perception to pressure. Not all elements contained in the input generate pressure on the political system. Even if they do, the stress levels may not be the same. Thus, it is necessary to explore separately whether different elements put significant pressure on the political system. Elements that may generate pressure on the political system include content, volume, emotion, and time. Easton [
28] proposed two types of output pressures that have a negative impact on the political system: content pressure and volume pressure. The “content pressure” refers to the stress that is faced by the political system and caused by the substance of input. For online responses, certain topics raised by the public may put pressure on the government, as these issues are hard to address through one-time replies. From this perspective, we may have the first hypothesis (H1a): that the substance of the initial public message posted online may influence the level of topic match of the corresponding government response. On the side of volume pressure, “the excessive volume stress” [
28] describes the dangerous situation faced by the political system when the input capacity of the requirement is too large. In the context of government response, the possible logic guided by this theory is that the greater amount of public messages received by a certain department, the more difficult it is for this department to allocate enough resources to each message, and the easier it is for the government response to not match the initial inquiry. Therefore, another hypothesis (H1b) is that the larger the number of public messages received by certain government departments, the higher the possibility of generating topic-unmatched responses.
In the response procedure, online public messages enter the political system as interest expressions that happen at the boundary between the social system and the political system. Interest expression determines the characteristics of the boundary and the model of boundary maintenance [
27]. One of the important dimensions of the characteristics of interest expression is emotion, which may form another type of pressure for the political system. The more emotional the expression of interest is, the more difficult it is to integrate and transform it into public policies [
27]. Information with strong emotion makes analysis and reasoning difficult, as the political system cannot easily evaluate or weight the emotional information so as to fill it into the flow of political input and output [
27]. In the response context, public messages with extreme emotion could obscure the description of issues and reduce the rationality of expressions, which may damage the accuracy and specificity of official replies. Thus, we generate the second hypothesis (H2): that the stronger the emotion of public messages, either positive or negative, the harder it is for them to trigger a matched e-government response.
Aside from content, volume, and emotion, government communication as a branch of the political system theory offers another valuable perspective on the phenomenon of response. Information communication is emphasized as being central to the governance process and is regarded as “the nerve of government” [
14]. According to this viewpoint, the government is “steering” rather than controlling [
14]. Guided by communication flows and feedbacks [
14], the “steering” process is interpreted as ongoing movement, continual adjustment of strategy, and sensitivity to the environment [
29]. The unmatched government online response can be regarded as a specific form of ineffective steering without the guidance of sufficient communication and adequate feedback. Karl Deutsch further raised major concepts to explain the steering process, including “lag” and “gain”. “Lag” refers to the time the political system takes to react to information, while “gain” means the extent of government reaction, which could be less, more, or exactly what the public requests [
30]. Time can exert a unique type of pressure on the political system. The longer the “lag” process is, the less likely the political system is to achieve the goal [
14]. Thus, the longer the government takes to process information during the “lag”, the less effectively they can “steer”. If it takes too long for the government to prepare the response, the effectiveness of resolving the initial public concern is questionable. Following these interpretations, the third hypothesis (H3) is that the longer the government departments take to respond to online public messages, the less likely the public receives the matched official replies.
4. Research Methods
Shared by the Department of Technology at the Window of the Capital, the whole dataset of government responses covers every item of everyday public messages and government replies on the Beijing Municipal Government website from 2019 to 2020. As the data are based on the population of local government responses across a time period, it minimizes the selection bias of sampling. In total, it includes 272,707 observations, with each one containing corresponding attributes including “category of message”, “title of message”, “content of public message”, “time of the message posted online”, “time of government receiving message”, “department of government reply”, “time of government reply”, and “content of government reply”.
In this study, the method of topic modeling is employed to generate the dependent variable pertaining to the adequacy of the government’s response to the public’s demands or, alternatively, whether the public’s complaints led to high-quality responses from the government. The transfer of the research focus from the traditional emphasis on response or not to the quality of text in political interaction is the essential reason of choosing topic modeling as the research method. This method can automatically calculate the probability distribution of topics in the text data, which are contained in the attributes “content of public message” and “content of government reply”. As the process by which the political system converts input into output is invisible, the logic and law of the information transformation process of the political system can be indirectly analyzed by topic modeling the textual features of input and output. This method considers each topic of “content of public message” and “content of government reply” as a probability distribution. For example, text A has a 70% probability of belonging to the illegal construction topic and a 30% probability of belonging to the traffic topic. At the same time, the topic model also considers the relationship between each topic and word frequency in the article as a probability distribution (and that a word belongs to a certain topic regardless of its order in the text, which is the “bag of word”). With known document-word information, we can estimate document-topic distributions and topic-word distributions through iterative estimation [
31]. By using this method, we can generate topics for each data point in “content of public message” and “content of government reply” and use their similarity as an independent variable to generate our dependent variable—whether or not the government has responded correctly to public concerns. By combining with other attributes, further analysis can be conducted to explore the specific situation and explain the reasons why matched and unmatched government responses can be generated. Popular topic modeling approaches include latent Dirichlet allocation (LDA) [
32] and structural topic model (STM) [
33]. They aim at identifying topics from a large amount of unstructured texts [
34] with the basic assumption of a “bag of words”, which means the order of terms in a document can be changed without affecting the results of model training [
35]. The structural topic model (STM) was chosen for this paper because it incorporates the effect of the covariate on topic prevalence and provides a more accurate prediction of topic distribution [
33,
36,
37].
Topic modeling has been applied to politics, public administration, and media studies with the focus on analyzing relevant texts. Researchers investigate the research–practice gap in public administration by topic modeling the titles and abstracts in
Public Administration Review and articles in
Public Administration Time [
34]. It can also be used to explore the political consequences of online expression by comparing the topic of online public messages and public policies in China [
24]. In addition, another area of applying topic modeling is to analyze journalistic texts, as there is large number of texts produced in this field [
38,
39,
40]. However, certain limitations of this method exist, as it requires tailored validation and cannot replace human reading and thinking [
41].
In topic modeling, researchers need to specify the parameter K. The value of K represents the number of topics in topic modeling. The machine cannot automatically decide this value, which requires human input. There are three main methods for the selection of the K-value: perplexity (held-out likelihood), exclusivity, and semantic consistency. Scholars regard perplexity as defective among them, so the selection of K-value in recent publications has rarely relied on perplexity. This article uses four methods, namely method semantic coherence, exclusivity, residuals, and held-out likelihood, to select parameter K. Semantic coherence is maximized when the most probable words in a given topic frequently co-occur together. Mimno et al. [
42] showed that the metric correlates well with human judgment of topic quality. Let
D(
,
) represent the number of times the words
and
appear together in a document. Then, for a list of the M most probable words in topic
k, the semantic coherence for topic
k is given as Equation (1). Because the range of values inside the logarithmic brackets on the right is (0,1), a larger semantic coherence indicates that there are more co-occurrences of words within each topic in the model, which means that the model is better.
A word’s exclusivity to a topic is its usage rate relative to a set of comparison topics [
43]. The greater the exclusivity of words in the model, the better the model. Residuals describe the degree of variance of the multinomial within the data-generating process of STM. The greater the degree of variance, the worse the model. Increasing the number of topics can usually absorb excess variance in the model. The idea of held-out likelihood is similar to cross-validation, where a portion of words are removed from the document, and the probability of their occurrence in the correct position is estimated. The higher the probability, the stronger the model’s predictive ability.
To optimize the value selection, both the exclusivity and the semantic coherence metrics are expected to be as large as possible. In this paper, we rely mainly on these two metrics and supplement them with held-out likelihood
1 and residuals check to select K values. We also check whether the indicators are overspread when extra topics are required [
44]. None of these metrics, with the primary role of assisting, are a fixed law for K-value selection. The semantic consistency keeps increasing until K reaches 50. The exclusivity increases monotonically and slows down when Kis around 50, where the marginal utility of K starts decreasing (see
Figure 1). Together with the consideration of held-out likelihood and residuals, we choose 50 as the appropriate K value.
The specific tag for each topic is summarized based on the words, which appear the most frequently under each topic.
Figure 2 illustrates the top five most frequent phrases for each topic and the topic proportion after using the frequent and exclusive (FREX) method. We use the method of FREX to measure the percentage of words, as it has been justified and advised in the relevant literature [
33]. FREX is the weighted harmonic mean of the word’s rank in terms of exclusivity and frequency [
44]. We summarize the tag for each topic based on the corresponding high-frequency phrases due to their frequent appearance. To some extent, the topic proportion can measure the prominence of each topic in public expressions and government responses. It can be found that the high-frequency words are more differentiated and weakly correlated between topics, while within the topics, the correlation of high-frequency words is stronger, which also justifies the selection of K= 50. To simplify the analysis, we classify the 50 topics into 16 clusters based on their similarity.
Table 1 illustrates the classification logic and result. We decide against directly setting K to 16. The reason is that the model using 16 as the K value in the structural equation is not as well fitted as the model with a K value of 50.
Apart from topic modeling, we also use sentiment analysis. The reason to choose sentiment analysis is that this method can quantify the extreme level of emotion, which lays the foundation for further correlation analysis between sentiment and unmatched government response. We use the API of the Baidu AI Open Platform to analyze online messages
2. Baidu is one of the largest and most technologically advanced technology companies in mainland China. The sentiment analysis is based on the ERNIE 2.0 model developed by Baidu [
45], which outperforms BERT in Chinese natural language processing and is one of the strongest models in this field. For each online message, this model helps us to generate the corresponding positive and negative probabilities of sentiment. We then calculate the absolute value of sentiment for each message by deducting the negative probability by the positive probability, which measures the level of extreme sentiment relative to the neutral sentiment. In order to test the hypotheses raised, we run logistic regression by taking the value of topic clusters, department, response interval, and the absolute value of sentiment as independent variables. For the dependent variable, we choose whether the government response matches the public inquiry as a binary dependent variable.
is the controlled covariates such as message type, date, and text length. Our model is shown in Equation (2)
3:
6. Conclusions
According to the classic political system theory, before the widespread adoption of digital technology in governance, the political system established a specific mode of processing pressure. The application of the Internet in government response could bring another set of behavioral patterns to the political system for sensing and processing pressure. With the Internet working as an information channel, the government can harness certain pressures that may have a negative impact on the political system, such as the volume pressure. This article adopts topic modeling and sentiment analysis to explore the factors that can potentially influence the failure of the online response of a political sub-system, if not the entire political system. It argues that the application of digital technology in government response adjusts the sensitivity of the political system to pressures in the informational communication between the political system and the social system. Topics, sentiment, and the response time interval can still generate pressure on the political sub-system by influencing the possibility of whether the government response aligns well with the public inquiry. Topics can influence the likelihood of a match between public inquiries and government responses. The hypothesis (H1a) was proven: the topics of the online public messages are significantly correlated with the possibility that the corresponding government responses match the topics of the initial public inquiries. When it comes to clusters of telecommunication operators, market supervision, public security, and environmental regulation, it may be difficult to effectively address public concerns posted online with a single response. The research positively verified the hypothesis (H2): the stronger the emotion of public messages, the more difficult it is for them to trigger a matched e-government response. Furthermore, the study proved the hypothesis (H3): the longer the official response interval is, the more likely it is that the government response will align with the public message. However, as digital technology expands the capacity of the information channel, the political sub-system is not sensitive to volume pressure. This study did not prove a significant positive correlation between the number of public messages received by certain government departments and the possibility of generating an unmatched official response, which fails to verify the hypothesis (H1b). This paper provides concrete evidence of the potential impact factors of ineffective government response, which aids in understanding the causes of ineffective political response in general. This may inspire further changes to the political mechanism in terms of topic identification, sentiment perception, and response time adjustment in order to improve the effectiveness and efficiency of government response in the digital context.
This paper reviews the political system theory, especially from the perspective of the effectiveness of “output” in the response process. It could be worthwhile to rethink this theory in the context of the Chinese government’s online response, as evidence supports that the volume of inputs does not really create pressure for the government to effectively address public inquiries, and the logical relationship between “lag” and “gain” does not follow the original theory. With the shift of the information communication channel from the interest group to Internet connectivity, we should reconsider the volume pressure argument in the political system theory. The increased volume of public inquiries does not necessarily increase the likelihood of output failure. This may relate to the operational logic modification of the political system after adopting the Internet for the function of response, which requires further investigation. In the online response context, the longer time of “lag” to process information on the political system may not negatively influence the achievement of political goals. Rather, the longer the “lag”, the greater the possibility of effective responses that correspond to original public concerns. However, some classic components of this theory are still supported by evidence in the digital response context, such as the pressures of content and sentiment. In the context of digital response, it appears that the political system theory can only partially explain the reality and logic of a typical Chinese political sub-system. This necessitates reconsidering the theory’s suitability for application to the digital contexts of other countries, which necessitates additional research. Due to the constraints of the resources, there are some limitations of this study, as the online response dataset was collected only from the Beijing Municipal Government website. If relevant data are available, comparing the influential factors of the response match for governments in different countries would be interesting. It would be interesting to compare the influential factors of the response match for governments of different countries if relevant data are available. It is also worthwhile to further investigate the logic and process of the unmatched government response by conducting interviews with government officials in relevant departments. More information could potentially be revealed by insiders about the government response mechanism, which is not covered by the online data. The endeavor of scholars to understand the response of the political system in the digital context will continue.