Abstract
Digital communication technology has created a world in which media are capable of crossing national boundaries as never before. As a result, language is increasingly the salient category determining individuals’ media consumption. Today, a single social media post can travel around the world, reaching anyone who speaks its language. This poses significant challenges to combatting the spread of disinformation, as an ever-growing pool of disinformation purveyors reach audiences larger than ever before. This dynamic is complicated, however, by the diversity of audience interpretations of message content within a particular language group. Both across and within national boundaries, a single message may be subject to a variety of interpretations depending on the cultural experiences and identities of its recipients. This study explores that dynamic through analysis of French language anti-vaccine and COVID-denialist disinformation. Using qualitative coding methodology, a team of researchers empirically identify common and far-reaching patterns of Francophone COVID disinformation narratives and rhetoric. These narratives and rhetorics are then subjected to hermeneutic close reading to determine likely variations in their reception across different French-speaking cultures. Data were gathered and analyzed between the dates of 24 March 2021 and 27 April 2021. Results of this study indicate the need for awareness on the part of public health officials combatting COVID disinformation online, for both the transnational reach of disinformation targeting speakers of a single language and for variations in meaning and salience across cultures within that language group.
1. Introduction
This study seeks to identify and analyze some of the most common narrative tropes and rhetorical strategies found in French-language antivaccine and COVID-denialist social media and user-generated content.
1.1. Vaccine Misinformation and Disinformation Online
Misinformation, disinformation, and malinformation refer to varieties of untrue or misleading messages. This study grounds itself in a pragmatic and inclusive theory of the problematic, such as that described by Tucker et al. for the Hewlett Foundation [1]. This perspective stands on several founding principles, namely, that mis-, dis-, and malinformation are detrimental to democratic policymaking [1,2,3]; that key affordances of online media such as low barrier to entry, anonymity, and affective polarization all contribute to a decline in quality of political and other policy discussions and an increase in the quantity of mis-, dis-, and malinformation [1,4,5,6]; and that a diverse array of actors, from the individual to the grassroots, government to the automated—each with their own methods and motives—contribute to the production of an online ecosystem brimming with misinformation, disinformation, and malinformation [1,4,7]. This study also acknowledges that misinformation and disinformation can be difficult to distinguish, as the difference rests on a question of the purveyors’ motive [8,9].
In the context of the COVID-19 pandemic, misinformation and disinformation can be defined as messages that contradict the best-available expert information and advice relating to public health and its attendant political, economic, and social conditions [10,11]. “Misinformation” is defined by its unintentional inaccuracy, while “disinformation” is knowingly fabricated and shared with the intent to mislead toward some ulterior motive [12,13]. Malinformation is distinguished by being agnostic to issues of facticity; it may or may not be true, yet it is specifically deployed in ways and contexts intended to mislead or harm [14]. All three forms can originate from citizens, governments, and foreign bodies. Their motives can be malign or benign, based in earnest ignorance or a cynical strategic program of harm. Whatever the motive, throughout the COVID-19 disease and pandemic, fabrication and propagation of unsubstantiated claims have steadily increased, creating a parallel public health information crisis, which some have termed the “infodemic” [14,15,16,17].
Mis-, dis-, and malinformation frequently take the form of “fake news,” a flexible term that refers to non-factitious or misleadingly factitious communication presented as news [18,19]. The digital age has created a news environment highly conducive to the spread of misinformation and disinformation, particularly as “citizen journalism challenged the link between news and journalists [and] social media offered a wider platform for non-journalists to engage in journalism” [19] (p. 139). Tadoc et al. point out how digitization, and social media in particular, have changed expectations as to the format and appearance of legitimate news, both in terms of the news message and its means of distribution.
Online fora are demonstrated to be a key contributor to the spread of vaccine hesitancy [20,21,22,23,24]. Access to digital communication technology has spread mis-, dis-, and malinformation through decentralized networks [4]. Social media platforms in particular appear to play a central role, both before and during the COVID-19 pandemic [25,26,27,28]. The digital francophone world comprises a relatively tight network connecting online media between France and other French-speaking countries, particularly in Africa [29]. This has led to vaccine hesitancy content originating in France to permeate networks in Francophone Africa [30]. False information regarding chloroquine as a COVID-19 treatment has similarly diffused from France to other Francophone countries, leading to widespread self-medication with chloroquine as a COVID-19 preventative and treatment, and in turn leading to many cases of overdose [31]. Francophone African countries have served as their own incubators of viral misinformation and disinformation, including popular apocalyptic conspiracy theories [29]. And outlets throughout the French-speaking world act as “info-laundering” devices, translating Russian and U.S. misinformation, disinformation, malinformation, and conspiracy theories relating to the COVID-19 pandemic and disseminating them throughout the francophone digital network [32].
1.2. National vs. Linguistic Borders and Online Communication
For the last decade, observers have debated as to the “post-Westphalian” or “Cyber Westphalian” quality of the internet [33,34,35,36], debating the effects of networked digital communication on the salience of national identities and state borders. To date, pronouncements as to the nation-state’s digital age obsolescence or its ruthless self-reassertion have proven overstated. National governments increasingly seek to assert sovereignty over digital space [37,38,39], while media industries seek on one hand to cultivate international audiences while protecting their domestic market advantages [40,41]. However, it cannot be denied that despite government interference and the still-prevalent “digital divide,” today’s audiences have far greater access to foreign media, both commercial and social, than ever before in human history [42,43,44].
So while state control of telecommunication infrastructure remains intact, and in many cases even expanding, digital communication continues to spread across state borders. If the inner limit of digital communication is access (state censorship and/or the “digital divide”), then the outer limit of online communication is less state regulation than legibility—that is, language [45,46,47]. The internet has been a powerful force for multilingualism, despite early expectations that it would lead to further global “Englishization” [48]. Hafez argues that language represents one of the critical barriers to the emergence of a true, global, public sphere [49]. “Even where media technologies and formats are explicitly transnational, as with satellite and cable TV, considerable adaptation to local and regional languages, cultures, and expectations concerning program genres has been a condition of viability for operating in different countries” [50] (p. 627). As Taneja and Wu succinctly put it: “websites cluster according to language and geography” [39] (p. 297). Yet despite digital media’s transnational reach, local circumstances prohibit the cultural flattening predicted by early techno-optimists and cheerleaders of globalization [51]. Perhaps even because of the porousness of national boundaries with respect to communication, national and local identities have stood fast, and in some cases re-entrenched [52,53].
This points to a situation in which (1) communication flows widely (but not unfettered) across state borders, which is (2) limited largely (but not exclusively) by linguistic intelligibility, to (3) audiences that may share a language but do not necessarily share a culture or identity. Under such circumstances the meaning imputed to digital content by its audience can be extremely varied. This phenomenon can perhaps be best modeled using the “encoding/decoding” model of communication first articulated by Stuart Hall [54]. In this model, Hall proposed that a message’s intended meaning and its received meaning “may not be perfectly symmetrical” [54] (p. 260). Hall proposed that a message might be understood at the valence of its producer (the “dominant or hegemonic” interpretation), the ideological functionaries of that producer (the “professional” interpretation), critically (a “negotiated” interpretation), or counter-hegemonically (an “oppositional” interpretation) [54] (pp. 272–274). Hall theorized this model prior to the age of social media and the digital prosumer. Today “elite” media production is no longer so evident, as new media forms such as memes, message boards, quote-Tweets etc. represent what Nowak terms “multiparticipant online content” [55]. However, Hall’s influential theory offers a ground from which to understand the simultaneous coexistence of many different interpretations and understandings of the same message. This theoretical perspective is useful in analyzing the ways in which a single piece of content might carry with it myriad meanings, some parallel and some contradictory, depending on its audience and their circumstances.
1.3. Persuasive Messaging: Targeting Narratives & Rhetoric vs. Targeting Facts
This codebook was developed as part of a toolkit of background materials supporting public health message campaigns in favor of COVID vaccination and against COVID-denialism and other forms of public health misinformation and disinformation. The field of pro-social persuasion reaches across numerous domains, from public health to preventing violent extremism [56,57,58]. And throughout the literature of these various domains, certain patterns emerge pertaining to the efficacy of fact- and logic-based persuasion campaigns versus campaigns based in emotion, identity, narrative/rhetoric and values. While the literature is not uniform, there appears to be strong evidence suggesting that persuasive campaigns focusing on message form (i.e., emotion, identity, narrative/rhetoric, values, etc.) tend to be more broadly successful than those focusing on logic and fact-based arguments.
To be sure, fact and logic-focused persuasive tactics such as fact-checking are effective in the right conditions. Fact-checking is a proven technique for reducing acceptance of misinformation and disinformation [59,60,61,62] as are preemptive factual approaches, such as “pre-bunking” [63,64]. However, outside of controlled circumstances, fact-checking faces serious scalability challenges associated with widespread inadequate resources and training for digital content moderators [65,66,67]. Furthermore, fact-based approaches have proven asymmetrical, and tend to be least efficacious among the audiences most in need of intervention. Feelings of social ostracism reduce the effectiveness of fact-checking [68]. Low information audiences are less receptive to political fact-checkers, as are conservatives in general [69].
The balance of existing research tends to suggest that audiences are more likely to be persuaded by narrative approaches [70,71,72,73], appeals to values [74,75,76], and rhetorics of personal, lived experience [77,78,79,80]. Perhaps this is due to a dynamic that Maertens et al. term a “broad spectrum” of persuasion [81]. Formal dimensions of a message, such as its narrative structure, rhetorical tone, the values it prescribes, the identities to which it appeals, etc., offer more points of persuasive contact with potential audiences than the narrower logico-factual approach. However, persuasive perspectives should not be overly broad either. Mason and Miller, for example, demonstrate how negative-outcome-focused public health messages are bolstered by specific references to the manipulative strategies of (in their study) junk food marketers and advertisers [82].
Unfortunately, there is as-yet no ironclad set of optimal practices for countering misinformation and disinformation with prosocial persuasive methods. While some methods and their proper applications are more well understood, strategic efficacy still varies across real-world circumstances. A detailed understanding of the narratives and rhetorics of manipulative and damaging health misinformation and disinformation is therefore essential for governments and NGOs to remain agile and dynamic in combating anti-vaccine and COVID-denialist misinformation and disinformation. To that end, this study sought to answer the following questions:
RQ1: What are the most frequent and widely found narratives comprising francophone anti-vaccine and COVID-denialist misinformation and disinformation?
RQ2: What are the most frequent and widely found rhetorical strategies found in francophone anti-vaccine and COVID-denialist misinformation and disinformation?
RQ3: How might reception of these narratives and rhetorics vary depending on the region and culture from which their audiences originate?
2. Materials and Methods
This study utilizes a qualitative coding methodology to create a “codebook” of twenty-five narrative tropes and twenty-four rhetorical strategies that appeared both frequently and across a wide range of French language platforms trafficking in content deemed detrimental to COVID-related public health measures. That codebook was then analyzed by a team of experts with regional and cultural expertise in key francophone regions, who proposed regionally and culturally specific approaches to interpreting these narratives and rhetorics. This data gathering and analysis occurred between the dates of 24 March 2021 and 27 April 2021. The data sampled, extant literature, and the analysis of the regional experts point to potentially powerful approaches to crafting public health messages for linguistically unified but geographically and culturally disparate audiences.
2.1. Qualitative Codebooking Methodology
This study relied on qualitative coding methodology in order to empirically analyze thematic content—specifically, the narrative tropes and rhetorical strategies commonly found in online francophone anti-vaccine and COVID-denialist social media content. The findings derived from this process were then compiled into a “codebook,” consisting of codes, definitions, inclusion criteria, and examples of this content [83]. Our analysis of narrative tropes and rhetorical strategies draws from both qualitative content analysis and hermeneutical approaches to textual analysis. As in qualitative content analysis, our study followed a defined process of “selecting material; structuring and generating categories [for coding]; defining categories; revising and expanding the frame [of coding criteria]” as the central component of its analysis [84] (p. 175). Qualitative content analysis is distinct from its quantitative counterparts due to its effectiveness in pulling latent meaning from out of the text [84] In the case of this study, that latent meaning refers to the implicit narratives and manipulative rhetorical tactics that make anti-vaccine and COVID denialist media persuasive in the first place. Because this latent meaning is sometimes well below the surface of that media, our team drew on hermeneutic approaches, too, “systematically to contrast a latent and a manifest level of meaning” [85] (p. 239) and to uncover “the latent meaning of utterances and its relation to the intentions (manifest meaning) of actors” [85] (p. 235). Here, again, our work finds resonance with that of Stuart Hall’s theories of encoding/decoding, and the search for asymmetry between a message’s intended and overt meaning and its received and latent meaning.
This study uses collaborative analytic methods to ensure a balance of what Cornish et al. term “rich local understandings” alongside inter-coder reliability [86]. Cornish et al. explain that “local experts, as collaborators, may provide the role of a ‘guide’ or ‘educator’, explaining to the rest of the team the local context and customs—knowledge that is needed in order to produce a sensitive analysis” [86] (p. 83). Given limitations of time and budget, this rich local understanding was essential to identifying culturally specific message reception. We assembled a team of five researchers, all with full bilingual fluency in French and English, and each with domain-specific expertise in at least one region of the French-speaking world: mainland France, regions of French West Africa, the Caribbean, and North Africa. (Other francophone regions such as Quebec or Mainland Southeast Asia were not incorporated, due to staffing and budget limitations.) These researchers came from professional backgrounds ranging from doctoral studies in political science and communication, professional journalism, and NGO administration to counter-terrorism research. These researchers were supported by a team of scholars from the university who oversaw methodological training and guided the process of data identification, gathering, cleaning, coding, and final analysis.
By the same token, intercoder reliability is necessary to ensure objectivity in this interpretive work [87] (p. 344). To draw on Hall’s rubric, it was essential that coders agreed on the fundamental “hegemonic” and “professional” coding of a message, even while identifying the “negotiated” and “oppositional” readings specific to their own region and culture of expertise. Of course, an exact replication of findings is impossible in a qualitative study such as this. Instead, we adopted the standard of “inter-subjective comprehensibility” [88] (p. 187), that is, congruency between researchers’ “hegemonic” coding of the narratives and rhetorics they encountered in the dataset. Inter-subjective comprehensibility was determined using a two-step process. First, in a “single-blind” evaluation, the project manager collected researchers’ codes and compared them, evaluating similarities and grouping them according to homophily. These homophilous groupings were then named and defined so as to encompass all the codes contained under their definition. These “meta-codes” were then resubmitted to the researchers for critique, evaluation, and where necessary revision.
A more detailed description of this process is now presented below.
2.2. Study Design
Our team of coders underwent a three-day, twelve-hour training on the principles and practices of qualitative coding and use of the NVivo qualitative data analysis software. They were then instructed to individually seek out 5 “channels” of French-language COVID mis-, dis-, or malinformation. Channels were restricted to online social media and user generated content platforms such as Facebook, Twitter, YouTube, Telegram, and blogs. To be considered for inclusion, a channel had to meet four criteria: (1) Its content had to have been exclusively or almost exclusively French language, (2) At least 80% of the content had to have been either generally anti-vaccine, provide misinformation about COVID, or oppose common public health tactics (e.g., mask mandates), (3) It must have been updated at least once in the week prior to selection, and (4) There had to have been at least 50 pieces of relevant content posted in the last 9 months. Due to the nature of the content, many of these accounts were effectively anonymous.
Each researcher selected five channels that met this criteria, for a total of 25 possible channels. These channels were analyzed by the project manager and head of the university research team, who is French-literate, who selected three channels for a preliminary round of coding. These channels were selected based on their audience size and diversity of content. As subsequent rounds went on, channels were also selected so as to incorporate a broad range of media (text, video, meme) and platforms. The first round of coding included the Facebook page of Frank Buhler (a self-proclaimed founder of the Gillet Jeune movement), an anonymous but high-traffic Twitter account calling itself “La Croix du Sud,” and the Instagram account of Salim Laibi (a dentist who also runs the far right website Libre Penseur). A second round of coding included the Twitter account “Association Victimes COVID-19 France,” the Telegram channel “Le Fronte Mediatique,” and the Instagram account “La Verité Fait Mal.” The 30 most recent vaccine or COVID-specific posts from each account were scraped and coded for the narrative tropes and rhetorical strategies that researchers identified in them.
Following these two rounds of coding, the researchers delivered their codes to the project manager and university research team. These codes were refined and consolidated into a preliminary codebook, consisting of 54 narrative tropes and rhetorical strategies. This codebook was then used for a third round of coding. Channels were identified based on the same criteria as those for rounds 1 and 2; however, they were selected in hopes of finding novel codes. This meant that personal, anonymous, and more marginal sources were considered for inclusion. Round 3′s channels consisted of 10 channels: the Telegram channels “Co-Créons!!!,” “Info Vaccins France,” and “STOP Masques Vaccins,” the blog “COVIDmenace,” the Instagram accounts “DNCT.x,” and “La Verité Derange,” the Facebook account of Evelyne Wermelinger, the Twitter accounts “@Laissonslesprescire” and “Flo” (the latter selected because it appeared to be a personal account with a wide reach, which aggregated popular news stories, memes, and talking points), and a 20-min video entitled Nouvel Ordre Mondial—Crise Coronavirus, which was hosted on the “Hax0r” Facebook group.
Again, each member of the codebooking team separately coded 30 posts per channel, except for “COVIDmenace” (for which they coded 10 blog posts) and Crise Coronavirus (for which they coded the entire video). In total, round two consisted of 241 closely analyzed and coded posts. The posts were assigned to codes from the preliminary codebook created after rounds 1 and 2, and coders were given the discretion to create additional codes as they deemed necessary. After completing their analysis individually, all team members submitted their codebooks to the project manager, who again refined and consolidated their codes. It was determined that saturation had been reached, based on the diminishing number of new codes and these new codes’ marginal distinction from those of the preliminary codebook. Codes were analyzed for both the frequency with which they appeared (i.e., how many discrete posts), and the range of their appearance (i.e., across how many distinct channels). The codes with the highest numbers of raw appearances and cross-channel presence were identified. These narrative tropes and rhetorical strategies comprise the content of the final codebook.
Following the creation of the final codebook, each coding team member separately analyzed each code. Based on their cultural domain expertise, they noted which narratives and rhetorics might have culturally specific interpretations depending on the region in which they were received. Each expert offered an interpretation only for their specific region of expertise. These region- and culture-specific interpretations were then added to each code entry. A finalized codebook consisted of 23 rhetorical strategies, of which 14 were observed to yield culturally specific interpretations, and 25 narrative tropes, of which 22 yielded culturally specific interpretations. These codes will be discussed in the next section, with a focus on those culturally specific interpretations.
3. Results
3.1. Narrative Tropes
Within the 25 narrative tropes and their 22 culturally specific variation, four key tropes addressed anger and mistrust in varying cultural contexts (see Table 1, below): (i) “Caged and Enraged” (Cage et Rage), (ii) “The National Conspiracy” (Le Complot National), (iii) “Medical Dictatorship” (Dictature Sanitaire), (iv) “Lies and Mistrust” (Les mensonges et la méfiance). The data in which these narrative tropes were identified are available upon request to the corresponding author.
Table 1.
Narratives (in English and in French).
The narrative of “Caged and Enraged” expresses frustration at quarantine measures confining individuals to their homes, which are viewed as meaningless at best and tyrannical at worst. In the North African context, this trope might commonly be interpreted particularly through a framework of government manipulation and control. For French audiences, this code would be expected to elicit strong emotion, outrage, and implicitly encourage direct action against the measures.
The second narrative trope, “The National Conspiracy,” directly invokes distrust of government by alluding to conspiracies—both specific and vague—surrounding the vaccine and the virus itself. An example of this is the belief that there are microchips in the vaccine, or that the COVID is manmade and either designed to reduce the population or garner income for pharmaceutical companies. These narratives find footing with the rise in conspiratorial thinking in France. In West Africa, narratives fitting this category are frequently linked to fears of revenant French colonialism. In Haiti and The Antilles, where COVID rates were lower during the period of this study, these narratives corresponded with beliefs that government officials were using funds from COVID for personal gain. The North African interpretation focuses on the conspiring between the government and pharmaceutical companies to sell vaccines and control the population.
The concept of pharmaceutical industry power returns again in the narrative of “Medical Dictatorship.” Narratives belonging to this category emphasize the power of medical authority and treat safety protocols as an extension of that power and a deprivation of autonomy. Interpretations of this narrative in France draw on cultural memories of past dictatorships and invoke the Nazi occupation as an example. In North Africa, the government and medical community are viewed as working in tandem to impose control; this is comparable to the idea of “medical colonialism” that West African narratives employ.
The fourth common narrative, “Lies and Mistrust,” appeals to mistrust in the press and other official sources as well as government leaders in their reporting of and response to COVID. In France, this narrative is seen to fuel a strong pre-existing mistrust of government officials. West Africa’s relatively lower infection rate sustained this mistrust, as individuals questioned the accuracy of infection rates. Interpretations of “Lies and Mistrust” in North Africa intersect with the previously mentioned view of the government and medical community colluding in order to encourage vaccination and treatments, which (so the narrative implies) are ineffective.
3.2. Rhetorical Strategies
Of the 24 rhetorical strategy codes listed in this final codebook, 14 yielded culturally specific variation. Of these, four key strategies suggested certain cultural distinctions in interpretation (see Table 2, below): (i) “Concern Trolling” (Concern Trolling), (ii) Indignation (Indignation), (iii) Talking Back to Authority (Pointer les autorités du doigt), (iv) Minimizing/Cure is Worse than Disease (Minimisant/le remède est pire que la maladie). The data in which these rhetorical strategies were identified are available upon request to the corresponding author.
Table 2.
Rhetorical Strategies (in English and French).
The rhetorical strategy of “Concern Trolling” (same in French) seeks to provoke sympathy for frontline workers and those deemed significantly affected by COVID, whether financially or mentally. However it does so for the specific purpose of denying vaccine efficacy or minimizing the severity of COVID as a public health menace. The rhetoric positions its message in a frame of selflessness, often expressing concern for those with mental or physical problems, unemployment, or depression. It uses this frame of sympathy to argue that these are problems from which COVID elimination efforts are distracting. The understanding of this strategy in West Africa challenges the Western-centered implementation of quarantine procedures that would threaten the informal markets on which many livelihoods are based and calls for regionally tailored solutions. Conversely, North African interpretations elicit an overall pessimism about society during the pandemic.
A second popular rhetoric of “Indignation” conjugates its messages in a register of annoyance and anger toward those who are pro-vaccine or following COVID protocols. This framing encourages its audience to join in ridicule of the pro-vaccine population. Interpreted in North Africa, it warns that those who follow vaccine protocols will face humiliation. In France, this code resonates with longstanding cultural values that embrace vocal expressions of indignation and outrage.
The strategy “Talking Back to Authority “preframes messages as if they were directly addressed to government officials. Messaging deploying this rhetorical strategy demands that authority reply to individual posts, which are often intoned with a sense of concern or defiance. This is seen in posts that tag government officials and seem to actually expect responses; a lack of response can be viewed as silence on the issue or cowardice on the part of the official. In France, public figures are commonly mistrusted and regularly attacked, so this strategy targets pre-existing mistrust. The West African interpretation of “Talking Back to Authority” interpellates African leaders as French puppets. In North Africa, this strategy fuels popular doubt in the authority of leaders.
A fourth popular rhetorical strategy, “Minimizing/Cure is Worse than the Disease” questions the basic legitimacy of the numbers of cases and deaths as well as the effectiveness of the vaccine. The strategy destabilizes belief in doctors and public health officials by implying that the true effects of COVID are less severe than portrayed by the media. It frames its messages around the assumption that the socio-economic costs of public health measures are underreported and underappreciated, and that these costs actually cause more harm and suffering than COVID itself. Particularly in North Africa, this rhetoric accompanies messages arguing that officials wish to generate fear and thus control the population. West African perceptions consider the fact that Africa has faced fewer cases than Europe; this is internalized by audiences as a chronic sense that official case statistics are too high to be credible.
4. Discussion
This study contributes to a growing body of research on the specific forms of anti-vaccine and COVID-denialist media. That body of research contributes to broader efforts at combatting mis-, dis-, and malinformation and reducing vaccine hesitancy. Members of the team responsible for this study have deployed similar study designs in the past, including one that developed an anglophone codebook of anti-vaccine and COVID-denialist narratives and rhetoric [89]. That anglophone codebook formed the basis for a series of prophylactic attitudinal inoculation videos against anti-vaccine and COVID-denialist misinformation and disinformation. These messages were demonstrated to have a significant impact in reducing perceived credibility toward the creators of anti-vaccine and COVID-denialist content [64]. It was found that fact-based inoculation messages performed equally well to narrative/rhetoric-based messages, and equally well to hybrid methods that used both fact and narrative/rhetorical techniques. It seems possible that a similar approach could be pursued to develop francophone public health messages based on persuading audiences away from anti-vaccine and COVID-denialist viewpoints. This codebook is intended to inform public health measures, from messaging campaigns to better moderation of online platforms.
5. Implications
This is not to say that the codebook offers no applicability on its own merits. It confirms previous studies that describe the spread of misinformation and disinformation across national boundaries via francophone networks. It demonstrates the extreme adaptability of misinformation and disinformation, even relative to changing developments in the legitimate news cycle. One may see how codes such as “The Little Guy” easily adapt to suit shifts in the population most impacted by the economic and social side-effects of necessary public health measures. Likewise, narratives such as “Medical Dictatorship” and rhetorics such as “Talking Back to Authority” are adaptable to alterations in the spokespeople explaining public health needs, or even changes of political administration. Indeed, this study’s findings indicate that facts offer limited power to impact the narratives and rhetoric that form the core of anti-vaccine and COVID-denialist mis- and disinformation. The most prevalent narratives and rhetorics are necessarily the most durable—that is, the most adaptable in responding to changing facts “on the ground.”
Unfortunately, this points to a very real challenge facing the digital media companies tasked with moderating content on their platforms. While factually incorrect information pertaining to the COVID pandemic is fairly easy to identify and remove, these persuasive narratives and rhetorics are not. Many of the most egregious narratives work via innuendo, or are hard to distinguish from hyperbole, which platforms may be reluctant to police. Rhetorics, likewise, operate in the register of emotion and affect, less concerned with rebutting facts than shaping audiences’ feelings toward those facts. To the extent that narrative and rhetoric helps to spread anti-vaccine and COVID-denialist attitudes (and that extent seems significant), they are able to spread through digital channels of news and information with only limited impediment.
This suggests a possible shift in the emphasis of news coverage may help society combat the spread of such misinformation. In addition to important updates on the latest scientific news pertaining to the COVID pandemic, mainstream, legacy, government and advocacy-based news and information sources might devote editorial space to showing how purveyors of misinformation and disinformation are adapting to these developments and incorporating them into their predetermined worldview. This is, after all, news itself in the sense of a changing development in the landscape of the pandemic. It would offer a valuable way for audiences to see anti-vaccine and COVID-denialist media’s loose and instrumentalized relationship to science, if not truth itself. While codebook-based communication such as this would not be attitudinal inoculation of the type described above, it nevertheless could play an important role in curbing the appeal of anti-vaccine and COVID-denialist propaganda.
6. Limitations
While this study takes advantage of its coding team’s cultural and regional expertise, it was also limited to those regions and cultures. Other francophone regions such as Quebec and Mainland Southeast Asia remained outside the scope of this study due to budgetary and staffing limitations. Unfortunately, it was also not possible to test the pervasiveness of the narratives’ and rhetorics’ culturally-specific interpretations. An expanded study might have sampled audiences from each of the regions discussed in the codebook to test the precision of the coding team’s interpretations and to identify new regionally and culturally specific interpretations. This study was also unable to perform network analysis on the flow of mis-, dis-, and malinformation through francophone social media. As per Bruns and Dotto and Cubbon, the francophone infodemic is neither one-directional nor self-contained. Anti-vaccine and COVID denialist narratives and codes presumably originate in every region of the French-speaking world and spread to every other region. Likewise, foreign misinformation and disinformation campaigns target francophone social media for a variety of reasons, from misguided to malign. It would likely have proven highly valuable to track the flow of the narratives and rhetorics listed in this study’s codebook, to better determine their origin and flows through the network.
7. Future Research
By pairing a follow-up francophone inoculation messaging study with the anglophone study mentioned before, we might gain greater insight into the need for audience-tailored approaches to public health messaging. Further research could indicate whether public health messages countering anti-vaccine and COVID-denialist media should be tailored for the specific regions in which they are broadcast, or if language alone is sufficient to positively influence audiences. The present study’s codebook might be used to further probe the question of fact-based vs. narrative/rhetoric-based efficacy. Given that the narratives and rhetorics identified in this study lead to different interpretations depending on their cultural reception, is it possible that fact-based prophylactic inoculation would yield overall better outcomes across pan-francophonic audiences? Or, would the so-called “blanket of immunity” effect, by which attitudinal inoculation against one manipulative persuasive technique confers resistance against similar techniques, mitigate that difference? Furthermore, research shows that generational cohort plays a role in receptivity to fake news [18]. Research into this dimension of message reception and interpretation might enrich the depth and accuracy of the study. In a situation such as the COVID pandemic, in which large numbers of people must be convinced to take a COVID vaccine, even a slight difference in message efficacy could mean the difference of many lives saved.
More abstractly, future qualitative and theoretical work might move deeper into questions unearthed by Hall’s encoding/decoding model of communication. Deeper analysis into the valences of hegemonic, negotiated, and oppositional interpretative positions across French-speaking cultures might yield important insights into preventative or counter-messaging strategies. Receptive differences between audiences in France versus in former French colonies raise tantalizing questions as to the relation between right-wing populism and the postcolony. Anti-vaccine and COVID-denialist audiences in both milieus appear to participate in oppositional decoding processes, and insofar as anti-vaccine and COVID denialism are concerned, reach similar conclusions in that oppositional decoding. Yet this dynamic seems informed by two contradictory ethos: on one hand, the right-populism of the colonizer culture appears motivated by a sense of aggrieved entitlement (resistance toward basic public health expectations) while the former colonized culture appears animated with a sense of “corrective paranoia” born of group grievance (against the perception of Western meddling in domestic affairs). This is no doubt a highly complex and fraught question, but the present study indicates that it is one with more than theoretical importance.
8. Conclusions
This study has identified twenty-five narrative tropes and twenty-four rhetorical strategies commonly found across a wide range of French-language anti-vaccine and COVID-denialist media. Toward the goal of answering its broad research questions, this study found the following:
RQ1: What are the most frequent and widely found narratives comprising francophone anti-vaccine and COVID-denialist misinformation and disinformation?
RQ2: What are the most frequent and widely found rhetorical strategies found in francophone anti-vaccine and COVID-denialist misinformation and disinformation?
These narratives and rhetorics represent a wide range of manipulative persuasive tactics. Most commonly, they speak to mistrust in government, social, and media authority and a belief that the costs of addressing COVID-19 as a public health matter outweigh the benefits of doing so.
RQ3: How might reception of these narratives and rhetorics vary depending on the region and culture from which their audiences originate?
Regional and culturally specific variations suggest that the breadth of their persuasive efficacy is wide indeed. These basic narratives and rhetorics often take on different meaning depending on the audience receiving them. These differences are most clearly seen in differing attitudes toward liberty and independence, divided between former colonizing and colonized nations/regions. They are also seen in regional and cultural differences relating to social censure, with different emphases placed on the negative experience of humiliation, ridicule, ostracism etc. Many key narratives and rhetorics did not suggest significant variation in cultural/regional reception, suggesting that some “hegemonic” meanings are more robust than others.
These answers raise promising possibilities as to the efficacy of wide-ranging public health messages targeting misinformation and disinformation related to the pandemic. However, it also raises questions as to underlying impetus behind these regional and cultural differences. While this study may facilitate immediate steps toward countering anti-vaccine misinformation and disinformation, it also points to important future research that ought to be undertaken.
Author Contributions
Conceptualization, B.H.; methodology, B.H.; validation, B.H. and M.C.; formal analysis, B.H., K.W., M.C. and J.W.; data curation, B.H., K.W. and M.C.; writing—original draft preparation, B.H., K.W., J.W., M.C., C.Z. and S.B.; writing—review and editing, B.H.; supervision, B.H.; project administration, B.H. All authors have read and agreed to the published version of the manuscript.
Funding
This project was funded by the Cabinet of the United Kingdom (HM Government of the UK)/ Mullen Lowe Group, proposal number 21-0243.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
Data is available upon request to the corresponding author.
Acknowledgments
The authors would like to thank our coding team and our regional/cultural analysis experts.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Tucker, J.A.; Guess, A.; Barbera, P.; Vaccari, C.; Siegel, A.; Sanovich, S.; Stukal, D.; Nyhan, B. Social Media, Political Polarization, and Political Disinformation: A Review of the Scientific Literature; SSRN Scholarly Paper ID 3144139; Social Science Research Network: Rochester, NY, USA, 2018. [Google Scholar]
- Schiffrin, A. Disinformation and Democracy: The Internet Transformed Protest but Did Not Improve Democracy. J. Int. Aff. 2017, 71, 117–126. [Google Scholar]
- Torcello, L. Democracy and the Limits of Reason: Why a sustained defense of liberal commitments is necessary to counter democracy’s disinformation and xenophobia. Disputatio 2020, 9, 125–173. [Google Scholar]
- Benkler, Y.; Faris, R.; Roberts, H. Network Propaganda: Manipulation, Disinformation, and Radicalization in American Politics/Yochai Benkler [and Two Others]; Oxford University Press: Oxford, UK, 2018. [Google Scholar]
- Bennett, W.L.; Livingston, S. The Disinformation Age: Politics, Technology, and Disruptive Communication in the United States; Cambridge University Press: Cambridge, UK, 2021. [Google Scholar]
- Feldstein, S. The Rise of Digital Repression: How Technology Is Reshaping Power, Politics, and Resistance/Steven Feldstein; Oxford University Press: Oxford, UK, 2021. [Google Scholar]
- Phillips, W. This Is Why We Can’t Have Nice Things: Mapping the Relationship between Online Trolling and Mainstream Culture; The MIT Press: Cambridge, MA, USA, 2015. [Google Scholar]
- Bernstein, J. Bad News: Selling the story of disinformation. Harper’s Magazine, September 2021. Available online: https://harpers.org/archive/2021/09/bad-news-selling-the-story-of-disinformation/(accessed on 9 August 2021).
- Pathak, A.; Srihari, R.K.; Natu, N. Disinformation: Analysis and identification. Comput. Math. Organ. Theory 2021, 27, 357–375. [Google Scholar] [CrossRef]
- Pan Health Organization. COVID-19 Factsheets: Understanding the Infodemic and Misinformation in the Fight against COVID-19—PAHO/WHO|Pan American Health Organization (Digital Transformation Toolkit); Pan Health Organization: Washington, DC, USA, 2020. [Google Scholar]
- Sell, T.K.; Hosangadi, D.; Smith, E.; Trotochaud, M.; Vasudevan, P.; Gronvall, G.K.; Rivera, Y.; Sutton, J.; Ruiz, A.; Cicero, A. National Priorities to Combat Misinformation and Disinformation; The Johns Hopkins Center for Health Security: Baltimore, MD, USA, 2021. [Google Scholar]
- Kapantai, E.; Christopoulou, A.; Berberidis, C.; Peristeras, V. A systematic literature review on disinformation: Toward a unified taxonomical framework. New Media Soc. 2021, 23, 1301–1326. [Google Scholar] [CrossRef]
- HLEG. A Multi-Dimensional Approach to Disinformation: Report of the Independent High Level Group on Fake News and Online Disinformation; Publications Office of the European Union: Luxembourg, 2018. [Google Scholar]
- Zielinski, C. Infodemics and infodemiology: A short history, a long future. Rev. Panam. Salud Pública 2021, 45, e40. [Google Scholar] [CrossRef] [PubMed]
- Cinelli, M.; Quattrociocchi, W.; Galeazzi, A.; Valensise, C.M.; Brugnoli, E.; Schmidt, A.L.; Zola, P.; Zollo, F.; Scala, A. The COVID-19 social media infodemic. Sci. Rep. 2020, 10, 16598. [Google Scholar] [CrossRef]
- World Health Organization. An Overview of Infodemic Management during COVID-19, January 2020–May 2021; World Health Organization: Geneva, Switzerland, 2021; p. 52. [Google Scholar]
- Zarocostas, J. How to fight an infodemic. The Lancet 2020, 395, 676. [Google Scholar] [CrossRef]
- Loos, E.; Nijenhuis, J. Consuming Fake News: A Matter of Age? The Perception of Political Fake News Stories in Facebook Ads. In Human Aspects of IT for the Aged Population. Technology and Society; Gao, Q., Zhou, J., Eds.; Springer International Publishing: New York City, NY, USA, 2020; pp. 69–88. [Google Scholar]
- Tandoc, E.C.; Lim, Z.W.; Ling, R. Defining “Fake News”: A typology of scholarly definitions. Digit. J. 2018, 6, 137–153. [Google Scholar] [CrossRef]
- Arif, N.; Al-Jefri, M.; Bizzi, I.H.; Perano, G.B.; Goldman, M.; Haq, I.; Chua, K.L.; Mengozzi, M.; Neunez, M.; Smith, H.; et al. Fake news or weak science? Visibility and characterization of antivaccine webpages returned by Google in different languages and countries. Front. Immunol. 2018, 9, 1215. [Google Scholar]
- Dubé, E.; Laberge, C.; Guay, M.; Bramadat, P.; Roy, R.; Bettinger, J.A. Vaccine hesitancy: An overview. Hum. Vaccines Immunother. 2013, 9, 1763–1773. [Google Scholar] [CrossRef]
- Goldstein, S.; MacDonald, N.E.; Guirguis, S. Health communication and vaccine hesitancy. Vaccine 2015, 33, 4212–4214. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Moran, M.B.; Lucas, M.; Everhart, K.; Morgan, A.; Prickett, E. What makes anti-vaccine websites persuasive? A content analysis of techniques used by anti-vaccine websites to engender anti-vaccine sentiment. J. Commun. Healthc. 2016, 9, 151–163. [Google Scholar]
- Obregon, R.; Chitnis, K.; Morry, C.; Feek, W.; Bates, J.; Galway, M.; Ogden, E. Achieving polio eradication: A review of health communication evidence and lessons learned in India and Pakistan. Bull. World Health Organ. 2009, 87, 624–630. [Google Scholar] [CrossRef]
- Basch, C.H.; MacLean, S.A. A content analysis of HPV related posts on instagram. Hum. Vaccines Immunother. 2019, 15, 1476–1478. [Google Scholar] [CrossRef] [PubMed]
- Ekram, S.; Debiec, K.E.; Pumper, M.A.; Moreno, M.A. Content and commentary: HPV vaccine and YouTube. J. Pediatric Adolesc. Gynecol. 2019, 32, 153–157. [Google Scholar] [CrossRef]
- Gunaratne, K.; Coomes, E.A.; Haghbayan, H. Temporal trends in anti-vaccine discourse on twitter. Vaccine 2019, 37, 4867–4871. [Google Scholar] [CrossRef]
- Puri, N.; Coomes, E.A.; Haghbayan, H.; Gunaratne, K. Social media and vaccine hesitancy: New updates for the era of COVID-19 and globalized infectious diseases. Hum. Vaccines Immunother. 2020, 16, 2586–2593. [Google Scholar] [CrossRef] [PubMed]
- Bruns, A.; Harrington, S.; Hurcombe, E. ‘Corona? 5G? or both?’: The dynamics of COVID-19/5G conspiracy theories on Facebook. Media Int. Aust. Inc. Cult. Policy 2020, 177, 12–29. [Google Scholar]
- Simas, C.; Larson, H.J. Overcoming vaccine hesitancy in low-income and middle-income regions. Nat. Rev. Dis. Primers 2021, 7, 41. [Google Scholar] [CrossRef]
- Endomba, F.T.; Bigna, J.J.; Noubiap, J.J. The impact of social networking services on the coronavirus disease 2019 (COVID-19) pandemic in sub-Saharan Africa. Pan Afr. Med. J. 2020, 35 (Suppl. 2), 67. [Google Scholar] [CrossRef]
- Dotto, C.; Cubbon, S. Disinformation Exports: How Foreign Anti-Vaccine Narratives Reached West. African Communities Online; First Draft News: New York City, NY, USA, 2021. [Google Scholar]
- Demchak, C.C.; Dombrowski, P. Rise of a Cybered Westphalian Age. Strateg. Stud. Q. Ssq 2011, 5, 32–61. [Google Scholar]
- Dryzek, J.S. Global Civil Society: The Progress of Post-Westphalian Politics. Annu. Rev. Political Sci. 2012, 15, 101–119. [Google Scholar] [CrossRef]
- Klos, M. Westphalian Sovereignty and the 4th Industrial Revolution: In Search of Legitimate Governmental Control over Online Content. In Democracy and Globalization: Legal and Political Analysis on the Eve of the 4th Industrial Revolution; Sieber-Gasser, C., Ghibellini, A., Eds.; Springer International Publishing: New York City, NY, USA, 2021; pp. 81–121. [Google Scholar]
- Maher, K.; The New Westphalian Web. Foreign Policy. Available online: https://foreignpolicy.com/2013/02/25/the-new-westphalian-web/ (accessed on 25 February 2013).
- Mansell, R. European Responses to (US) Digital Platform Dominance. In The Routledge Handbook of Digital Media and Globalization; Routledge: Oxfordshire, UK, 2021. [Google Scholar]
- Nocetti, J. Contest and conquest: Russia and global internet governance. Int. Aff. 2015, 91, 111–130. [Google Scholar] [CrossRef]
- Taneja, H.; Wu, A.X. Does the Great Firewall Really Isolate the Chinese? Integrating Access Blockage with Cultural Factors to Explain Web User Behavior. Inf. Soc. 2014, 30, 297–309. [Google Scholar]
- Chalaby, J.K. The rise of Britain’s super-indies: Policy-making in the age of the global media market. Int. Commun. Gaz. 2010, 72, 675–693. [Google Scholar] [CrossRef]
- Elkins, E. Streaming Diplomacy: Netflix’s Domestic Politics and Foreign Policy. In The Routledge Handbook of Digital Media and Globalization; Routledge: Oxfordshire, UK, 2021. [Google Scholar]
- Khalil, M.; Shamsi, Z.; Shabbir, A.; Samad, A. A Comparative Study of Rural Networking Solutions for Global Internet Access. In Proceedings of the 2019 International Conference on Information Science and Communication Technology (ICISCT), Karachi, Pakistan, 9–10 March 2019; pp. 1–5. [Google Scholar]
- Küng, L.; Picard, R.G.; Towse, R. The Internet and the Mass Media; SAGE: Washington, DC, USA, 2008. [Google Scholar]
- Shandler, R.; Canetti, D. A Reality of Vulnerability and Dependence: Internet Access as a Human Right. Isr. Law Rev. 2019, 52, 77–98. [Google Scholar] [CrossRef] [Green Version]
- Barnett, G.A.; Chung, C.J.; Park, H.W. Uncovering Transnational Hyperlink Patterns and Web-Mediated Contents: A New Approach Based on Cracking. com Domain. Soc. Sci. Comput. Rev. 2011, 29, 369–384. [Google Scholar] [CrossRef]
- Hecht, B.; Gergle, D. The Tower of Babel Meets Web 2.0: User-Generated Content and Its Applications in a Multilingual Context. In Proceedings of the SIGCHI Conference on Human Factors in Computing, New York, NY, USA, 10 April 2010; pp. 291–300. [Google Scholar]
- Takhteyev, Y.; Gruzd, A.; Wellman, B. Geography of Twitter networks. Soc. Netw. 2012, 34, 73–81. [Google Scholar] [CrossRef]
- Dor, D. From Englishization to Imposed Multilingualism: Globalization, the Internet, and the Political Economy of the Linguistic Code. Public Cult. 2004, 16, 97–118. [Google Scholar] [CrossRef] [Green Version]
- Hafez, K. The Myth of Media Globalization; Skinner, A., Translator; Polity Press: Cambridge, UK, 2007. [Google Scholar]
- Flew, T.; Waisbord, S. The ongoing significance of national media systems in the context of media globalization. Media Cult. Soc. 2015, 37, 620–636. [Google Scholar] [CrossRef] [Green Version]
- Curran, J. Misunderstanding the Internet/James Curran, Natalie Fenton, and Des. Freedman; Routledge: Oxfordshire, UK, 2012. [Google Scholar]
- Flew, T. Globalization, neo-globalization and post-globalization: The challenge of populism and the return of the national. Glob. Media Commun. 2020, 16, 19–39. [Google Scholar] [CrossRef]
- Schroeder, R. Digital Media and the Globalizing Spread of Populism. In The Routledge Handbook of Digital Media and Globalization; Routledge: Oxfordshire, UK, 2021. [Google Scholar]
- Hall, S. Encoding and Decoding in the Television Discourse. In Essential Essays, Volume 1: Foundations of Cultural Studies; Duke University Press: Durham, NC, USA, 2018; pp. 257–276. [Google Scholar]
- Nowak, J. Internet meme as meaningful discourse: Towards a theory of multiparticipant popular online content. Cent. Eur. J. Commun. 2016, 9, 73–89. [Google Scholar] [CrossRef] [Green Version]
- Benoit, W.L. Persuasive Messages: The Process of Influence; Benoit, W.L., Benoit, P.J., Eds.; Blackwell Publishing: Hoboken, NJ, USA, 2008. [Google Scholar]
- Braddock, K. Weaponized Words: The Strategic Role of Persuasion in Violent Radicalization and Counter-Radicalization; Cambridge University Press: Cambridge, UK, 2020. [Google Scholar]
- Cho, H. Health Communication Message Design: Theory and Practice; Hyunyi, C., Ed.; SAGE Publications: Washington, DC, USA, 2012. [Google Scholar]
- Pérez-Escolar, M.; Ordóñez-Olmedo, E.; Alcaide-Pulido, P. Fact-Checking Skills and Project-Based Learning about Infodemic and Disinformation. Think. Ski. Creat. 2021, 41, 100887. [Google Scholar] [CrossRef]
- Rodriguez-Perez, C.; Paniagua-Rojano, F.J.; Magallon-Rosa, R. Debunking Political Disinformation through Journalists’ Perceptions: An Analysis of Colombia’s Fact-Checking News Practices. Media Commun. 2021, 9, 264–275. [Google Scholar] [CrossRef]
- Wood, T.; Wood, T.; Porter, E.; Porter, E. The Elusive Backfire Effect: Mass Attitudes’ Steadfast Factual Adherence. Political Behav. 2019, 41, 135–163. [Google Scholar] [CrossRef]
- Zimmermann, F.; Kohring, M. Mistrust, Disinforming News, and Vote Choice: A Panel Survey on the Origins and Consequences of Believing Disinformation in the 2017 German Parliamentary Election. Political Commun. 2020, 37, 215–237. [Google Scholar] [CrossRef]
- Guan, T.; Liu, T.; Yuan, R. Facing disinformation: Five methods to counter conspiracy theories amid the COVID-19 pandemic. Comunicar 2021, 29, 67–78. [Google Scholar] [CrossRef]
- Piltch-Loeb, R.; Su, M.; Hughes, B.; Testa, M.; Goldberg, B.; Braddock, K.; Miller-Idriss, C.; Maturo, V.; Savoia, E. (forthcoming). Testing the Efficacy of Attitudinal Inoculation Videos to Enhance COVID-19 Vaccine Confidence. J. Med Internet Res. 2021, in press. [Google Scholar]
- Nemr, C.; Gangware, W. Weapons of Mass Distraction: Foreign State-Sponsored Disinformation in the Digital Age; Park Advisors: Washington, DC, USA, 2019. [Google Scholar]
- Newton, C. The Secret Lives of Facebook Moderators in America; The Verge. Available online: https://web.archive.org/web/20190225135232/https://www.theverge.com/2019/2/25/18229714/cognizant-facebook-content-moderator-interviews-trauma-working-conditions-arizona (accessed on 25 February 2019).
- Roberts, S.T. Behind the Screen: Content Moderation in the Shadows of Social Media; Yale University Press: New Haven, CT, USA, 2019. [Google Scholar]
- Garrett, R.K.; Sude, D.; Riva, P. Toeing the Party Lie: Ostracism Promotes Endorsement of Partisan Election Falsehoods. Political Commun. 2020, 37, 157–172. [Google Scholar] [CrossRef]
- Guess, A.M.; Nyhan, B.; Reifler, J. Exposure to untrustworthy websites in the 2016 US election. Nat. Hum. Behav. 2020, 4, 472–480. [Google Scholar] [CrossRef]
- Adebayo, A.; Davidson Mhonde, R.; DeNicola, N.; Maibach, E. The Effectiveness of Narrative Versus Didactic Information Formats on Pregnant Women’s Knowledge, Risk Perception, Self-Efficacy, and Information Seeking Related to Climate Change Health Risks. Int. J. Environ. Res. Public Health 2020, 17, 6969. [Google Scholar] [CrossRef]
- Kreuter, M.W.; Holmes, K.; Alcaraz, K.; Kalesan, B.; Rath, S.; Richert, M.; McQueen, A.; Caito, N.; Robinson, L.; Clark, E.M. Comparing narrative and informational videos to increase mammography in low-income African American women. Patient Educ. Couns. 2010, 81, S6–S14. [Google Scholar] [CrossRef] [Green Version]
- Liu, S.; Yang, J.Z. The Role of Temporal Distance Perception in Narrative vs. Non-Narrative Persuasion Related to E-Cigarettes. J. Health Commun. 2020, 25, 543–553. [Google Scholar] [CrossRef]
- Murphy, S.T.; Frank, L.B.; Chatterjee, J.S.; Moran, M.B.; Zhao, N.; Amezola de Herrera, P.; Baezconde-Garbanati, L.A. Comparing the Relative Efficacy of Narrative vs Nonnarrative Health Messages in Reducing Health Disparities Using a Randomized Trial. Am. J. Public Health 2015, 105, 2117–2123. [Google Scholar] [CrossRef]
- Attwell, K.; Freeman, M. I Immunise: An evaluation of a values-based campaign to change attitudes and beliefs. Vaccine 2015, 33, 6235–6240. [Google Scholar] [CrossRef] [Green Version]
- Falk, E.; Scholz, C. Persuasion, Influence, and Value: Perspectives from Communication and Social Neuroscience. Annu. Rev. Psychol. 2018, 69, 329–356. [Google Scholar] [CrossRef] [PubMed]
- Bryan, C.J.; Yeager, D.S.; Hinojosa, C.P. A values-alignment intervention protects adolescents from the effects of food marketing. Nat. Hum. Behav. 2019, 3, 596–603. [Google Scholar] [CrossRef]
- Chen, M.; Bell, R.A. A meta-analysis of the impact of point of view on narrative processing and persuasion in health messaging. Psychol. Health 2021, 1–18. [Google Scholar] [CrossRef]
- de Wit, J.B.F.; Das, E.; Vet, R. What Works Best: Objective Statistics or a Personal Testimonial? An Assessment of the Persuasive Effects of Different Types of Message Evidence on Risk Perception. Health Psychol. 2008, 27, 110–115. [Google Scholar]
- Gilkey, M.B.; Grabert, B.K.; Malo, T.L.; Hall, M.E.; Brewer, N.T. Physicians’ rhetorical strategies for motivating HPV vaccination. Soc. Sci. Med. 2020, 266, 113441. [Google Scholar] [CrossRef]
- Ooms, J.; Hoeks, J.; Jansen, C. “Hey, that could be me”: The role of similarity in narrative persuasion. PLoS ONE 2019, 14, e0215359. [Google Scholar] [CrossRef]
- Maertens, R.; Roozenbeek, J.; Basol, M.; van der Linden, S. Long-term effectiveness of inoculation against misinformation: Three longitudinal experiments. J. Exp. Psychol. Appl. 2021, 27, 1–16. [Google Scholar] [CrossRef]
- Mason, A.M.; Miller, C.H. Inoculation message treatments for curbing noncommunicable disease development. Rev. Panam. De Salud Pública 2013, 34, 29–35. [Google Scholar]
- DeCuir-Gunby, J.T.; Marshall, P.L.; McCulloch, A.W. Developing and Using a Codebook for the Analysis of Interview Data: An Example from a Professional Development Research Project. Field Methods 2011, 23, 136–155. [Google Scholar] [CrossRef]
- Hsieh, H.-F.; Shannon, S.E. Three Approaches to Qualitative Content Analysis. Qual. Health Res. 2005, 15, 1277–1288. [Google Scholar] [CrossRef] [PubMed]
- Wernet, A. Hermeneutics and Objective Hermeneutics. In A Companion to Qualitative Research; Flick, U., von Kardorff, E., Steinke, I., Eds.; Jenner, B., Translator; SAGE Publications: Washington, DC, USA, 2004; pp. 234–246. [Google Scholar]
- Cornish, F.; Gillespie, A.; Zittoun, T. Collaborative Analysis of Qualitative Data. In A Companion to Qualitative Research; Flick, U., von Kardorff, E., Steinke, I., Eds.; Jenner, B., Translator; SAGE Publications: Washington, DC, USA, 2008; pp. 79–93. [Google Scholar]
- Lavrakas, P. Intercoder Reliability. In Encyclopedia of Survey Research Methods; SAGE Publications, Inc.: Washington, DC, USA, 2008. [Google Scholar]
- Flick, U.; von Kardorff, E.; Steinke, I. (Eds.) A Companion to Qualitative Research; Jenner, B., Translator; Sage Publications: Washington, DC, USA, 2004; p. 187. [Google Scholar]
- Hughes, B.; Miller-Idriss, C.; Piltch-Loeb, R.; Goldberg, B.; White, K.; Criezis, M.; Savoia, E. Development of a Codebook of Online Anti-Vaccination Rhetoric to Manage COVID-19 Vaccine Misinformation. Int. J. Environ. Res. Public Health 2021, 18, 7556. [Google Scholar] [CrossRef]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2021 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).