Abstract
Guilt appeals in the field of persuasion are quite common. However, the effectiveness of these messages is sometimes ambivalent. It is widely acknowledged that guilt leads people to engage into prosocial behaviors, but the effects of guilt can also be counter-productive (e.g., reactance-like effects). We argue that the explanations for these contradictions remain unsatisfactory and suggest that taking into account the implications of underlying cognitive—especially attentional—mechanisms would provide a better understanding of these paradoxical outcomes. This article provides a brief review of the literature on the link between guilt and pro-social behaviors and its classical interpretations. We propose a reinterpretation of this link by taking into account specific attentional processes triggered by the emotion of guilt. Attentional biases are, in our opinion, better predictors of the effectiveness of a message than the amount of emotion induced by the same message. This consideration should guide future research in the field of guilt appeals and pro-social behaviors. Implications, in terms of a broader comprehension of the emotion–behavior association in decision making processes, are discussed.
A picture depicts an African woman lying in a desert, holding a stylish handbag. A slogan states “Handbag: 32€. Food for a week: 4€”. Another advertisement shows a famished child, with the following statement “He’s starving, we’re not. It’s time to share”. These two examples taken from the 2000s illustrate how persuasion frequently relies on moral emotions and, especially, guilt appeals. Moral emotions can be depicted as emotions “linked to the interests or welfare either of society as a whole or at least of persons other than the judge or the agent” ([1], p. 853). Guilt is often seen as the most prototypical moral emotion [2], and it is repeatedly used in persuasion campaigns for its prosocial consequences. A wide body of research has focused on its definition (i.e., the origin of guilt) and behavioral consequences (i.e., restorative behaviors). However, there is a lack of knowledge regarding the processes linking guilt to prosocial actions. The objective of the present article is to shortly review the sometimes paradoxical effects of guilt on persuasion and to propose alternative explanations based on the investigation of underlying cognitive, especially attentional, processes. Although there are other theoretical frameworks to explain these effects, we limit our paper to the contribution of taking these cognitive processes into account.
2. What Cognitive Processes Are Involved in Guilt Appeals?
The shift from emotion to behavior involves physiological and cognitive intermediate processes. For example, fear is often considered to indicate a danger to the individual and leads to a state of readiness to flee by directing the attention of the person in danger both to the origin of the danger (e.g., a snake) and to escape possibilities, such as a hideout (see [51]). Under this perspective, a large body of research has examined the role of attentional mechanisms associated with emotions (e.g., [52,53,54,55,56]). Other studies have shown that emotions make information relevant to the achievement of a behavior being more “accessible” (e.g., [57,58]). Within this context, the “feeling is for doing” approach (see [43]) argues for a need to be specific when investigating the impact of emotions on decision making. However, the authors also pointed out that the link between emotion and behavior is not enough to understand the specificity of an emotion and that “it is time to move beyond the mere documentation of behavioral results of emotions to direct tests of the proposed mechanism underlying these effects. Although many studies demonstrate congruence between observed decisional effects and emotional goals, this does not conclusively attest for the idea that goal activation as a result of emotional states causes these effects.” ([59], p. 24). In fact, little work has been done to understand the cognitive mechanisms at play in the guilt–prosocial behavior relationship. A better understanding of these processes could also provide a better understanding of the global nature of the relationship between emotions and behavior.
It has been shown that different types of cognitive processing can mediate the emotion–behavior relationship. As highlighted by the “feeling is for doing” approach, the allocation of specific attention modified by the emotional state might represent a relevant candidate to explain the mediation of the emotion–behavior relationship. In other words, attention involves the exclusion or abstraction of certain objects in order to treat others more effectively [60]. Attention is thus a corollary of the inability to process, visually or cognitively, all the information available in one’s environment [61] at one specific moment. Our objective here is not to detail the different components and specificities of attention (for a review, see, for instance, [62]) but to highlight how selective attention can account for paradoxical effects of guilt appeals.
Many studies have highlighted the existence of attentional biases towards negative stimuli or those associated with the notion of threat for people experiencing anxiety [52,53,56]. For example, Mogg and Bradley [53] used an attentional probe task to show that anxiety disorders led to more attention being directed to negative stimuli than depression. These effects may be explained by the need to detect stimuli perceived as threatening more quickly in order to get prepared for fast action (escape). These results were replicated with other tasks, such as the “emotional Stroop test [63]. The literature on attention and anxiety shows a greater allocation of attention to the source of the anxiety feeling. In the context of an action-oriented conception of emotion, it is conceivable that the emotional state is also directed towards the means at disposal to prepare this action (e.g., the possibility to escape for fear). To date, few studies have examined the attention mechanisms specific to social and more complex emotions, such as guilt. Graton and Ric [64] showed that guilt increased attention towards items related to reparation, but this did not imply persuasion messages or real means provided to repair. This attentional selectivity towards the means of performing the action associated with the emotional state may allow for a more accurate interpretation of the behavioral effects of guilt.
As seen above, most studies relying on guilt appeals use fairly similar methodologies: The first part of a message seeks to make the target feel guilty (via a sufficiently strong image or slogan). The second part of the same persuasion message makes it possible to engage in pro-social behavior (donation, involvement in health behavior, etc.) and thus reduce feelings of guilt by “repairing”. The problem with this type of message is that it is difficult to anticipate the risks of backlash and reactance. Meta-analyses showing inverted U-type curves (e.g., [31]) indicate a “threshold of guilt” at which too much emotional feeling causes reactance. However, they do not show the process by which this emotional “saturation” occurs, leading to a large number of persuasive messages that are relatively disappointing in their effects, even though the message intends to induce “little” guilt (see [65]). Another way to address these threshold effects is to take attention into account. Social marketing measurement tools have long been interested in these attentional processes (see [66]), particularly in the area of health and nutrition messages [67]. For example, studies have used eye-tracking techniques (for a review of these techniques, see [68]) to highlight the attentional processes involved in exposure to anti-tobacco campaigns for adolescents [69]. Wedel and Pieters [70] also showed that attention to a prevention message was increased when the number of words in the message was reduced. Oddly enough, attention measurement techniques are rarely used to study the relationships between the emotional state induced by a message and adherence to it. We support the idea that a process such as reactance is not the mere result of “too much guilt”, as can be explained in the current literature, but the result of an interaction between attentional processes activated by the emotional state and the possibility of reparation offered by the message (see, for example, [18]). In other words, it seems more relevant to us to measure the “amount” of attention allocated to a message caused by an emotion rather than the amount of emotion induced by the same message. From this attentional process could come a feeling of cognitive saturation that could lead to rejection of the message (i.e., reactance).
4. Extension to Other Emotions: Mediators of the Emotion–Behavior Relationship
Taking cognitive processes into account as a mediator seems to be a way to better understand the emotion–behavior relationship. In the “feeling is for doing” approach, the transition from emotion to action through intermediate processes, such as attention, remains poorly studied. For example, attentional biases towards aggressive faces have been found for angry people compared to a control group [76] but little research has directly examined an anger-attentional bias towards stimuli related to the attack. This attentional bias towards objects related to aggressiveness (e.g., weapons, verbs such as “attack”, “strike”) could be an intermediate step between anger and aggressive behavioral tendencies. Similarly, emotions like disgust have mainly been studied in terms of increased attention to the source of this emotion (e.g., difficulty to disengage confronting a disgusting face, see [77]). It is, however, imaginable that some behaviors frequently associated with disgust (e.g., object rejection) may be preceded by attentional processes directed at “how” to achieve this behavior (e.g., stimuli representing a “garbage can” or “sink” to get rid of the object causing disgust, see [78]). Here again, “attentional probe” or eye-tracking experiments could highlight a possible attentional bias mediating the relationship between emotion and behavior. In accordance with the “feeling is for doing” theory, studies must now be carried out to better understand the nature of the association between emotion and behavior. We think that a large number of emotionally associated behaviors can potentially be explained by attentional biases directed at objects facilitating the motivated behavior. From this evidence may emerge a better understanding of the emotion–behavior relationship and a more precise use of emotional appeals in social marketing.
5. Conclusions
It has been well established that emotions act as preparation for action (e.g., “feeling is for doing”, see [43]). This emotional–behavioral link is frequently studied in the literature, but the mechanisms underlying it remain poorly understood. As highlighted in the present paper, research has experimentally demonstrated the link between guilt and prosocial behaviors [16,17,19,29], leading to a large number of messages using guilt as a method of persuasion. However, reducing guilt to an emotion systematically leading to restorative actions does not theoretically allow a series of studies showing the imperfection of this guilt–restorative association to be taken into account, especially in the field of persuasion [20,71,79]. We propose the hypothesis that prosocial behavioral tendencies will go along with attentional biases. These biases may, depending on the case, facilitate prosocial behavior or, on the other hand, cause reactance. This consideration of the underlying cognitive processes of attention not only allows for a better interpretation of otherwise ambiguous results (e.g., inverted U-shaped curves, [72]) but also opens new research possibilities. It is the entire chain—source of emotion–cognitive processes–prosocial behavior—that must be taken into account in future research to understand the real role of emotions in fields like persuasion or health communication.
Author Contributions
G.A. contributed in initial conception of the work, drafting the article, revision of the article and final approval of the version to be published. M.M. contributed in drafting the article, critical revision and revision of the article and final approval of the version to be published.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Haidt, J. The moral emotions. In Handbook of Affective Sciences; Davidson, R.J., Scherer, K.R., Goldsmith, H.H., Eds.; Oxford University Press: Oxford, UK, 2003; pp. 852–870. [Google Scholar]
- Tangney, J.P.; Dearing, R. Shame and Guilt; Guilford: New York, NY, USA, 2002. [Google Scholar]
- Frijda, N.H.; Mesquita, B. The social roles and functions of emotions. In Emotion and Culture: Empirical Studies of Mutual Influence; Kitayama, S., Markus, H.R., Eds.; American Psychological Association: Washington, DC, USA, 1994; pp. 51–87. [Google Scholar]
- Keltner, D.; Haidt, J. Social functions of emotions at four levels of analysis. Cogn. Emot. 1999, 13, 505–521. [Google Scholar] [CrossRef]
- Ortony, A.; Clore, G.L.; Collins, A. The Cognitive Structure of Emotions; Cambridge University Press: Cambridge, UK, 1988. [Google Scholar]
- Baumeister, R.F.; Stillwell, A.M.; Heatherton, T.F. Guilt as interpersonal phenomenon. Psychol. Bull. 1994, 115, 243–267. [Google Scholar] [CrossRef] [PubMed]
- Manstead, A.S.R.; Tetlock, P.E.; Manstead, T. Cognitive appraisals and emotional experience: Further evidence. Cogn. Emot. 1989, 3, 225–239. [Google Scholar] [CrossRef]
- Lewis, H.B. Shame and Guilt in Neurosis; International Universities Press: New York, NY, USA, 1971. [Google Scholar]
- Monteith, M.J. Self-regulation of stereotypical responses: Implications for progress in prejudice reduction. J. Personal. Soc. Psychol. 1993, 65, 469–485. [Google Scholar] [CrossRef]
- Twenge, J.M.; Baumeister, R.F.; DeWall, C.N.; Ciarocco, N.J.; Bartels, J.M. Social exclusion decreases prosocial behavior. J. Personal. Soc. Psychol. 2007, 92, 56. [Google Scholar] [CrossRef]
- Smith, A. The Theory of Moral Sentiments; Kincaid, A., Bell, J., Eds.; Oxford University Press: Oxford, UK, 1759. [Google Scholar]
- Carlsmith, J.M.; Gross, A.E. Some effects of guilt on compliance. J. Personal. Soc. Psychol. 1969, 11, 232–239. [Google Scholar] [CrossRef]
- Freedman, J.L.; Wallington, S.A.; Bless, E. Compliance without pressure: The effect of guilt. J. Personal. Soc. Psychol. 1967, 7, 117–124. [Google Scholar] [CrossRef]
- Regan, D.T.; Williams, M.; Sparling, S. Voluntary expiation of guilt: A field experiment. J. Personal. Soc. Psychol. 1972, 24, 42–45. [Google Scholar] [CrossRef]
- Carlson, M.; Miller, N. Explanation of the relation between negative mood and helping. Psychol. Bull. 1987, 102, 91. [Google Scholar] [CrossRef]
- Ketelaar, T.; Au, W.T. The effects of feelings of guilt on the behaviour of uncooperative individuals in repeated social bargaining games: An affect-as-information interpretation of the role of emotion in social interaction. Cogn. Emot. 2003, 17, 429–453. [Google Scholar] [CrossRef]
- De Hooge, I.E.; Zeelenberg, M.; Breugelmans, S.M. Moral sentiments and co-operation: Differential influences of shame and guilt. Cogn. Emot. 2007, 21, 1025–1042. [Google Scholar] [CrossRef]
- Graton, A.; Ric, F.; Gonzalez, E. Reparation or reactance? The influence of guilt on reaction to persuasive communication. J. Exp. Soc. Psychol. 2016, 62, 40–49. [Google Scholar] [CrossRef]
- Nelissen, R.M.A.; Dijker, A.J.M.; de Vries, N.K. How to turn a hawk into a dove and vice versa: Interactions between emotions and goals in a give-some dilemma game. J. Exp. Soc. Psychol. 2007, 43, 280–286. [Google Scholar] [CrossRef]
- Coulter, R.H.; Pinto, M.B. Guilt appeals in advertising: What are their effects? J. Appl. Psychol. 1995, 80, 697–705. [Google Scholar] [CrossRef] [PubMed]
- Alden, D.L.; Crowley, A.E. Sex guilt and receptivity to condom advertising. J. Appl. Soc. Psychol. 1995, 25, 1446–1463. [Google Scholar] [CrossRef]
- Agrawal, N.; Duhachek, A. Emotional compatibility and the effectiveness of antidrinking messages: A defensive processing perspective on shame and guilt. J. Mark. Res. 2010, 47, 263–273. [Google Scholar] [CrossRef]
- Becheur, I.; Dib, H.; Merunka, D.; Valette-Florence, P. Emotions of fear, guilt or shame in anti-alcohol messages: Measuring direct effects on persuasion and the moderating role of sensation seeking. Eur. Adv. Consum. Res. 2008, 8, 99–106. [Google Scholar]
- Baek, T.H.; Yoon, S. Guilt and shame: Environmental message framing effects. J. Advert. 2017, 46, 440–453. [Google Scholar] [CrossRef]
- Chang, C.-T. Are guilt appeals a panacea in green advertising? Int. J. Advert. 2012, 31, 741–771. [Google Scholar] [CrossRef]
- Basil, D.Z.; Ridgway, N.M.; Basil, M.D. Guilt appeals: The mediating effect of responsibility. Psychol. Mark. 2006, 23, 1035–1054. [Google Scholar] [CrossRef]
- Hibbert, S.; Smith, A.; Davies, A.; Ireland, F. Guilt appeals: Persuasion knowledge and charitable giving. Psychol. Mark. 2007, 24, 723–742. [Google Scholar] [CrossRef]
- De Hooge, I.E.; Nelissen, R.M.A.; Breugelmans, S.M.; Zeelenberg, M. What is moral about guilt? Acting ‘prosocially’ at the disadvantage of others. J. Personal. Soc. Psychol. 2011, 100, 462–473. [Google Scholar] [CrossRef]
- Cryder, E.C.; Springer, S.; Morewedge, C.K. Guilty feelings, targeted actions. Personal. Soc. Psychol. Bull. 2012, 38, 607–618. [Google Scholar] [CrossRef]
- Bessarabova, E.; Turner, M.M.; Fink, E.L.; Blustein, N.B. Extending the Theory of Reactance to Guilt Appeals “You Ain’t Guilting Me into Nothin”. J. Psychol. 2015, 223, 215–224. [Google Scholar]
- O’Keefe, D.J. Guilt and social influence. Commun. Yearb. 2000, 23, 67–101. [Google Scholar] [CrossRef]
- Brehm, J.W. Theory of Psychological Reactance; Academic Press: San Diego, CA, USA, 1966. [Google Scholar]
- Brehm, S.S.; Brehm, J.W. Psychological Reactance: A Theory of Freedom and Control; Academic Press: New York, NY, USA, 1981. [Google Scholar]
- Forest, D.; Clark, M.S.; Mills, J.; Isen, A.M. Helping as a function of feeling state and nature of the helping behavior. Motiv. Emot. 1979, 3, 161–169. [Google Scholar] [CrossRef]
- Isen, A.M.; Simmonds, S.F. The effect of feeling good on a helping task that is incompatible with good mood. Soc. Psychol. 1978, 41, 346–349. [Google Scholar] [CrossRef]
- Wicker, F.W.; Payne, G.C.; Morgan, R.D. Participant descriptions of guilt and shame. Motiv. Emot. 1983, 7, 25–39. [Google Scholar] [CrossRef]
- De Hooge, I.E.; Breugelmans, S.M.; Zeelenberg, M. Not so ugly after all: When shame acts as a commitment device. J. Personal. Soc. Psychol. 2008, 95, 933–943. [Google Scholar] [CrossRef]
- Gausel, N.; Leach, C.W.; Vignoles, V.L.; Brown, R. Defend or repair? Explaining responses to in-group moral failure by disentangling feelings of shame, rejection, and inferiority. J. Personal. Soc. Psychol. 2012, 102, 941–960. [Google Scholar] [CrossRef]
- Leach, C.W.; Cidam, A. When is shame linked to constructive approach orientation? A metaanalysis. J. Personal. Soc. Psychol. 2015, 109, 983–1002. [Google Scholar] [CrossRef]
- Schmader, T.; Lickel, B. The approach and avoidance function of guilt and shame emotions: Comparing reactions to self-caused and other-caused wrongdoing. Motiv. Emot. 2006, 30, 43–56. [Google Scholar] [CrossRef]
- Feinberg, M.; Willer, R.; Keltner, D. Flustered and faithful: Embarrassment as a signal of prosociality. J. Personal. Soc. Psychol. 2012, 102, 81–97. [Google Scholar] [CrossRef]
- Zeelenberg, M.; Breugelmans, S.M. The role of interpersonal harm in distinguishing regret from guilt. Emotion 2008, 8, 589–596. [Google Scholar] [CrossRef]
- Zeelenberg, M.; Pieters, R. Feeling is for doing: A pragmatic approach to the study of emotions in economic behavior. In Social Psychology and Economics; DeCremer, D., Zeelenberg, M., Murnighan, J.K., Eds.; Erlbaum: Mahwah, NJ, USA, 2006; pp. 117–137. [Google Scholar]
- Schwarz, N. Feelings-as-information theory. Handb. Theor. Soc. Psychol. 2011, 1, 289–308. [Google Scholar]
- Gouldner, A.W. The norm of reciprocity: A preliminary statement. Am. Sociol. Rev. 1960, 25, 161–178. [Google Scholar] [CrossRef]
- Xu, H.; Begue, L.; Shankland, R. Guilt and guiltlessness: An integrative review. Soc. Personal. Psychol. Compass 2011, 5, 440–457. [Google Scholar] [CrossRef]
- Festinger, L. A Theory of Cognitive Dissonance (Vol. 2); Stanford University Press: Palo Alto, CA, USA, 1962. [Google Scholar]
- Burnett, M.S.; Lunsford, D.A. Conceptualizing guilt in the consumer decision-making process. J. Consum. Mark. 1994, 11, 33–43. [Google Scholar] [CrossRef]
- Ortony, A. Is guilt an emotion? Cogn. Emot. 1987, 1, 283–298. [Google Scholar] [CrossRef]
- Elison, J. Shame and guilt: A hundred years of apples and oranges. New Ideas Psychol. 2005, 23, 5–32. [Google Scholar] [CrossRef]
- Faucher, L.; Tappolet, C. Fear and the focus of attention. Conscious. Emot. 2002, 3, 105–144. [Google Scholar] [CrossRef][Green Version]
- Broadbent, D.; Broadbent, M. Anxiety and Attentional Bias: State and Trait. Cogn. Emot. 1988, 2, 165–183. [Google Scholar] [CrossRef]
- Fox, E. Processing emotional facial expressions: The role of anxiety and awareness. Cogn. Affect. Behav. Neurosci. 2002, 2, 52–63. [Google Scholar] [CrossRef]
- Mansell, W.; Clark, D.M.; Ehlers, A.; Chen, Y.-P. Social Anxiety and Attention away from Emotional Faces. Cogn. Emot. 1999, 13, 673–690. [Google Scholar] [CrossRef]
- Mogg, K.; Bradley, B.P. Attentional Bias in Generalized Anxiety Disorder Versus Depressive Disorder. Cogn. Ther. Res. 2005, 29, 29–45. [Google Scholar] [CrossRef]
- Williams, J.M.G.; Watts, F.N.; MacLeod, C.; Mathews, A. Cognitive Psychology and Emotional Disorders; John Wiley & Sons: Chichester, NH, USA, 1988. [Google Scholar]
- Challis, B.H.; Krane, R.V. Mood induction and the priming of semantic memory in a lexical decision task: Asymmetric effects of elation and depression. Bull. Psychon. Soc. 1988, 26, 309–312. [Google Scholar] [CrossRef]
- Ferraro, F.R.; King, B.; Ronning, B.; Pekarski, K.; Risan, J. Effects of induced emotional state on lexical processing in younger and older adults. J. Psychol. 2003, 137, 262–272. [Google Scholar] [CrossRef]
- Zeelenberg, M.; Nelissen, R.M.; Breugelmans, S.M.; Pieters, R. On emotion specificity in decision making: Why feeling is for doing. Judgm. Decis. Mak. 2008, 3, 18–27. [Google Scholar]
- Treisman, A.M. Contextual cues in selective listening. Q. J. Exp. Psychol. 1960, 12, 242–248. [Google Scholar] [CrossRef]
- Broadbent, D.E. Perception and Communication; Pergamon Press: New York, NY, USA, 1958. [Google Scholar]
- Maquestiaux, F. Psychology of Attention; De Boeck: Brussels, Belgium, 2013. [Google Scholar]
- MacLeod, C.; Rutherford, E.M. Anxiety and the selective processing of emotional information: Mediating roles of awareness, trait and state variables, and personal relevance of stimuli. Behav. Res. Ther. 1992, 30, 479–491. [Google Scholar] [CrossRef]
- Graton, A.; Ric, F. How guilt leads to reparation? Exploring the processes underlying the effects of guilt. Motiv. Emot. 2017, 41, 343–352. [Google Scholar] [CrossRef]
- Perloff, R.M. The Dynamics of Persuasion: Communication and Attitudes in the Twenty-First Century; Routledge: New York, NY, USA, 2016. [Google Scholar]
- Nixon, H.K. Attention and Interest in Advertising (No. 72); Columbia University: New York, NY, USA, 1924. [Google Scholar]
- Wedel, M.; Pieters, R. Eye tracking for visual marketing. Found. Trends Mark. 2008, 1, 231–320. [Google Scholar] [CrossRef]
- Pieters, R.; Wedel, M. A review of eye-tracking research in marketing. In Review of Marketing Research; Routledge: Abingdon, UK, 2017; pp. 143–167. [Google Scholar]
- Krugman, D.M.; Fox, R.J.; Fletcher, J.E.; Fischer, P.M.; Rojas, T.H. Do adolescents attend to warnings in cigarette advertising? An eye-tracking approach. J. Advert. Res. 1994, 34, 39–52. [Google Scholar]
- Wedel, M.; Pieters, R. Eye fixations on advertisements and memory for brands: A model and findings. Mark. Sci. 2000, 19, 297–312. [Google Scholar] [CrossRef]
- Cotte, J.; Coulter, R.A.; Moore, M. Enhancing or disrupting guilt: The role of ad credibility and perceived manipulative intent. J. Bus. Res. 2005, 58, 361–368. [Google Scholar] [CrossRef]
- O’Keefe, D.J. Guilt as a mechanism of persuasion. In The Persuasion Handbook: Developments in Theory and Practice; Dillard, J.P., Pfau, M., Eds.; Sage: Thousand Oaks, CA, USA, 2002; pp. 329–344. [Google Scholar]
- Lickel, B.; Schmader, T.; Curtis, M.; Scarnier, M.; Ames, D.R. Vicarious shame and guilt. Group Process. Intergroup Relat. 2005, 8, 145–157. [Google Scholar] [CrossRef]
- Nathanson, D.L. Shame and Pride: Affect, Sex, and the Birth of the Self; Norton: New York, NY, USA, 1992. [Google Scholar]
- Elison, J.; Lennon, R.; Pulos, S. Investigating the compass of shame: The development of the Compass of Shame Scale. Soc. Behav. Personal. Int. J. 2006, 34, 221–238. [Google Scholar] [CrossRef]
- Honk, J.V.; Tuiten, A.; de Haan, E.; vann de Hout, M.; Stam, H. Attentional biases for angry faces: Relationships to trait anger and anxiety. Cogn. Emot. 2001, 15, 279–297. [Google Scholar] [CrossRef]
- Cisler, J.M.; Olatunji, B.O.; Lohr, J.M.; Williams, N.L. Attentional bias differences between fear and disgust: Implications for the role of disgust in disgust-related anxiety disorders. Cogn. Emot. 2009, 23, 675–687. [Google Scholar] [CrossRef]
- Vogt, J.; Lozo, L.; Koster, E.H.; De Houwer, J. On the role of goal relevance in emotional attention: Disgust evokes early attention to cleanliness. Cogn. Emot. 2011, 25, 466–477. [Google Scholar] [CrossRef]
- O’Keefe, D.J. Message properties, mediating states, and manipulation checks: Claims, evidence, and data analysis in experimental persuasive message effects research. Commun. Theory 2003, 13, 251–274. [Google Scholar] [CrossRef]
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).