Next Article in Journal
Analysis of the Anti-Vaccine Movement in Social Networks: A Systematic Review
Previous Article in Journal
The Association between Body Mass Index and Physical Fitness of Normal Weight/Overweight/Obese University Students
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Role of Negative Emotions Pre- and Post-Implementation of Graphic Health Warnings: Longitudinal Evidence from South Korea

1
Business School, Korea University, Seoul 02841, Korea
2
Dongguk Business School, Dongguk University, Seoul 04620, Korea
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(15), 5393; https://doi.org/10.3390/ijerph17155393
Submission received: 22 May 2020 / Revised: 22 July 2020 / Accepted: 23 July 2020 / Published: 27 July 2020

Abstract

:
This longitudinal study investigated the factors that determine the effectiveness of graphic health warnings (GHWs) by comparing 246 South Korean smoker’s responses before and after the introduction of the country’s new tobacco control policy wherein GHWs were placed on all cigarette packaging. Even though introducing GHWs did not cause immediate changes in smokers’ intention to quit smoking or perception of smoking’s health risk, GHWs eventually motivated smokers to quit smoking when they experienced negative emotional responses to the newly introduced graphic warnings on cigarette packaging. More importantly, this study found that positive changes in smokers’ perceived risk associated with smoking due to the introduction of GHWs mediated a positive relationship between changes in smokers’ negative emotions (NE) from text-only warnings to graphic warnings and changes in their intention to quit smoking during the same period. Based on these results, the authors suggest that, for GHW policy to be more effective in motivating smoking cessation, the warnings need to convey images sufficiently unpleasant to induce negative emotional responses among smokers.

Graphical Abstract

1. Introduction

Smoking is a well-known cause of preventable premature deaths [1] and public health risk. In 2015, the daily smoking rate of adult males in South Korea was 31.4%, which was one of the top countries in terms of the smoking rate among the 36 member countries of the Organization for Economic Cooperation and Development (OECD) [2]. The estimated cost of smoking prevalence in South Korea was approximately 1% of the country’s gross domestic product (GDP) [3]. On 23 December 2016, South Korea introduced their graphic health warning (GHW) anti-tobacco campaign. They unveiled 10 full-color pictorials along with text warnings that are mandated to cover at least 50% (i.e., 30% graphic and 20% text) of the front side of every cigarette pack (see Supplementary Table S1). Before GHWs were introduced, cigarette packs carried text warnings that covered only 20% of the pack’s front side. Ever since Iceland implemented black and white picture warnings in 1986, many countries, including Canada, Singapore, and Taiwan, have officially implemented GHWs on tobacco packaging, now in full color, as an effective tool to reduce national smoking rates [4,5]. The South Korean government expected that this policy would help to reduce the country’s smoking rates to the OECD member countries’ average smoking rate of 29% by 2020 [6].
Although many studies have examined the impact of various interventions on reduction in smoking and expansion of health consciousness, to the best of the authors’ knowledge, little research has directly examined why GHWs are effective in persuading smokers to quit. We focused on the role of negative emotions (NE) in activating the effects of GHWs on persuasion. Prior studies have suggested that people experience negative emotions when they view GHWs on tobacco packaging [7,8,9]. Negative emotions affect human cognitive activity and behaviors such as judgment, decision-making, and attitude [10,11]. We suggest that changes in negative emotional responses caused by viewing GHWs might increase their perception of the health risk of smoking, thereby persuading them to cease smoking. This research tests the prediction by means of a longitudinal study that was conducted during the introductory period of a new regulation requiring GHWs to appear on all cigarette packs sold in South Korea.
We conducted a quasi-experimental panel study, with individual panels held approximately one year apart, to estimate the effectiveness of GHW introduction—the national transformation of text-only warnings into graphic health warnings on cigarette packs in South Korea. The purpose of conducting this study was twofold: (1) to assess changes in smoker emotions, perceived smoking risk, and quitting behaviors before and after the introduction of GHW policy and (2) to understand the underlying mechanism of the effect of GHWs’ introduction on smokers’ quitting behavior.
Ethical approval for this study was granted by the Ethics Committee of Gachon University (project identification code: 1044396-201612-HR-094-01.)

2. Literature Review and Hypothesis Development

2.1. Various Interventions in Tobacco Control

Many countries take comprehensive interventions trying to reduce demand for tobacco products combining pricing (increasing price and tax of cigarettes) and non-pricing policies (smoking bans in public places, text and graphic health warnings, smoking cessation services, advertising regulations etc.) following the World Health Organization’s (WHO) recommendations [12]. First, cigarette price increases through higher taxation is considered to be one of the most effective strategies to reduce tobacco use and to motivate smoking cessation [13,14,15]. According to the World Bank [16], when the price of cigarettes was raised by 10%, tobacco consumption decreased by 4% in high-income countries, 8% in mid-to low-income countries, and the smoking rates has decreased by 2% and 4%, respectively. Second, non-pricing strategies including smoking bans in public places pursuits to reduce the smokers’ temptation as well as the public’s exposures to smoking. As the risks of second-hand smoke have been scientifically proven, countries have set and expanded non-smoking areas in accordance with the WHO Framework Convention on Tobacco Control’s guidelines [13]. Zhou et al. [17] showed that the implementations of this policy significantly impacts smoking cessation by a systematic review. They found that the higher the smoker’s dependence on nicotine and the less knowledge he or she has about tobacco, the more negative attitude one has toward tobacco policy and the policy of non-smoking areas is less effective. Bans on advertising, promoting and sponsorship of tobacco have the same purpose on tobacco control. Saffer and Chaloupka [18] found, by investigating the effect of tobacco advertising bans on tobacco consumption among 22 OECD countries. Most countries, especially developing countries, where anti-smoking policies were effective have used a comprehensive set of policies together rather than implementing only a specific single policy [18,19].
In similar vein, the combined use of strategies was effective in South Korea. In 2015, the Korean government increased the retail price of cigarettes, mainly due to higher taxation, about 80% higher than the previous price after a 10-year price freeze. The combination of this pricing policy with non-pricing policies such as an expansion of smoking-free areas from public places to insides of any buildings, restaurants, bars, and coffee shops increased smoking cessation from 7.2–9.9% [20].

2.2. Smoker Responses to the Implementation of Graphic Health Warning (GHW) Policy

As a second wave of tobacco control at the end of 2016, the South Korean government enforced mandatory GHWs on every cigarette pack sold which is known as one of the non-pricing strategies to reduce demand for tobacco products. Many studies have found evidence both for and against the effectiveness of GHWs. The predominant stream of research found evidence to support the assertion that GHWs are more effective in promoting smoking cessation than text-only warnings. The direct visual depiction of harmful health consequences (e.g., smoking-related throat cancer, skin discoloration, loss of lung function) causes smokers to pay more attention to warnings [21], prompts stronger cognitive and emotional reactions [22,23], increases smokers’ intention to quit (IQ) [24], increases non-smokers’ intention to avoid smoking [25,26], and generally reduces smoking behaviors [27]. Interestingly, many of the studies demonstrated that smoking rates were reduced in countries which implemented GHW policy, such as China, Canada, and the Netherlands [8,24,26,27,28,29]. However, another stream of research has reported that graphic warnings led to strong feelings of being threatened and maladaptive responses in smokers, with a range of effects including discounting the messages [30], displaying psychological reactance [31], and increasing intent to smoke [32]. ]. It is noticeable that no effect or negative effects from GHWs found in studies conducted in countries that had not yet adopted GHW policy such as the United States (US) [31,32]. For example, studies by Hammond et al. [28] and Sabbane et al. [32] demonstrated that GHWs worked well in Canada, but not as well in the US. However, Evans et al. [23] investigated US university students by establishing an environment in which they were naturally exposed to GHWs for four weeks and eventually discovered positive effects.
Based on such evidence, we suggest that GHWs will increase a smoker’s intent to quit smoking, negative emotions, and perception of smoking-related health risk when repeatedly exposed to GHWs. First, we propose that the introductions of GHWs might increase smokers’ intent to quit smoking. Most evidence that does not support GHWs’ positive effect on intent to quit is derived from experimental studies of countries in which GHW regulations had not yet been implemented. In such studies, research panels were asked questions about attitude and intent to quit after a one-time exposure to strong GHWs that may induce hostility. This experimental setting might be quite different from more realistic contexts in which individuals are exposed and react to GHWs. Cognitive reactance, the most common psychological mechanism explaining the boomerang effect of GHWs on smoking cessation, could be a smoker’s immediate response to a GHW to avoid the negative feelings induced by its graphic imagery. The acute and immediate response of avoidance due to the negative feelings aroused by GHWs might wane if smokers were repeatedly exposed to strong graphic images in everyday life. Indeed, Gibson et al. [33] found that a one-time exposure to strong graphic warnings in a laboratory setting was more effective than text warnings in increasing negative emotional responses in smokers but were not sufficient to increase their intent to quit. Their findings hinted at the possibility that the negative emotions produced by strong reactance were not enduring and were ultimately reduced in a real-world setting.
Second, we expect smokers to experience negative emotions when exposed to GHWs after the introduction of the policy. Graphic warnings were more effective in inducing emotional arousal [24,34] because the graphics depicted smoking-related diseases and damaged body organs by means of strong and sensational imagery [35]. GHWs have been shown to elicit negative emotions such as fear, disgust, worry, and guilt [7,8,9]. For example, Hammond et al. [8] discovered that GHWs elicited fear and disgust and examined the relationship between such emotions and quitting smoking. Netemeyer et al. [9] reported that when exposed to GHWs, smokers more often experienced disgust than non-smokers. In addition, they found that guilt can be elicited by GHWs. Therefore, we predict that the implementation of GHW policy might induce negative emotional responses in smokers.
Third, we suggest that smokers might realize the health risk of smoking from GHWs and feel vulnerable to these risks after the policy’s introduction. White et al. [36] discovered that GHWs increased the perceived risk of smoking (PRS) among Australian adolescents by comparing students before and after the introduction of the new GHWs. Hammond et al. [28] examined differences in the effectiveness of GHWs between four countries, namely, Canada, the United Kingdom (UK), Australia, and the US, between 2002–2005. They found that in Canada, where GHW policy had already been implemented for almost 20 years, smokers thought more about their health risk from smoking than smokers in the US, a country that uses text-only warnings. Interestingly, during the study period (i.e., in 2002) of the Hammond study, the UK introduced GHWs and it was found that British smokers considered health risk more seriously after the implementation of GHW policy than they did previously. Such results imply the existence of a linear relationship between time and GHWs’ effect on the perceived risk of smoking. Therefore, we suggest that the introduction of GHWs might enable smokers to realize the hazards of smoking to their health.
Hypothesis 1 (H1).
Smokers’ intent to quit is higher after the introduction of GHWs than before.
Hypothesis 2 (H2).
Smokers’ negative emotions are higher after the introduction of GHWs than before.
Hypothesis 3 (H3).
Smokers’ perceived risk associated with smoking is higher after the introduction of GHWs than before.

2.3. Negative Emotions, Perceived Smoking Risk, and Intent to Quit

GHWs elicit a greater level of negative emotion than text-only warnings [24,34] and induce various negative emotions including fear, disgust, worry, and guilt [7,8,9]. However, previous research has reported mixed findings, documenting both positive [8,37] and negative effects of this negative emotional response on quitting smoking [34,38,39]. Noticeably, those studies that reported supportive evidence were conducted in Canada many years after GHW policy was implemented. In other words, positive effect of the negative emotional responses to GHWs effect on quitting smoking could be valid only in cases in which smokers are repetitively exposed to GHWs in their daily lives [37]. Therefore, we predict that negative emotions from GHWs could have a dual impact with respect to time—negative emotional responses might not change smoker attitudes and smoking behavior in the short term, but, in the long term, repeated exposure to GHWs might eventually promote attempts to quit smoking. In other words, we focus on negative emotions as an important factor activating the effect of GHWs, but the effect is expected to take a certain length of time to appear. To test our predictions, we investigated how the GHWs’ introduction affected smoker emotions and how their emotions were associated with perceived risk of smoking and quitting behavior by comparing South Korean smokers’ reactions pre- and post-introduction of GHWs.
Negative emotions serve a dual role: as information and as a motivation [34,38,39]. The “affect-as-information” model states that people use negative feelings associated with a target to evaluate a target negatively [39]. In terms of this informational view, smokers often rely on their feelings as a source of judgement rather than deliberately evaluating the target’s objective features or attributes. In turn, these feelings affect their decision-making and behavior [40]. On the other hand, smokers could appraise the potential hazards of smoking in a more systematic way by using scientific realism when in a negative mood while they could be quite optimistic about estimating the possible hazards of smoking that might apply to themselves in a normal mood [41,42]. When exposed to GHWs stimuli, smokers might experience negative emotions that have a dual role. On the one hand, they might lead to the development of reactance if a smoker experiences an especially intense negative emotional response such as anger. In this case, the consequences might be rather counterproductive. However, a strong, acute, and intense negative emotional response does not last long enough to have a maximal effect, so when GHWs are implemented, repeated daily exposure to GHWs might eventually reduce reactance in smokers. Similar findings were reported by Cho et al. [37].
We suggest that the negative feelings aroused by GHWs might affect smokers’ recognition of the health risk associated with smoking to be more severe for two reasons. First, in line with the literature, intense negative emotions would act as information to make smokers to avoid or ignore GHWs immediately while less intense i.e., moderate to weak negative emotional responses might lead smokers to systematically elaborate about smoking hazards. Therefore, it might be helpful to increase the number of attempts to quit smoking by voluntarily finding additional reasons to avoid cigarettes. Second, when people experience negative emotions that are associated with a certain product or activity, they tend to evaluate the cigarettes or the activity of smoking negatively and perceive the associated risk to be more important and, accordingly, the associated benefits to be less important [43]. Evans et al. [23] found that GHWs caused negative emotional responses that increased perception of the risk of smoking. In addition, Netemeyer et al. [9] showed that the fear elicited by GHWs mediated the relationship between GHWs and adolescent smokers’ current consideration of smoking. The more frightened those adolescent smokers became when exposed to GHWs, the more they reflected on the consequences of their own smoking, such as the negative health effects of smoking on themselves and others. The results of this study imply that negative emotions from GHWs might motivate smokers to perceive the risk of smoking through a more realistic lens and consequently increase their perception of the risk of smoking. Therefore, due to GHWs’ introduction, the negative emotional responses from repeated exposures to GHWs might increase Korean smokers’ recognition of the risk associated with smoking.
Hypothesis 4 (H4).
Before and after GHWs introduction, changes in negative emotions are positively related to changes in perceived health risks of smoking.
Next, we suggest that changes in negative emotions and perceived smoking risk might play a critical role in producing behavioral changes in smokers after GHW policy is introduced. Evidence supports a positive relationship between negative emotions and intent to quit smoking [9,24]. Kees et al. [24] reported a mediating role of fear between GHWs and intent to quit smoking. By analyzing the mediating effect of fear, disgust, and guilt in the relationship, Netemeyer et al. [9] showed that fear performs mainly a mediating role. However, worry also mediated GHWs’ effect [22]. In addition, neurological studies showed that, among smokers, more emotionally arousing pictorial warnings caused a stronger activation of the brain regions associated with decision-making and memory formation [44,45]. As found in functional magnetic resonance imaging (fMRI) research on smoking cessation advertisements [46], strong brain activation prompted by graphic cigarette warnings predicts a decrease in smoking [47]. These studies focused on the negative emotions elicited by GHWs and confirmed their mediating effects.
Based on previous studies that established that a variety of negative emotions are critical variables, we suggest that the overall negative emotion elicited by GHWs’ introduction affects smokers’ intent to quit smoking.
Hypothesis 5 (H5).
Before and after GHWs introduction, changes in negative emotions are related to changes in intent to quit.
Several studies have noticed the dual function of negative emotions: informational as well as motivational [39,48]. People often diagnose their current situation as being problematic when they experience negative emotions and, at the same time, the negative emotions stimulate analytical processing to solve the problem [39]. The cognition most associated with negative emotions is risk perception [48,49]. Since the perception of risk would be amplified by fear [49], negative emotions lead people to perceive the hazards of smoking and estimated risk associated with smoking [22,23]. Based on the role of analytical thinking, negative emotions elicited by GHWs might induce motivation to contemplate the maladaptive consequences of smoking. Similarly, the extended parallel process model [50] emphasized the estimated threat as a critical determinant of changing behavior in order for advertisements using fear appeal to be effective. When people more intensely perceive risk after viewing fear-appeal advertising, their behavior changes. In addition, in some experimental studies with self-reported measures, negative affective reactions provoked by warnings cued further processing of warning information and ultimately, motivated smoking cessation [23,38]. Indeed, some studies found a dual mediating role of negative emotions and risk perception of GHWs’ effect on smokers’ intent to quit [7,22,23,24]. Emery et al. [22] showed that GHWs have a positive effect on intent to quit smoking by means of increasing worry as well as risk perception.
In line with the preceding rationale, we suggest that the perceived changes of risk level after GHWs introduction would mediate the effect of negative emotions on smoker intent to quit smoking.
Hypothesis 6 (H6).
Both before and after GHWs’ introduction, perceived risk associated with smoking mediates the effect of negative emotions on intent to quit.

3. Methods

3.1. Procedure and Panels

Only current smokers were eligible to participate in the surveys. The International Tobacco Control (ITC) survey [51] used three criteria to classify individuals as smokers: if they had smoked more than 100 cigarettes (i.e., five packs) over their lifetimes; if they had smoked more than once during the preceding month; and if they were over 19 years of age. Smokers were recruited to participate in two opt-in panel surveys—one before and one after the legal implementation of GHWs—conducted by a marketing research company in Korea. The pre-introduction survey was conducted with 368 smokers during the first week of December 2016 (05.12.2016–11.12.2016). The introduction of GHWs began on 23 December 2016, but it took two or three months for cigarette packaging with GHWs to be fully available at local retailers throughout the country.
All panels were adult smokers over 20 years old who had smoked more than 100 cigarettes in their lifetime. The majority (84.1%) of respondents reported that they had last smoked within the preceding 24 h; 10.6% of participants had smoked between the preceding 24 h and the preceding week, and 5.3% had smoked between the preceding week and the preceding month.
The sample was recruited from different age groups and regions, and only those who participated in both the pre- and post-introduction surveys were analyzed for the study. Of the pre-introduction participants, only 246 returned to take part in the second survey that was conducted during the first week of October 2017 (02.10.2017–08.10.2017) (i.e., a return rate of 66.85%). We analyzed 246 pieces of data of those who participated in both surveys. We stratified the sample by age—the average age was 40.48 with a standard deviation (SD) of 10.88–19.5% of the sample in their 20s, 25.2% in their 30s, 28.0% in their 40s, and 27.2% in their 50s, as well as by gender (52.8% men, 47.2% women). The majority of the respondents were city dwellers (96.7%). They spent about 163 dollars ($) (equivalent to 174,100 won) per month on cigarettes purchases that accounted for 3.91% of their average monthly earnings ($4160, or 4.45 million won). On average, they smoked 11.34 cigarettes per day. Most respondents (i.e., 65.4%) considered themselves to be addicted to smoking and only 6.5% said that they were not addicted. In support of this, 57.3% of the survey participants reported that they had smoked every day during the preceding month.

3.2. Measures

Each participant in this study was invited to take part in the online survey twice: one month before the introduction of GHWs (i.e., pre-introduction) and 10 months after their introduction (i.e., post-introduction). The research firm sent email invitations with individual survey links to track responses.

3.2.1. Negative Emotions (NE)

The extent of six negative emotions —worry, guilt, disgust, sadness, regret, and anger—from the current warnings on cigarette packaging were assessed with the items adapted from Gibson et al. [33]. We used the same questions for both the pre- and post-introduction surveys but, due to the study design, the targets that these items measured differed: they were text-only warnings at the pre-introduction survey and GHWs at the post-introduction survey. Each item was judged using a seven-point Likert scale, with anchors of one (least likely to feel) to seven (most likely to feel). The summed scores produced satisfactory Cronbach’s alpha coefficients for both surveys: text-only warnings during the pre-introduction period (α = 0.91) and GHWs during the post-introduction period (α = 0.95).

3.2.2. Perceived Risk of Smoking (PRS)

A panel of participants used a seven-point Likert scale ranging from one (strongly disagree) to seven (strongly agree) to indicate the extent to which they agreed with two statements to measure perception of the health risk of cigarette smoking: (1) smoking is harmful to health (e.g., severity) and (2) smokers’ probability of death is much higher than that of non-smokers (e.g., vulnerability). These values were summed to calculate a pre-introduction perceived risk score (α = 0.78) and a post-introduction perceived risk score (α = 0.84).

3.2.3. Intent to Quit Smoking (IQ)

A two-item scale was used to assess the degree to which a panel of participants was willing to quit smoking [52]. The participants used a seven-point Likert scale ranging from one (extremely unlikely) to seven (extremely likely) to indicate the degree to which they might make a plan to quit smoking within the next month or within the next six months. The items were summed, rather than averaged, to create, for each participant, a total pre-introduction score (α = 0.80) and post- introduction score (α = 0.81) since the two items were significantly correlated at a 5% significance level (r = 0.67 for pre-introduction and r = 0.69 for post-introduction).

4. Results

4.1. Attrition Analysis

To detect attrition bias caused by extinction of 122 participants (from 368 in the pre-introduction survey to 246 in the post-introduction survey), we conducted t tests to compare those subjects responding to pre- and post-introduction surveys with those responding to only the pre-introduction survey. There were no significant differences in the means of primary variables of the study such as pre-NE (t = −1.85, p > 0.05), pre−PRS (t = −0.47, p > 0.05), pre-IQ (t = −0.32, p > 0.05), average number of cigarettes per day (t = 1.79, p > 0.05) and sex (chi-square = 3.409, p > 0.05). However, only age difference was significant (t = −2.08, p < 0.05). The average age of participants only in pre-introduction survey (37.95 years old) was 2.52 years lower than that of participants in both surveys (40.48 years old). Cross tabulation analysis of drop-out and no drop-out groups and age groups showed that participants in their 20s (44.8%) dropped out relatively more than 30 s (32.6%), 40 s (25.8%), and 50 s (30.2%). To examine the difference between 20 s drop-outs and 20s non-dropouts, we conducted t tests on key variables. No significant differences were found in pre-NE (t = −0.39, p > 0.05), pre-PRS (t = 0.78, p > 0.05), pre-IQ (t = −0.46, p > 0.05). While attrition was not random with age, it was not related to the primary variables on which this study focuses. Overall, the results indicated no evidence of attribution bias in this study.

4.2. Pre-Introduction and Post-Introduction Differences in Negative Emotions, Subjective Risk, and Intent to Quit Smoking: H1, H2 and H3

A series of paired two-sample t tests was conducted to compare differences in the negative emotional responses to type of warning, perceived risk of smoking, and intent to quit smoking pre- and post-introduction of GHWs. As shown in Table 1, negative emotions increased significantly from a mean score of 3.84 (SD = 1.40) for the pre-introduction survey to a mean score of 4.50 (SD = 1.27) for the post-introduction survey (t (245) = −7.54, p <.001). However, neither mean values changed for the perceived risk of smoking (pre-introduction M = 5.35 (SD = 1.20) vs. post-introduction M = 5.30 (SD = 1.23); t (245) = 0.59, p = 0.55) nor for intent to quit smoking (pre-introduction M = 3.02 (SD = 1.11) vs. post-introduction M = 2.96 (SD = 1.12); t (245) = 0.87, p = 0.38) which showed a statistically significant difference due to the introduction of GHWs. Thus, the prediction for the change in negative emotions due to GHWs’ introduction, Hypothesis 2, was supported, but the other hypotheses were not.
The findings show that respondents were indeed frightened or felt uncomfortable after the GHWs were introduced. However, the introduction of GHWs did not have an impact on respondents’ tendency to give them more thought or change their willingness to quit smoking.

4.3. Testing the Longitudinal Hypotheses: H4 and H5

A simple regression analysis was used to test the longitudinal association between the positive mean changes in negative emotions between text-only and graphic warnings on cigarette packs (∆NE) and the increased level of perceived health risk associated with smoking (∆PRS) during the same period. The results indicated that changes of negative emotions significantly predicted changes of perceived risk of smoking (β = 0.17, t = 2.75, p < 0.05). In addition, we entered pre-introduction perceived risk of smoking (pre-PRS) and pre-introduction negative emotional responses to text warnings (pre-NE) as control variables to the first regression model. The results indicate that the effect of respondents’ negative emotional changes on their risk perception changes became larger (β = 0.36, t = 5.37, p < 0.001) after controlling for the pre-introduction effect of negative emotions toward text-only warnings (t = 3.66, p < 0.001) and pre-introduction perceived risk of smoking (t = −9.47, p < 0.001; see Table 2). This evidence confirms Hypothesis 4.
The similar procedure of analysis was conducted to test Hypothesis 5. The results showed that the changes of negative emotions toward cigarette package warning between pre- and post-introduction of GHWs was significantly associated with the changes of intention to quit in both the simple regression (β = 0.12, t = 2.79, p < 0.05) and the multiple regression (β = 0.19, t = 2.79, p < 0.05) conditions. Thus, Hypothesis 5 was supported. Details of these results are shown in Table 2.
These findings demonstrate that participants perceived a higher level of health risk of smoking since they experienced more negative emotions from GHWs over time. The increased level of negative emotional responses also longitudinally increased respondents’ intentions to quit smoking.

4.4. Testing the Mediation Hypothesis: H6

We predicted that the influence of enhanced negative emotional response on increased level of quitting intention would be mediated by changes in the perceived level of smoking risk before and after GHWs were introduced. To test mediating effect, we conducted Hayes’ PROCESS macro model 4 with ∆IQ as a dependent variable, ∆NE as an independent variable, and ∆PRS as a mediating variable. Recently in area of psychology research, this PPOCESS macro model based on the bootstrapping test has been widely used for the mediation effect as a better way to supplement the limitations of Baron and Kenny’s mediation analysis [53]. As shown as Figure 1, a bootstrap analysis [54] revealed that the increased level of perceived smoking risk mediated the association between mean changes in negative emotions and mean changes in intent to quit (indirect effect = 0.024, SE = 0.013, 95% CI = (0.005, 0.054)). The direct effect between mean changes in negative emotions and mean changes in intent to quit was not significant (direct effect = 0.068, SE = 0.047, 95% CI = (−0.025, 0.161)).
These findings show that, despite the insignificant direct association, participants reported an increased intention to quit smoking when they experienced a more negative emotional response from the newly introduced GHWs because they perceived a higher risk associated with smoking than before their introduction.

5. Discussion

This study investigated two issues related to the introduction of GHW policy in South Korea. The first issue was whether mandatory GHWs would change smokers’ emotions, perception of risk, and intention to quit immediately or after the passage of a certain time. The second issue concerned testing the mediating role of elaborated thought about smoking risk due to the negative emotions generated by GHWs and the effect of the policy’s introduction on quitting attempts among adult cigarette smokers.
This longitudinal study, which compares variables before and after the implementation of GHWs in South Korea, demonstrated that GHWs’ introduction had a direct influence on negative emotions. This supports previous research findings that graphic warnings elicit negative emotional responses [24,55]. However, there were no direct effects of GHWs’ introduction on smokers’ intent to quit or smoking risk perception, which differs from the results in previous studies. Longitudinal studies conducted in countries that had previously implemented GHW policy found that GHWs directly affect smoker perception of risk [28,36] and intent to quit smoking [8,24,26,27,28]. However, in this study, the negative emotions elicited because of repeated exposure to GHWs indirectly increased smoker intent to quit by means of GHWs’ higher level of perception of smoking risk. When exposed to a cigarette pack every day after the GHW policy’s introduction, smokers’ negative emotions toward the graphic warnings might be accompanied by a presumably more accurate estimate of smoking risk than previously, which mediates the direct relationship between GHWs’ introduction and intent to quit smoking. Although GHWs’ introduction did not directly increase intent to quit smoking, it increased negative emotional responses that caused smokers to be more vividly aware of their own vulnerability to the potential risk of smoking. Noticeably, these negative feelings were powerful enough to directly influence smokers’ intent to quit. These emotional and perceptual changes caused by repeated exposure to GHWs in daily life might promote self-directed and voluntary behavioral changes to conform to GHWs’ persuasive messages. In other words, GHWs’ introduction was effective in motivating smokers to accept the graphic warnings’ information and persuading smokers to voluntarily cease smoking.

6. Conclusions

This study contributes to existing literature on the effects of GHWs in a couple of ways. First, our findings shed light on how and why the effects of GHWs might work by examining the latent rather than the immediate effects of GHWs on changes in smoker emotions, perceived risk of smoking, and quitting behavior. To the best of our knowledge, this is the first longitudinal study to demonstrate the role of perceived risk of smoking to motivate smokers to attempt smoking cessation since they experience relatively more negative emotions toward GHWs than text-only warnings. While previous longitudinal studies used different samples or did not apply the same panels for analysis of the effects of GHWs’ introduction [6,28], the current study investigated the effects by comparing the same panel’s responses before and after the introduction of GHWs. This is a more rigorous way to verify the effects of GHWs. Second, we examined the overall role of the negative emotional responses elicited by GHWs in their effect on smoker intent to quit smoking. Previous studies investigated how discrete negative emotions—such as fear and disgust—work in increasing smoking cessation behavior in experimental settings [55] or how an advertisement with fear appeal works [50,56]. However, recent research on the effects of GHWs’ emotional responses on information processing [34,37,40] has examined its effect by integrating negative emotions. Therefore, we demonstrated that integrated negative feelings, not one discrete negative emotion, might work in the same way. The experience of overall negative feelings increased smoker intent to quit smoking by means of increasing perceived smoking risk in terms of severity and vulnerability, which worked as a critical driver in the effect of GHWs on smoking cessation. This study expands the depth of understanding of the effects of the negative emotions that are experienced as a result of GHWs.
In addition, this research enriches fear-appeal literature by resolving two contradictory findings. Traditional fear-appeal literature, such as the extended parallel process model that emphasizes the role of fear and perception of risk, has suggested that a mild level of fear works best, but extremely strong fear might backfire on GHWs’ effects [50]. However, recent studies have demonstrated a linear relationship between the persuasion effect and the strength of fear appeal [56]. These studies found that a strong fear appeal in advertising might be effective in persuading viewers to change their attitude and increase their intent to purchase. Our findings provide an alternative explanation of why some applications of strong fear appeal are successful while others are not. It is possible that strong fear appeal might be effective only when individuals must accept it and are repeatedly exposed to it. In this longitudinal study, smokers should accept the general negative feelings, including fear, from GHWs on cigarette packs as a matter of daily routine. Then, the changes in negative emotions pre- and post-introduction of GHW policy actually led to an increase in intent to quit smoking by means of perceived health risk of smoking. Therefore, we suggest that, in order for fear appeal to be successful, the stimulus should be exposed for a sufficiently long duration to remind targets of the relevant risk associated with fear.
The current study has important political implications for the sustainability of public health interventions. The introduction of GHW policy in South Korea changed tobacco warnings from text-only to a mandatory graphic image accompanying text warnings on cigarette packaging. A longitudinal field study conducted to compare smoker responses to tobacco warnings before and after this transformational policy implementation found GHW labels effectively persuade smokers both emotionally and cognitively by discouraging them from continuing to smoke. Repeated exposure to GHWs induced smokers to experience negative emotional responses that led them to more accurately estimate the hazards of smoking which, in turn, increased their intent to quit smoking. Although smokers might cognitively block threatening messages to control their feelings of fear, they regulated their misconduct (i.e., smoking) to mitigate the personal danger that the behavior might cause over the long term.
However, the current study has several limitations that require further research. First, these findings should be interpreted with caution, since only the South Korean case was tested for the effectiveness of GHW policy on promoting smoking cessation vis-à-vis quitting attempts. Further research should investigate another country to validate these findings. For example, the US Food and Drug Administration (FDA) announced that a new GHWs policy will be implemented in cigarette packages and advertisements in June 2021 [57]. Second, in addition to the effectiveness of GHWs’ introduction, as suggested in this study, the possibility exists that other variables such as smoking bans, prices increase, and media campaigns are also effective. Difficulty to control all extraneous variables is one limitation of longitudinal studies. However, this longitudinal study meets the key requirements of causal relation, association, and temporality, although alternative explanations cannot be ruled out. Therefore, these findings are sufficiently meaningful [6]. Third, the effectiveness of GHWs might be driven by the particular, cultural risk beliefs specifically targeted by the warnings implemented in South Korea (e.g., impotence) rather than the general health risk of smoking. However, it still remains unclear which type of risk perception is most effective in reducing intention to smoke. Fourth, another line of future research might explore a potential reversal in directional causation with the introduction of GHWs. It is possible that the changes in risk perception and quitting intentions might also drive negative emotional responses. Last, the sample size of this study is somewhat smaller than those of prior longitudinal studies. Our study is a comparative study of one sample group’s responses before and after the introduction of GHWs. In the area of GHW research, due to the difficulty of collecting and maintaining samples, studies that directly compare the responses of a single sample were rarely conducted. Therefore, despite the small sample size, our findings nonetheless contribute to research on tobacco packaging GHWs.

Supplementary Materials

The following are available online at https://www.mdpi.com/1660-4601/17/15/5393/s1, Table S1: Ten types of graphic warning used on cigarette packages.

Author Contributions

Conceptualization, S.M.L. and J.S.L.; methodology, S.C. and J.S.L.; software, validation and formal analysis, S.C. and J.S.L.; investigation, S.M.L., J.S.L. and S.C.; resources and data curation, S.M.L. and S.C.; writing—original draft preparation, S.M.L.; writing—review and editing, J.S.L.; visualization and supervision, J.S.L.; project administration, S.M.L; funding acquisition, S.M.L. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Ministry of Education of the Republic of Korea and the National Research Foundation of Korea (NRF-2016S1A5B5A07920399).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. 2012 Global Progress Report on Implementation of the WHO Framework Convention on Tobacco Control; World Health Organization: Geneva, Switzerland, 2012; Available online: https://apps.who.int/iris/handle/10665/79170 (accessed on 25 April 2020).
  2. OECD. Health at a Glance 2017: OECD Indicators; OECD Publishing: Paris, France, 2017. [Google Scholar] [CrossRef]
  3. Kang, H.Y.; Kim, H.J.; Park, T.K.; Jee, S.H.; Nam, C.M.; Park, H.W. Economic burden of smoking in Korea. Tob. Control 2003, 12, 37–44. [Google Scholar] [CrossRef] [Green Version]
  4. Canadian Cancer Society. Cigarette Package Health Warnings: International Status Report; Canadian Cancer Society: Toronto, ON, Canada, 2014; Available online: https://tobaccolabels.s3.ca-central-1.amazonaws.com/uploads/2016/11/Cigarette-Package-Health-Warnings-International-Status-Report-English-CCS-Oct-2016.pdf (accessed on 20 April 2020).
  5. Hiilamo, H.; Crosbie, E.; Glantz, S.A. The evolution of health warning labels on cigarette packs: The role of precedents, and tobacco industry strategies to block diffusion. Tob. Control 2014, 23, 1–10. [Google Scholar] [CrossRef]
  6. Korean Ministry of Health and Welfare. The Revised Enforcement Ordinance Notice No. 2015-951; Korean Ministry of Health and Welfare: Sejong City, Korea, 2015; Available online: http://www.mohw.go.kr/react/al/sal0301vw.jsp?PAR_MENU_ID=04&MENU_ID=0403&CONT_SEQ=326170 (accessed on 15 April 2020).
  7. Byrne, S.; Katz, S.; Mathios, A.; Niederdeppe, J. Do the ends justify the means? A test of alternatives to the FDA proposed cigarette warning labels. Health Commun. 2015, 30, 680–693. [Google Scholar] [CrossRef]
  8. Hammond, D.; Fong, G.T.; McDonald, P.W.; Brown, K.S.; Cameron, R. Graphic Canadian cigarette warning labels and adverse outcomes: Evidence from Canadian smokers. Am. J. Public Health 2004, 94, 1442–1445. [Google Scholar] [CrossRef]
  9. Netemeyer, R.G.; Burton, S.; Andrews, J.C.; Kees, J. Graphic health warnings on cigarette packages: The role of emotions in affecting adolescent smoking consideration and secondhand smoke beliefs. J. Public Policy Mark. 2016, 35, 124–143. [Google Scholar] [CrossRef]
  10. Lazarus, R.S. Emotion and Adaption; Oxford University Press: New York, NY, USA, 1991. [Google Scholar]
  11. Smith, C.A.; Ellsworth, P.C. Patterns of cognitive appraisal in emotion. J. Pers. Soc. Psychol. 1985, 48, 813–838. [Google Scholar] [CrossRef]
  12. World Health Organization. Technical Manual on Tobacco Tax Administration; World Health Organization: Genenva, Switzerland, 2010; Available online: https://www.who.int/tobacco/publications/economics/tax_administration/en/ (accessed on 15 April 2020).
  13. Warner, K.E. Death and taxes: Using the latter to reduce the former. Tob. Control 2014, 23, i4–i6. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Chaloupka, F.J.; Yurekli, A.; Fong, G.T. Tobacco taxes as a tobacco control strategy. Tob. Control 2012, 21, 172–180. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Sharbaugh, M.S.; Althouse, A.D.; Thoma, F.W.; Lee, J.S.; Figueredo, V.M.; Mulukutla, S.R. Impact of cigarette taxes on smoking prevalence from 2001–2015: A report using the Behavioral and Risk Factor Surveillance Survey (BRFSS). PLoS ONE 2018, 13, e0204416. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. The World Bank. Tobacco Control in Developing Countries; The World Bank: New York, NY, USA, 2012; Available online: https://documents.worldbank.org/en/publication/documents-reports/documentdetail/602821468330954036/tobacco-control-in-development-countries (accessed on 13 April 2020).
  17. Zhou, L.; Niu, L.; Jiang, H.; Jiang, C.; Xiao, S. Facilitators and barriers of smokers’ compliance with smoking bans in public places: A systematic review of quantitative and qualitative literature. Int. J. Environ. Res. Public Health 2016, 13, 1228. [Google Scholar] [CrossRef] [Green Version]
  18. Saffer, H.; Chaloupka, F. The effect of tobacco advertising bans on tobacco consumption. J. Health Econ. 2000, 19, 1117–1137. [Google Scholar] [CrossRef]
  19. Blecher, E. The impact of tobacco advertising bans on consumption in developing countries. J. Health Econ. 2008, 27, 930–942. [Google Scholar] [CrossRef] [PubMed]
  20. Kwon, D.S.; Kim, T.H.; Byun, M.K.; Kim, H.J.; Lee, H.S.; Park, H.J.; Korean Smoking Cessation Study Group. Positive effects of the national cigarette price increase policy on smoking cessation in South Korea. Tuberc. Respir. Dis. 2020, 83, 71–80. [Google Scholar] [CrossRef] [PubMed]
  21. Noar, S.M.; Francis, D.B.; Bridges, C.; Sontag, J.M.; Brewer, N.T.; Ribisl, K.M. Effects of strengthening cigarette pack warnings on attention and message processing: A systematic review. J. Mass Commun. Q. 2017, 94, 416–442. [Google Scholar] [CrossRef] [Green Version]
  22. Emery, L.F.; Romer, D.; Sheerin, K.M.; Jamieson, K.H.; Peters, E. Affective and cognitive mediators of the impact of cigarette warning labels. Nicotine Tob. Res. 2014, 16, 263–269. [Google Scholar] [CrossRef] [Green Version]
  23. Evans, A.T.; Peters, E.; Strasser, A.A.; Emery, L.F.; Sheerin, K.M.; Romer, D. Graphic warning labels elicit affective and thoughtful responses from smokers: Results of a randomized clinical trial. PLoS ONE 2015, 10, e0142879. [Google Scholar] [CrossRef]
  24. Kees, J.; Burton, S.; Andrews, J.C.; Kozup, J. Understanding how graphic pictorial warnings work on cigarette packaging. J. Public Policy Mark. 2010, 29, 265–276. [Google Scholar] [CrossRef] [Green Version]
  25. Chun, S.; Park, J.W.; Heflick, N.; Lee, S.M.; Kim, D.; Kwon, K. The moderating effects of self-esteem and self-efficacy on responses to graphic health warnings on cigarette packages: A comparison of smokers and nonsmokers. Health Commun. 2018, 33, 1013–1019. [Google Scholar] [CrossRef]
  26. Fong, G.T.; Hammond, D.; Jiang, Y.; Li, Q.; Quah, A.C.; Driezen, P.; ITC China Project Team. Perceptions of tobacco health warnings in China compared with picture and text-only health warnings from other countries: An experimental study. Tob. Control 2010, 19, i69–i77. [Google Scholar] [CrossRef]
  27. Hammond, D.; Fong, G.T.; McDonald, P.W.; Cameron, R.; Brown, K.S. Impact of the graphic Canadian warning labels on adult smoking behaviour. Tob. Control 2003, 12, 391–395. [Google Scholar] [CrossRef] [Green Version]
  28. Hammond, D.; Fong, G.T.; Borland, R.; Cummings, K.M.; McNeill, A.; Driezen, P. Text and graphic warnings on cigarette packages: Findings from the international tobacco control four country study. Am. J. Prev. Med. 2007, 32, 202–209. [Google Scholar] [CrossRef] [Green Version]
  29. Willemsen, M.C. The new EU cigarette health warnings benefit smokers who want to quit the habit: Results from the Dutch Continuous Survey of Smoking Habits. Eur. J. Public Health 2005, 15, 389–392. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Schüz, N.; Eid, M.; Schüz, B.; Ferguson, S.G. Immediate effects of plain packaging health warnings on quitting intention and potential mediators: Results from two ecological momentary assessment studies. Psychol. Addict. Behav. 2016, 30, 220–228. [Google Scholar] [CrossRef] [PubMed]
  31. LaVoie, N.R.; Quick, B.L.; Riles, J.M.; Lambert, N.J. Are graphic cigarette warning labels an effective message strategy? A test of psychological reactance theory and source appraisal. Commun. Res. 2017, 44, 416–436. [Google Scholar] [CrossRef]
  32. Sabbane, L.I.; Lowrey, T.M.; Chebat, J.C. The effectiveness of cigarette warning label threats on nonsmoking adolescents. J. Consum. Aff. 2009, 43, 332–345. [Google Scholar] [CrossRef]
  33. Gibson, L.; Brennan, E.; Momjian, A.; Shapiro-Luft, D.; Seitz, H.; Cappella, J.N. Assessing the consequences of implementing graphic warning labels on cigarette packs for tobacco-related health disparities. Nicotine Tob. Res. 2015, 17, 898–907. [Google Scholar] [CrossRef]
  34. Popova, L.; Thrul, J.; Glantz, S.A. Effects of large cigarette warning labels on smokers’ expected longevity. Am. J. Health Behav. 2018, 42, 85–92. [Google Scholar] [CrossRef]
  35. Noar, S.M.; Francis, D.B.; Bridges, C.; Sontag, J.M.; Ribisl, K.M.; Brewer, N.T. The impact of strengthening cigarette pack warnings: Systematic review of longitudinal observational studies. Soc. Sci. Med. 2006, 164, 118–129. [Google Scholar] [CrossRef] [Green Version]
  36. White, V.; Webster, B.; Wakefield, M. Do graphic health warning labels have an impact on adolescents’ smoking related beliefs and behaviours? Addiction 2008, 103, 1562–1571. [Google Scholar] [CrossRef]
  37. Cho, Y.J.; Thrasher, J.F.; Swayampakala, K.; Yong, H.H.; McKeever, R.; Hammond, D.; Borland, R. Does reactance against cigarette warning labels matter? Warning label responses and downstream smoking cessation amongst adult smokers in Australia, Canada, Mexico and the United States. PLoS ONE 2016, 11, e0159245. [Google Scholar] [CrossRef]
  38. Peters, E.; Evans, A.T.; Hemmerich, N.; Berman, M. Emotion in the law and the lab: The case of graphic cigarette warnings. Tob. Regul. Sci. 2016, 2, 404–413. [Google Scholar] [CrossRef] [Green Version]
  39. Schwarz, N. Feelings as information: Informational and motivational functions of affective states. In Handbook of Motivation and Cognition: Foundations of Social Behavior; Higgins, E.T., Sorrentino, R.M., Eds.; The Guilford Press: New York, NY, USA, 1990; pp. 527–561. [Google Scholar]
  40. Pham, M.T. Representativeness, relevance, and the use of feelings in decision making. J. Consum. Res. 1998, 25, 144–159. [Google Scholar] [CrossRef]
  41. Alloy, L.B.; Abramson, L.Y. Judgment of contingency in depressed and nondepressed students: Sadder but wiser? J. Exp. Psychol. Gen. 1979, 108, 441. [Google Scholar] [CrossRef] [PubMed]
  42. Moore, M.T.; Fresco, D.M. Depressive realism: A meta-analytic review. Clin. Psychol. Rev. 2012, 32, 496–509. [Google Scholar] [CrossRef] [PubMed]
  43. Alhakami, A.S.; Slovic, P. A psychological study of the inverse relationship between perceived risk and perceived benefit. Risk Anal. 1994, 14, 1085–1096. [Google Scholar] [CrossRef] [PubMed]
  44. Green, A.E.; Mays, D.; Falk, E.B.; Vallone, D.; Gallagher, N.; Richardson, A.; Niaura, R.S. Young adult smokers’ neural response to graphic cigarette warning labels. Addict. Behav. Rep. 2016, 3, 28–32. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Wang, A.L.; Lowen, S.B.; Romer, D.; Giorno, M.; Langleben, D.D. Emotional reaction facilitates the brain and behavioural impact of graphic cigarette warning labels in smokers. Tob. Control 2015, 24, 225–232. [Google Scholar] [CrossRef]
  46. Falk, E.B.; Berkman, E.T.; Whalen, D.; Lieberman, M.D. Neural activity during health messaging predicts reductions in smoking above and beyond self-report. Health Psychol. 2011, 30, 177. [Google Scholar] [CrossRef] [Green Version]
  47. Riddle, P.J., Jr.; Newman-Norlund, R.D.; Baer, J.; Thrasher, J.F. Neural response to pictorial health warning labels can predict smoking behavioral change. Soc. Cognit. Affect. Neurosci. 2016, 11, 1802–1811. [Google Scholar] [CrossRef]
  48. Slovic, P.; Peters, E. Risk perception and affect. Curr. Dir. Psychol. Sci. 2006, 15, 322–325. [Google Scholar] [CrossRef]
  49. Lerner, J.S.; Keltner, D. Fear, Anger, and Risk. J. Pers. Soc. Psychol. 2001, 81, 146–159. [Google Scholar] [CrossRef] [PubMed]
  50. Witte, K. Putting the fear back into fear appeals: The extended parallel process model. Commun. Monogr. 1992, 59, 329–349. [Google Scholar] [CrossRef]
  51. Thompson, M.E.; Fong, G.T.; Hammond, D.; Boudreau, C.; Driezen, P.; Hyland, A.; Mackintosh, A.M. Methods of the International Tobacco Control (ITC) four country survey. Tob. Control 2006, 15, iii12–iii18. [Google Scholar] [CrossRef] [PubMed]
  52. Brennan, E.; Durkin, S.J.; Cotter, T.; Harper, T.; Wakefield, M.A. Mass media campaigns designed to support new pictorial health warnings on cigarette packets: Evidence of a complementary relationship. Tob. Control 2011, 20, 412–418. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Zhao, X.; Lynch, J.G., Jr.; Chen, Q. Reconsidering Baron and Kenny: Myths and truths about mediation analysis. J. Consum. Res. 2010, 37, 197–206. [Google Scholar] [CrossRef]
  54. Hayes, A.F. Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach; The Guilford Press: New York, NY, USA, 2013. [Google Scholar]
  55. Erceg-Hurn, D.M.; Steed, L.G. Does exposure to cigarette health warnings elicit psychological reactance in smokers? J. Appl. Soc. Psychol. 2011, 41, 219–237. [Google Scholar] [CrossRef]
  56. LaTour, M.S.; Snipes, R.L.; Bliss, S.J. Don’t be afraid to use fear appeals: An experimental study. J. Advert. Res. 1996, 36, 59–68. [Google Scholar]
  57. US Food and Drug Administration. FDA proposes new required health warnings with color images for cigarette packages and advertisements to promote greater public understanding of negative health consequences of smoking. In FDA News Release; US Food and Drug Administration: Silver Spring, MD, USA, 2019. Available online: https://www.fda.gov/news-events/press-announcements/fda-proposes-new-required-health-warnings-color-images-cigarette-packages-and-advertisements-promote (accessed on 25 April 2020).
Figure 1. Results of mediation analysis based on bootstrapping.
Figure 1. Results of mediation analysis based on bootstrapping.
Ijerph 17 05393 g001
Table 1. Results of paired sample t tests.
Table 1. Results of paired sample t tests.
VariablesMeanStandard Deviation (SD)tp
NEPre3.841.40− 7.540.00
Post4.501.27
PRSPre5.351.200.590.55
Post5.301.23
IQPre3.021.110.870.38
Post2.961.12
Note: NE = negative emotions, PRS = perceived risk of smoking, IQ = intention to quit smoking, Pre = before the introduction of the policy; Post = after the introduction of the policy.
Table 2. Results of testing for longitudinal effects.
Table 2. Results of testing for longitudinal effects.
Test ModelDVIVsβtpR2F (p)
∆NE → ∆PRS∆PRS∆NE0.172.750.010.037.57 (0.01)
∆NE0.365.370.000.3034.20 (0.00)
Pre-NE0.253.660.00
Pre-PRS−0.53−9.470.00
∆NE → ∆IQ∆IQ∆NE0.121.950.050.023.80 (0.05)
∆NE0.192.790.010.2425.05 (0.00)
Pre−NE0.202.700.01
Pre-IQ−0.50−8.380.00
Note: NE = negative emotions, PRS = perceived risk of smoking, IQ = intention to quit smoking.

Share and Cite

MDPI and ACS Style

Lee, S.M.; Chun, S.; Lee, J.S. The Role of Negative Emotions Pre- and Post-Implementation of Graphic Health Warnings: Longitudinal Evidence from South Korea. Int. J. Environ. Res. Public Health 2020, 17, 5393. https://doi.org/10.3390/ijerph17155393

AMA Style

Lee SM, Chun S, Lee JS. The Role of Negative Emotions Pre- and Post-Implementation of Graphic Health Warnings: Longitudinal Evidence from South Korea. International Journal of Environmental Research and Public Health. 2020; 17(15):5393. https://doi.org/10.3390/ijerph17155393

Chicago/Turabian Style

Lee, Seon Min, Seungwoo Chun, and Jin Suk Lee. 2020. "The Role of Negative Emotions Pre- and Post-Implementation of Graphic Health Warnings: Longitudinal Evidence from South Korea" International Journal of Environmental Research and Public Health 17, no. 15: 5393. https://doi.org/10.3390/ijerph17155393

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop