<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" article-type="review-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">ijerph</journal-id>
      <journal-title>International Journal of Environmental Research and Public Health</journal-title>
      <abbrev-journal-title abbrev-type="publisher">Int. J. Environ. Res. Public Health</abbrev-journal-title>
      <abbrev-journal-title abbrev-type="pubmed">International journal of environmental research and public health</abbrev-journal-title>
      <issn pub-type="epub">1660-4601</issn>
      <publisher>
        <publisher-name>MDPI</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.3390/ijerph9062121</article-id>
      <article-id pub-id-type="publisher-id">ijerph-09-02121</article-id>
      <article-categories>
        <subj-group>
          <subject>Review</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Gain-Framed Messages Do Not Motivate Sun Protection: A Meta-Analytic Review of Randomized Trials Comparing Gain-Framed and Loss-Framed Appeals for Promoting Skin Cancer Prevention</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>O’Keefe</surname>
            <given-names>Daniel J.</given-names>
          </name>
          <xref rid="c1-ijerph-09-02121" ref-type="corresp">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Wu</surname>
            <given-names>Daisy</given-names>
          </name>
        </contrib>
      </contrib-group>

      <aff id="af1-ijerph-09-02121">Department of Communication Studies, Northwestern University, 2040 Campus Drive, Evanston, IL 60208, USA; Email: <email>YujingWu2014@u.northwestern.edu</email></aff>      
	  <author-notes>
        <corresp id="c1-ijerph-09-02121"><label>*</label> Author  to whom correspondence should be addressed; Email: <email>d-okeefe@northwestern.edu</email>; Tel.: +1-847-491-3581; Fax: +1-847-467-1036.</corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>05</day>
        <month>06</month>
        <year>2012</year>
      </pub-date>
      <pub-date pub-type="ppub"><month>06</month>
        <year>2012</year>
      </pub-date>
      <volume>9</volume>
      <issue>6</issue>
      <fpage>2121</fpage>
      <lpage>2133</lpage>
      <history>
        <date date-type="received">
          <day>18</day>
          <month>04</month>
          <year>2012</year>
        </date>
        <date date-type="rev-recd">
          <day>30</day>
          <month>05</month>
          <year>2012</year>
        </date>
        <date date-type="accepted">
          <day>30</day>
          <month>05</month>
          <year>2012</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>© 2012 by the authors; licensee MDPI, Basel, Switzerland.</copyright-statement>
        <copyright-year>2012</copyright-year>
        <license xmlns:xlink="http://www.w3.org/1999/xlink" license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/">
          <p>This article is an open-access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p>
        </license>
      </permissions>
      <abstract>
        <p>Persuading people to undertake actions to prevent skin cancer is an important public health challenge. A number of studies have compared the effectiveness of gain-framed and loss-framed appeals in this domain, often expecting gain-framed appeals to be more persuasive. A meta-analytic review (<italic>k</italic> = 33, <italic>N</italic> = 4,168), however, finds no significant difference in the persuasiveness of gain- and loss-framed appeals for encouraging skin cancer prevention. This conclusion is unaffected by differences in the specific protective action advocated or by differences in the kind of outcomes invoked. But the results offer an intimation that men might be more susceptible to framing variations in this domain—with loss-framed appeals potentially having a persuasive advantage.</p>
      </abstract>
      <kwd-group>
        <kwd>skin cancer prevention</kwd>
        <kwd>message framing</kwd>
        <kwd>gain-framed</kwd>
        <kwd>loss-framed</kwd>
        <kwd>persuasive messages</kwd>
        <kwd>meta-analysis</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>1. Introduction</title>
      <p>Skin cancer is a serious disease. One estimate is that almost 200,000 people worldwide were diagnosed with malignant melanoma in 2008 [<xref ref-type="bibr" rid="B1-ijerph-09-02121">1</xref>]. In the United States alone, the American Cancer Society’s estimate is that 12,190 deaths (9,180 from melanoma and 3,010 from other nonepithelial skin cancers) will occur in 2012 [<xref ref-type="bibr" rid="B2-ijerph-09-02121">2</xref>]. CDC’s National Program of Cancer Registries listed the skin as one of the top ten cancer sites in 2008 in the U.S. population [<xref ref-type="bibr" rid="B3-ijerph-09-02121">3</xref>]. The total number of people in the US population with nonmelanoma skin cancer has been estimated to have been over 3.5 million in 2006, making it an “underrecognized epidemic” [<xref ref-type="bibr" rid="B4-ijerph-09-02121">4</xref>].</p>
      <p>It is correspondingly important to identify what sorts of persuasive messages might be most effective in encouraging skin cancer prevention. One choice faced by advocates is whether to use a gain-framed appeal, which emphasizes the desirable consequences of undertaking the recommended preventive actions, or a loss-framed appeal, which emphasizes the undesirable consequences of failing to undertake the recommended actions. </p>
      <p>The most well-known hypothesis about message framing persuasive effects is that the relative persuasiveness of gain-framed and loss-framed messages will vary depending on the kind of behavior being advocated. Specifically, the expectation has been that loss-framed appeals will be more persuasive than gain-framed appeals where the advocated action is a disease detection behavior, but gain-framed appeals will be more persuasive than loss-framed appeals where the advocated action is a disease prevention behavior [<xref ref-type="bibr" rid="B5-ijerph-09-02121">5</xref>,<xref ref-type="bibr" rid="B6-ijerph-09-02121">6</xref>]. This general hypothesis has not fared well, however. For most disease detection behaviors, there is no difference in the persuasiveness of gain-framed and loss-framed messages [<xref ref-type="bibr" rid="B7-ijerph-09-02121">7</xref>]. Similarly, for most disease prevention behaviors, there is no difference in the persuasiveness of gain-framed and loss-framed messages [<xref ref-type="bibr" rid="B8-ijerph-09-02121">8</xref>]. However, even if these broad categories of behavior do not yield the expected differences, those differences might still emerge in some more specific behavioral domain, such as skin cancer prevention.</p>
      <p>This paper provides a meta-analytic review of the accumulated research concerning the relative persuasiveness of gain-framed and loss-framed messages for encouraging skin cancer preventive behaviors. The primary research question is whether gain-framed and loss-framed appeals are differentially persuasive on this subject. Plainly, if one appeal form is generally more effective than the other, those charged with designing messages on this topic will be able to craft messages in ways that maximize effectiveness. No previous message framing meta-analysis located more than a dozen studies concerning skin cancer prevention [<xref ref-type="bibr" rid="B8-ijerph-09-02121">8</xref>,<xref ref-type="bibr" rid="B9-ijerph-09-02121">9</xref>,<xref ref-type="bibr" rid="B10-ijerph-09-02121">10</xref>]. However, as will be seen, over 30 relevant studies are available (over twice as many as ever previously reviewed), which means that any previous conclusions would have been based on only a fraction of the relevant research evidence.</p>
      <p>In addition to addressing the question of whether there is a general difference in the persuasiveness of gain-framed and loss-framed messages in this domain, we were also interested in exploring the possible moderating roles of three variables. One was the advocated action. Any number of different behaviors might be encouraged as a means of reducing skin cancer risk: using sunscreen, avoiding sun exposure at peak times, wearing protective clothing, and so forth. It might be that the relative persuasiveness of gain- and loss-framed appeals varies across different advocated actions.</p>
      <p>A second was the basis of the persuasive appeal, that is, the kind of outcomes invoked by the appeal. Skin cancer preventive behaviors might be encouraged by emphasizing the dangers of skin cancer (or other health-related consequences)—or those behaviors might be encouraged by invoking appearance-related consequences of unprotected sun exposure, such as unattractive skin. It might be that the relative persuasiveness of gain- and loss-framed appeals varies depending on the basis of the appeal. </p>
      <p>A third was the sex of message recipients. Even though gain- and loss-framed appeals do not generally differ in persuasiveness, a small but statistically significant loss-framed advantage has been reported for studies in which messages advocated breast cancer detection behaviors [<xref ref-type="bibr" rid="B7-ijerph-09-02121">7</xref>]. This advocacy subject might be thought distinctive on any number of grounds, but given that all of the research participants in those studies were women, it is at least possible that men and women differ in their susceptibility to message framing variations. </p>
    </sec>
    <sec sec-type="methods">
      <title>2. Methods</title>
      <sec>
        <title>2.1. Identification of Relevant Investigations</title>
        <sec>
          <title>2.1.1. Literature Search</title>
          <p>Research reports were located through personal knowledge of the literature, examination of reference lists from previous reviews and primary research reports, and searches of relevant databases (including Medline, PsycINFO, EBSCO, ProQuest Dissertations and Theses, ABI/INFORM, and Web of Science) using appropriate combinations of search terms such as <italic>message framing</italic>, <italic>gain-framed</italic>, <italic>loss-framed</italic>, <italic>skin cancer</italic>, <italic>sunscreen</italic>, and <italic>sun avoidance</italic>. </p>
        </sec>
        <sec>
          <title>2.1.2. Inclusion Criteria</title>
          <p>Studies selected had to meet three criteria. First, the study had to be a randomized trial comparing the persuasiveness of gain-framed and loss-framed messages. A gain-framed message emphasizes the advantages of compliance with the advocated view; a loss-framed message emphasizes the disadvantages of noncompliance. Second, the messages had to advocate skin cancer preventive behaviors (e.g., sunscreen use, minimization of sun exposure, <italic>etc.</italic>). Third, appropriate quantitative data relevant to persuasive effects (e.g., attitude, intention, or behavior) had to be available; where it was not provided in the report, we made efforts to obtain information from authors. Excluded by these criteria were studies of other kinds of framing variations (e.g., [<xref ref-type="bibr" rid="B11-ijerph-09-02121">11</xref>,<xref ref-type="bibr" rid="B12-ijerph-09-02121">12</xref>]), studies lacking an appropriate outcome variable [<xref ref-type="bibr" rid="B13-ijerph-09-02121">13</xref>], and studies for which relevant quantitative information could not be obtained [<xref ref-type="bibr" rid="B14-ijerph-09-02121">14</xref>,<xref ref-type="bibr" rid="B15-ijerph-09-02121">15</xref>,<xref ref-type="bibr" rid="B16-ijerph-09-02121">16</xref>,<xref ref-type="bibr" rid="B17-ijerph-09-02121">17</xref>,<xref ref-type="bibr" rid="B18-ijerph-09-02121">18</xref>].</p>
        </sec>
      </sec>
      <sec>
        <title>2.2. Outcome Variable and Effect Size Measure</title>
        <p>The outcome variable was persuasion, as assessed through attitude, behavioral intention, behavior, and the like. When multiple indices of persuasion (e.g., assessments of attitude and intention) were available, we averaged the effects to yield a single summary. Every comparison between a gain-framed message and its loss-framed counterpart was summarized using <italic>r</italic> (correlation) as the effect size measure. Differences indicating greater effectiveness with gain-framed messages were given a positive sign. When correlations were averaged (e.g., across several indices of persuasiveness), we computed the average using the <italic>r</italic>-to-<italic>z</italic>-to-<italic>r</italic> transformation procedure, weighted by <italic>n</italic>. </p>
      </sec>
      <sec>
        <title>2.3. Moderator Variables</title>
        <sec>
          <title>2.3.1. Advocated Behavior</title>
          <p>We distinguished studies based on the behavior being recommended by the message. In nearly all studies, the messages mentioned sunscreen use, but some messages advocated only sunscreen use. Hence we contrasted studies in which the messages advocated sunscreen use and studies in which in the messages advocated either some other protective action (e.g., sun avoidance) or multiple actions (e.g., both sunscreen and sun avoidance). </p>
        </sec>
        <sec>
          <title>2.3.2. Appeal Basis</title>
          <p>We distinguished studies based on the kinds of outcomes that formed the basis of the persuasive appeals. In nearly all studies, the messages mentioned health-related outcomes, but some messages mentioned only health-related consequences. Hence we contrasted studies in which the messages invoked only health-related outcomes (e.g., skin cancer) and studies in which the messages did not invoke only health-related outcomes (appeals that referred to other outcomes such as appearance-related effects, or appeals that invoked a combination of health-related outcomes and other outcomes). </p>
        </sec>
        <sec>
          <title>2.3.3. Message Recipient Sex</title>
          <p>For each study for which appropriate exact information was available, we recorded the proportion of female participants. </p>
        </sec>
      </sec>
      <sec sec-type="methods">
        <title>2.4. Unit of Analysis and Meta-Analytic Procedures</title>
        <p>The unit of analysis was the message pair, that is, the pair composed of a gain-framed message and its loss-framed counterpart. We recorded a measure of effect size for each distinguishable message pair found in the body of studies. Whenever a study included more than one message pair and reported data separately for each pair, each pair was treated as providing a separate effect size estimate (e.g., [<xref ref-type="bibr" rid="B19-ijerph-09-02121">19</xref>]). </p>
        <p>In some cases, the same primary data served as the basis for multiple reports (e.g., both a dissertation and a subsequent publication). When a given investigation was reported in more than one outlet, it was treated as a single study and analyzed accordingly. The same research was reported (in whole or in part) in: [<xref ref-type="bibr" rid="B20-ijerph-09-02121">20</xref>] and ([<xref ref-type="bibr" rid="B21-ijerph-09-02121">21</xref>], Study 2); [<xref ref-type="bibr" rid="B22-ijerph-09-02121">22</xref>] and [<xref ref-type="bibr" rid="B23-ijerph-09-02121">23</xref>]; [<xref ref-type="bibr" rid="B24-ijerph-09-02121">24</xref>], [<xref ref-type="bibr" rid="B25-ijerph-09-02121">25</xref>], and [<xref ref-type="bibr" rid="B26-ijerph-09-02121">26</xref>]; [<xref ref-type="bibr" rid="B27-ijerph-09-02121">27</xref>] and [<xref ref-type="bibr" rid="B28-ijerph-09-02121">28</xref>]; [<xref ref-type="bibr" rid="B29-ijerph-09-02121">29</xref>] and [<xref ref-type="bibr" rid="B30-ijerph-09-02121">30</xref>]; [<xref ref-type="bibr" rid="B31-ijerph-09-02121">31</xref>] and [<xref ref-type="bibr" rid="B32-ijerph-09-02121">32</xref>]; [<xref ref-type="bibr" rid="B33-ijerph-09-02121">33</xref>] and [<xref ref-type="bibr" rid="B34-ijerph-09-02121">34</xref>]; [<xref ref-type="bibr" rid="B35-ijerph-09-02121">35</xref>] and [<xref ref-type="bibr" rid="B36-ijerph-09-02121">36</xref>]; [<xref ref-type="bibr" rid="B37-ijerph-09-02121">37</xref>] and [<xref ref-type="bibr" rid="B38-ijerph-09-02121">38</xref>]. The individual effect sizes (correlations) were analyzed using random-effects procedures (specifically, those of [<xref ref-type="bibr" rid="B39-ijerph-09-02121">39</xref>]).</p>
      </sec>
    </sec>
    <sec sec-type="results">
      <title>3. Results</title>
      <sec>
        <title>3.1. Sample Characteristics</title>
        <p>Precise data were not available for most cases concerning the racial/ethnic composition of the study samples, although when such data were reported the samples were predominantly Caucasian. Most participants were young adults (e.g., university students).</p>
      </sec>
      <sec>
        <title>3.2. Overall Effects</title>
        <p>Effect sizes were available for 33 cases, with 4,168 participants. Details for each included case are contained in <xref ref-type="table" rid="ijerph-09-02121-t001">Table 1</xref>. Across all 33 cases, the random-effects weighted mean correlation was −0.020. The limits of the 95% confidence interval for this mean were −0.060 and 0.019, indicating no significant persuasive advantage for one framing form over the other (<italic>Z</italic> = −1.002, <italic>p</italic> = 0.316). </p>
        <table-wrap id="ijerph-09-02121-t001" position="anchor">
          <object-id pub-id-type="pii">ijerph-09-02121-t001_Table 1</object-id>
          <label>Table 1</label>
          <caption>
            <p>List of cases.</p>
          </caption>
          <table>
            <thead>
              <tr>
                <th align="left" valign="middle">Study</th>
                <th align="left" valign="middle">
                  <italic>r</italic>
                </th>
                <th align="left" valign="middle">
                  <italic>N</italic>
                </th>
                <th align="left" valign="middle">Codings <sup>a</sup></th>
              </tr>
            </thead>
            <tbody>
              <tr>
                <td align="left" valign="middle">Block (1993) sun exposure [<xref ref-type="bibr" rid="B20-ijerph-09-02121">20</xref>]</td>
                <td align="left" valign="middle">0.174</td>
                <td align="left" valign="middle">58</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Cox, Cox, &amp; Zimet (2006) Study 1 prevention [<xref ref-type="bibr" rid="B40-ijerph-09-02121">40</xref>]</td>
                <td align="left" valign="middle">0.013</td>
                <td align="left" valign="middle">139</td>
                <td align="left" valign="middle">2/1/41</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Currie (2010) [<xref ref-type="bibr" rid="B41-ijerph-09-02121">41</xref>]</td>
                <td align="left" valign="middle">0.064</td>
                <td align="left" valign="middle">131</td>
                <td align="left" valign="middle">1/2/73</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Detweiler <italic>et al.</italic> (1999) [<xref ref-type="bibr" rid="B42-ijerph-09-02121">42</xref>]</td>
                <td align="left" valign="middle">0.122</td>
                <td align="left" valign="middle">217</td>
                <td align="left" valign="middle">2/2/76</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Fischer &amp; Nabi (2001) sunscreen [<xref ref-type="bibr" rid="B43-ijerph-09-02121">43</xref>]</td>
                <td align="left" valign="middle">−0.191</td>
                <td align="left" valign="middle">79</td>
                <td align="left" valign="middle">1/1/54</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Hoffner &amp; Ye (2009) [<xref ref-type="bibr" rid="B28-ijerph-09-02121">28</xref>]</td>
                <td align="left" valign="middle">0.000</td>
                <td align="left" valign="middle">154</td>
                <td align="left" valign="middle">1/1/66</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Hwang, Cho, Sands, &amp; Jeong (in press) [<xref ref-type="bibr" rid="B31-ijerph-09-02121">23</xref>]</td>
                <td align="left" valign="middle">−0.099</td>
                <td align="left" valign="middle">219</td>
                <td align="left" valign="middle">2/2/45</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Ku (2008) skin cancer [<xref ref-type="bibr" rid="B44-ijerph-09-02121">44</xref>]</td>
                <td align="left" valign="middle">−0.155</td>
                <td align="left" valign="middle">467</td>
                <td align="left" valign="middle">2/1/45</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lee &amp; Aaker (2004) Experiment 2 promotion [<xref ref-type="bibr" rid="B45-ijerph-09-02121">45</xref>]</td>
                <td align="left" valign="middle">0.055</td>
                <td align="left" valign="middle">85</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lee &amp; Aaker (2004) Experiment 2 prevention [<xref ref-type="bibr" rid="B45-ijerph-09-02121">45</xref>]</td>
                <td align="left" valign="middle">−0.173</td>
                <td align="left" valign="middle">78</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lee, Brown, &amp; Blood (2000) sunscreen/clothing [<xref ref-type="bibr" rid="B46-ijerph-09-02121">46</xref>]</td>
                <td align="left" valign="middle">0.119</td>
                <td align="left" valign="middle">132</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lemieux, Hale, &amp; Mongeau (1994) vivid high fear [<xref ref-type="bibr" rid="B19-ijerph-09-02121">19</xref>]</td>
                <td align="left" valign="middle">0.039</td>
                <td align="left" valign="middle">51</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lemieux <italic>et al.</italic> (1994) pallid high fear [<xref ref-type="bibr" rid="B19-ijerph-09-02121">19</xref>]</td>
                <td align="left" valign="middle">0.132</td>
                <td align="left" valign="middle">50</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lemieux <italic>et al.</italic> (1994) vivid low fear [<xref ref-type="bibr" rid="B19-ijerph-09-02121">19</xref>]</td>
                <td align="left" valign="middle">0.070</td>
                <td align="left" valign="middle">50</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Lemieux <italic>et al.</italic> (1994) pallid low fear [<xref ref-type="bibr" rid="B19-ijerph-09-02121">19</xref>]</td>
                <td align="left" valign="middle">0.019</td>
                <td align="left" valign="middle">50</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">McCormick (2010) [<xref ref-type="bibr" rid="B47-ijerph-09-02121">47</xref>]</td>
                <td align="left" valign="middle">−0.114</td>
                <td align="left" valign="middle">154</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Nan (2011) [<xref ref-type="bibr" rid="B30-ijerph-09-02121">30</xref>]</td>
                <td align="left" valign="middle">0.059</td>
                <td align="left" valign="middle">152</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Robinson (2004) Study 1 [<xref ref-type="bibr" rid="B48-ijerph-09-02121">48</xref>]</td>
                <td align="left" valign="middle">−0.013</td>
                <td align="left" valign="middle">96</td>
                <td align="left" valign="middle">1/2/100</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Rothman <italic>et al.</italic> (1993) Experiment 2 [<xref ref-type="bibr" rid="B18-ijerph-09-02121">18</xref>]</td>
                <td align="left" valign="middle">0.039</td>
                <td align="left" valign="middle">108</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Saadi (2009) Experiment 1 prevention disincentive [<xref ref-type="bibr" rid="B49-ijerph-09-02121">49</xref>]</td>
                <td align="left" valign="middle">0.183</td>
                <td align="left" valign="middle">50</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Saadi (2009) Experiment 1 prevention incentive [<xref ref-type="bibr" rid="B49-ijerph-09-02121">49</xref>]</td>
                <td align="left" valign="middle">−0.137</td>
                <td align="left" valign="middle">50</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Schubert (2008) [<xref ref-type="bibr" rid="B50-ijerph-09-02121">50</xref>]</td>
                <td align="left" valign="middle">−0.131</td>
                <td align="left" valign="middle">174</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Seo (2008) verbal [<xref ref-type="bibr" rid="B31-ijerph-09-02121">31</xref>]</td>
                <td align="left" valign="middle">0.191</td>
                <td align="left" valign="middle">48</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Seo (2008) visual [<xref ref-type="bibr" rid="B31-ijerph-09-02121">31</xref>]</td>
                <td align="left" valign="middle">−0.162</td>
                <td align="left" valign="middle">47</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Shamaskin (2009) Study 1 skin cancer prevention [<xref ref-type="bibr" rid="B33-ijerph-09-02121">33</xref>]</td>
                <td align="left" valign="middle">−0.165</td>
                <td align="left" valign="middle">49</td>
                <td align="left" valign="middle">2/1/59</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Shen (2005) Study 1 skin cancer [<xref ref-type="bibr" rid="B35-ijerph-09-02121">35</xref>]</td>
                <td align="left" valign="middle">−0.054</td>
                <td align="left" valign="middle">286</td>
                <td align="left" valign="middle">2/2/73</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Shen &amp; Kollar (2011) sunscreen [<xref ref-type="bibr" rid="B51-ijerph-09-02121">51</xref>]</td>
                <td align="left" valign="middle">0.125</td>
                <td align="left" valign="middle">148</td>
                <td align="left" valign="middle">1/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Shen &amp; Kollar (2011) tanning [<xref ref-type="bibr" rid="B51-ijerph-09-02121">51</xref>]</td>
                <td align="left" valign="middle">−0.051</td>
                <td align="left" valign="middle">143</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Smith (2003) prevention [<xref ref-type="bibr" rid="B52-ijerph-09-02121">52</xref>]</td>
                <td align="left" valign="middle">−0.008</td>
                <td align="left" valign="middle">31</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Stoner (2010) [<xref ref-type="bibr" rid="B37-ijerph-09-02121">37</xref>]</td>
                <td align="left" valign="middle">0.110</td>
                <td align="left" valign="middle">136</td>
                <td align="left" valign="middle">2/1/100</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Taber (2010) [<xref ref-type="bibr" rid="B53-ijerph-09-02121">53</xref>]</td>
                <td align="left" valign="middle">−0.101</td>
                <td align="left" valign="middle">146</td>
                <td align="left" valign="middle">2/1/60</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Thomas <italic>et al.</italic> (2010) appearance [<xref ref-type="bibr" rid="B26-ijerph-09-02121">26</xref>]</td>
                <td align="left" valign="middle">−0.079</td>
                <td align="left" valign="middle">183</td>
                <td align="left" valign="middle">2/2/na</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Thomas <italic>et al.</italic> (2010) health [<xref ref-type="bibr" rid="B26-ijerph-09-02121">26</xref>]</td>
                <td align="left" valign="middle">−0.144</td>
                <td align="left" valign="middle">207</td>
                <td align="left" valign="middle">2/1/na</td>
              </tr>
            </tbody>
          </table>
		  <table-wrap-foot>
		  <fn>
       <p><bold><sup>a </sup></bold>The codings are, respectively, the advocated behavior (1 = sunscreen, 2 = other/multiple), the basis of the appeals (1 = health consequences only, 2 = other/multiple), and the proportion of female participants (na = not available).</p>
		  </fn>
		  </table-wrap-foot>
        </table-wrap>
        <p>This result was based on combining outcome data across attitudinal, intention, and behavioral outcomes—thereby affording greater statistical power for detecting any effects—but the substantive conclusion is unaffected by this procedural decision. In this dataset, as in other meta-analytic reviews of the relative persuasiveness of gain-loss message framing variations (e.g., [<xref ref-type="bibr" rid="B9-ijerph-09-02121">9</xref>,<xref ref-type="bibr" rid="B10-ijerph-09-02121">10</xref>]), these different outcomes were functionally equivalent as indicators of relative persuasiveness. Specifically: The mean ES for attitudinal outcomes (−0.017, <italic>k</italic> = 18, 95% CI limits of −0.078 and .044) did not significantly differ from the mean ES for intention outcomes (−0.013, <italic>k</italic> = 30, 95% CI limits of −0.055, 0.029; Q(1) = 0.010, <italic>p</italic> = 0.921) or from the mean ES for behavioral outcomes (0.044, <italic>k</italic> = 3, 95% CI limits of −0.140 and 0.225; Q(1) = 0.371, <italic>p</italic> = 0.543). The mean ES for intention outcomes did not significantly differ from the mean ES for behavioral outcomes (Q(1) = 0.344, <italic>p</italic> = 0.558).</p>
      </sec>
      <sec>
        <title>3.3. Moderating Factors</title>
        <sec>
          <title>3.3.1. Advocated Behavior</title>
          <p>The relative persuasiveness of gain-framed and loss-framed appeals was not affected by whether the messages advocated only sunscreen use (mean <italic>r</italic> = −0.013) or advocated other or multiple behaviors (mean <italic>r</italic> = −0.023); these two mean effects were not significantly different (<italic>Q</italic>(1) = 0.058, <italic>p</italic> = 0.810). </p>
        </sec>
        <sec>
          <title>3.3.2. Appeal Basis</title>
          <p>The relative persuasiveness of gain-framed and loss-framed appeals was not affected by whether the messages invoked only health-related consequences (mean <italic>r</italic> = −0.024) or did not invoke only health-related consequences (<italic>i.e.</italic>, invoked non-health consequences or a combination of health and non-health consequences; mean <italic>r</italic> = −0.015); these two mean effects were not significantly different (<italic>Q</italic>(1) = 0.048, <italic>p</italic> = 0.826). </p>
        </sec>
        <sec>
          <title>3.3.3. Message Recipient Sex</title>
          <p>Twelve cases provided exact information about the proportion of female participants. For exploring the possible moderating role of participant sex, we analyzed the data in two ways. First, we performed a modified weighted least squares regression using the proportion of female participants (as a continuous variable) to predict effect size. Using SPSS regression analysis, and applying the corrections described by [<xref ref-type="bibr" rid="B54-ijerph-09-02121">54</xref>], the proportion of female participants was strongly (<italic>R</italic> = 0.635) and significantly (<italic>z</italic> = 3.00, <italic>p</italic> = 0.001) related to effect size: As the proportion of female participants increased, effect sizes became more positive.</p>
          <p>Second, we dichotomized the 12 relevant cases on the basis of the proportion of female participants. As indicated in <xref ref-type="table" rid="ijerph-09-02121-t002">Table 2</xref>, when the proportion of female participants was greater than 0.6, there was no significant difference in the persuasiveness of gain-framed and loss-framed appeals (mean <italic>r</italic> = 0.033, <italic>k</italic> = 6), but when the proportion of female participants was 0.6 or less, loss-framed appeals were significantly more persuasive than gain-framed appeals (mean <italic>r</italic> = −0.119, <italic>k</italic> = 6). These two mean effects were significantly different (<italic>Q</italic>(1) = 13.194, <italic>p</italic> = 0.001).</p>
          <table-wrap id="ijerph-09-02121-t002" position="anchor">
            <object-id pub-id-type="pii">ijerph-09-02121-t002_Table 2</object-id>
            <label>Table 2</label>
            <caption>
              <p>Summary of results.</p>
            </caption>
            <table>
              <thead>
                <tr>
                  <th align="left" valign="middle"> </th>
                  <th align="center" valign="middle">
                    <italic>k</italic>
                  </th>
                  <th align="center" valign="middle">
                    <italic>N</italic>
                  </th>
                  <th align="center" valign="middle">mean 
                  <italic>r</italic></th>
                  <th align="center" valign="middle">95% CI</th>
                  <th align="center" valign="middle">Power <sup>a</sup></th>
                  <th align="center" valign="middle"><italic>Q</italic>(df)</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="left" valign="middle">All cases</td>
                  <td align="center" valign="middle">33</td>
                  <td align="center" valign="middle">4,168</td>
                  <td align="center" valign="middle">−0.020</td>
                  <td align="center" valign="middle">−0.060, 0.019</td>
                  <td align="center" valign="middle">0.99</td>
                  <td align="center" valign="middle">47.8(32) *</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">Advocated behavior</td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                </tr>
                <tr>
                  <td align="left" valign="middle">sunscreen</td>
                  <td align="center" valign="middle">12</td>
                  <td align="center" valign="middle">1,120</td>
                  <td align="center" valign="middle">−0.013</td>
                  <td align="center" valign="middle">−0.085, 0.060</td>
                  <td align="center" valign="middle">0.64</td>
                  <td align="center" valign="middle">15.4(11)</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">other/multiple</td>
                  <td align="center" valign="middle">21</td>
                  <td align="center" valign="middle">3,048</td>
                  <td align="center" valign="middle">−0.023</td>
                  <td align="center" valign="middle">−0.071, 0.025</td>
                  <td align="center" valign="middle">0.97</td>
                  <td align="center" valign="middle">31.8(20) *</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">Appeal basis</td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                </tr>
                <tr>
                  <td align="left" valign="middle">health</td>
                  <td align="center" valign="middle">13</td>
                  <td align="center" valign="middle">1,776</td>
                  <td align="center" valign="middle">−0.024</td>
                  <td align="center" valign="middle">−0.094, 0.046</td>
                  <td align="center" valign="middle">0.84</td>
                  <td align="center" valign="middle">23.2(12) *</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">other/multiple</td>
                  <td align="center" valign="middle">20</td>
                  <td align="center" valign="middle">2,392</td>
                  <td align="center" valign="middle">−0.015</td>
                  <td align="center" valign="middle">−0.061, 0.032</td>
                  <td align="center" valign="middle">0.93</td>
                  <td align="center" valign="middle">23.5(19)</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">Proportion of females</td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                  <td align="center" valign="middle"> </td>
                </tr>
                <tr>
                  <td align="left" valign="middle">&gt;60%</td>
                  <td align="center" valign="middle">6</td>
                  <td align="center" valign="middle">1,020</td>
                  <td align="center" valign="middle">0.033</td>
                  <td align="center" valign="middle">−0.030, 0.096</td>
                  <td align="center" valign="middle">0.61</td>
                  <td align="center" valign="middle">5.1(5)</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">≤60%</td>
                  <td align="center" valign="middle">6</td>
                  <td align="center" valign="middle">1,099</td>
                  <td align="center" valign="middle">−0.119</td>
                  <td align="center" valign="middle">−0.177, −0.060</td>
                  <td align="center" valign="middle">--</td>
                  <td align="center" valign="middle">3.7(5)</td>
                </tr>
              </tbody>
            </table>
			<table-wrap-foot>
			<fn>
          <p>* <italic>p</italic> &lt; 0.05. <bold><sup>a </sup></bold>These are power figures for detecting a population effect size of <italic>r</italic> = ±0.10, assuming large heterogeneity, with a random-effects analysis, .05 alpha, and a two-tailed test [<xref ref-type="bibr" rid="B55-ijerph-09-02121">55</xref>].</p>
			</fn>
			</table-wrap-foot>
          </table-wrap>
        </sec>
      </sec>
    </sec>
    <sec sec-type="discussion">
      <title>4. Discussion</title>
      <p>Gain-framed and loss-framed appeals do not generally differ significantly in persuasiveness concerning skin cancer prevention. The lack of a statistically significant difference is not the consequence of poor statistical power. On the contrary, for detecting even a relatively small population effect (<italic>r</italic> = ±0.10), the data in hand afforded power of 0.99. One can be quite sure that if any nonzero population effect exists, it is quite small indeed. </p>
      <p>This is unquestionably a disappointing result, because identifying dependable ways of substantially enhancing the persuasiveness of skin cancer prevention messages is an important enterprise. But it is plain that those charged with the task of designing skin cancer prevention messages should generally not spend time worrying about whether their messages are gain-framed or loss-framed. </p>
      <p>This conclusion is unaffected by the specific preventive action being recommended. There is no evidence that the relative persuasiveness of gain-framed and loss-framed appeals varies as a consequence of whether the message advocates simply sunscreen use or advocates some other action or combination of actions. And this conclusion is unaffected by the kinds of consequences invoked by the message’s arguments. Specifically, there is no reason to suppose that the relative persuasiveness of gain-framed and loss-framed messages varies as a consequence of whether the messages invoke only health-related consequences (such as skin cancer) or invoke other consequences (in addition to, or instead of, health consequences). </p>
      <p>However, these negative conclusions must be tempered a bit by the intriguing result concerning the sex of message recipients. The very limited evidence in hand suggests that as the proportion of male message recipients increases, loss-framed appeals become progressively more advantageous than gain-framed appeals. More specifically, when the audience is predominantly female, message framing variations make virtually no difference—but with a larger proportion of men in the audience, a difference between gain- and loss-framed messages emerges, with loss-framed appeals having a persuasive advantage. </p>
      <p>It is not obvious what might explain this apparent effect. The effect is not plausibly a matter of men somehow being intrinsically more susceptible to message framing variations than are women. As mentioned above, a small but statistically significant difference between gain- and loss-framed appeals has appeared in studies in which all the participants were women (studies concerning breast cancer screening behaviors) [<xref ref-type="bibr" rid="B5-ijerph-09-02121">5</xref>]. It may simply be that this result is a statistical fluke; one notices, for example, the relatively poor statistical power in the set of studies in which the proportion of female participants exceeded 0.6. </p>
      <p>This explanatory uncertainty may be seen to reflect the key limitation of the present review (a limitation common to meta-analytic reviews), namely, that the conclusions are necessarily circumscribed by the nature of the primary research under investigation. Given that the observed sex-related effect may be a statistical oddity (given the relatively low power), only additional primary research can provide clarification. As another example: Nearly all of the samples in these studies were composed of college-age participants. Although this population is of natural interest as a focus for skin cancer prevention efforts, this restriction means that one cannot say with confidence how the results might have been different had a broader age range been sampled.</p>
    </sec>
    <sec sec-type="conclusions">
      <title>5. Conclusions</title>
      <p>These results suggest three broad conclusions. First, gain-framed and loss-framed appeals do not generally differ in persuasiveness concerning skin cancer prevention. Researchers interested in developing understandings of what makes for more and less effective messages in this domain should consider directing their efforts elsewhere. </p>
      <p>Second, researchers who do continue testing potential differences in the persuasiveness of gain-framed and loss-framed messages concerning skin cancer prevention might attend closely to the sex composition of their samples. The present results raise the possibility of sex-related variations in the differential persuasiveness of gain- and loss-framed appeals, so further evidence will be welcomed.</p>
      <p>Third, replications are essential in studies of the relative effectiveness of alternative public health messages. One of the earliest studies of message framing and skin cancer prevention—the research of Detweiler <italic>et al.</italic> [<xref ref-type="bibr" rid="B42-ijerph-09-02121">42</xref>]—compared one gain-framed brochure and one loss-framed brochure, and reported that the gain-framed message was more effective. This experimental design is the conventional one for addressing research questions concerning the relative effectiveness of two message kinds: one specific concrete message of one type is compared to one specific concrete message of the other type. But the result obtained in this study was obviously not general. Across 33 such comparisons to date, gain-framed and loss-framed messages are actually statistically indistinguishable with respect to persuasiveness concerning skin cancer prevention. This pattern of effects—in which an initial study produces a statistically significant effect but subsequent research fails to confirm it—is not uncommon [<xref ref-type="bibr" rid="B56-ijerph-09-02121">56</xref>,<xref ref-type="bibr" rid="B57-ijerph-09-02121">57</xref>]. Thus in addition to serving as a reminder to be cautious about the conclusions to be drawn from any single study, the present results underscore the importance of replications.</p>
      <p>However, it should be noticed that where the research question concerns the relative persuasiveness of two message kinds (e.g., gain-framed <italic>vs.</italic> loss-framed messages), replications can be created within the design of a single experiment. That is, rather than conducting an experiment examining just one pair of messages (as is the current practice), a researcher could instead compare multiple message pairs. Such designs require statistical analyses adapted to the presence of message replications, but obviously have substantial benefits with respect to establishing dependable generalizations about message effects [<xref ref-type="bibr" rid="B58-ijerph-09-02121">58</xref>,<xref ref-type="bibr" rid="B59-ijerph-09-02121">59</xref>,<xref ref-type="bibr" rid="B60-ijerph-09-02121">60</xref>]. Thus in future research aimed at examining the relative effectiveness of two message kinds for encouraging skin cancer prevention (or any other behavior), the research community need not wait for replications to be published; researchers can-and arguably should-be asked to include message replications in their designs, so as to provide evidence that any claimed effects generalize beyond that particular pair of messages. </p>
    </sec>
  </body>
  <back>
    <ack>
      <title>Acknowledgments</title>
      <p>Thanks to Hyunyi Cho, Anthony Cox, Sinéad Currie, Cynthia Hoffner, Angela Lee, Natalie Robinson, Yvonne Saadi, Andrea Shamaskin, and Lijiang Shen for providing information about their research.</p>
    </ack>
    <notes>
      <title>Conflict of Interest</title>
      <p>The authors declare no conflict of interest.</p>
    </notes>
    <ref-list>
      <title>References</title>
      <ref id="B1-ijerph-09-02121">
        <label>1.</label>
        <citation citation-type="book">
		<collab>Cancer Research UK</collab>
          <source>Key Facts: Skin Cancer</source>
          <publisher-name>Cancer Research UK</publisher-name>
          <publisher-loc>London, UK, 2012</publisher-loc>
          <year>2012</year>
        </citation>
      </ref>
      <ref id="B2-ijerph-09-02121">
        <label>2.</label>
        <citation citation-type="book">
		<collab>American Cancer Society</collab>
          <source>Cancer Facts &amp; Figures</source>
          <publisher-name>American Cancer Society</publisher-name>
          <publisher-loc>Atlanta, GA, USA</publisher-loc>
          <year>2012</year>
        </citation>
      </ref>
      <ref id="B3-ijerph-09-02121">
        <label>3.</label>
        <citation citation-type="gov">
		<collab>US Cancer Statistics Working Group</collab>
          <source>United States Cancer Statistics: 1999-2008 Incidence and Mortality Web-Based Report</source>
          <publisher-name>U.S. Department of Health and Human Services, Centers for Disease Control and Prevention and National Cancer Institute</publisher-name>
          <publisher-loc>Atlanta, GA, USA</publisher-loc>
          <year>2012</year>
        </citation>
      </ref>
      <ref id="B4-ijerph-09-02121">
        <label>4.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rogers</surname>
              <given-names>H.W.</given-names>
            </name>
            <name>
              <surname>Weinstock</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Harris</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Hinckley</surname>
              <given-names>M.R.</given-names>
            </name>
            <name>
              <surname>Feldman</surname>
              <given-names>S.R.</given-names>
            </name>
            <name>
              <surname>Fleischer</surname>
              <given-names>A.B.</given-names>
            </name>
            <name>
              <surname>Coldiron</surname>
              <given-names>B.M.</given-names>
            </name>
          </person-group>
          <article-title>Incidence estimate of nonmelanoma skin cancer in the United States, 2006</article-title>
          <source>Arch. Dermatol.</source>
          <year>2010</year>
          <volume>146</volume>
          <fpage>283</fpage>
          <lpage>287</lpage>
          <pub-id pub-id-type="doi">10.1001/archdermatol.2010.19</pub-id>
        </citation>
      </ref>
      <ref id="B5-ijerph-09-02121">
        <label>5.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rothman</surname>
              <given-names>A.J.</given-names>
            </name>
            <name>
              <surname>Salovey</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Shaping perceptions to motivate healthy behavior: The role of message framing</article-title>
          <source>Psychol. Bull.</source>
          <year>1997</year>
          <volume>121</volume>
          <fpage>3</fpage>
          <lpage>19</lpage>
          <pub-id pub-id-type="doi">10.1037/0033-2909.121.1.3</pub-id>
        </citation>
      </ref>
      <ref id="B6-ijerph-09-02121">
        <label>6.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Salovey</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Schneider</surname>
              <given-names>T.R.</given-names>
            </name>
            <name>
              <surname>Apanovitch</surname>
              <given-names>A.M.</given-names>
            </name>
          </person-group>
          <article-title>Message Framing in the Prevention and Early Detection of Illness</article-title>
          <source>The Persuasion Handbook: Developments in Theory and Practice</source>
          <person-group person-group-type="editor">
            <name>
              <surname>Dillard</surname>
              <given-names>J.P.</given-names>
            </name>
            <name>
              <surname>Pfau</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <publisher-name>Sage Publications</publisher-name>
          <publisher-loc>Thousand Oaks, CA, USA</publisher-loc>
          <year>2002</year>
          <fpage>391</fpage>
          <lpage>406</lpage>
        </citation>
      </ref>
      <ref id="B7-ijerph-09-02121">
        <label>7.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>O’Keefe</surname>
              <given-names>D.J.</given-names>
            </name>
            <name>
              <surname>Jensen</surname>
              <given-names>J.D.</given-names>
            </name>
          </person-group>
          <article-title>The relative persuasiveness of gain-framed and loss-framed messages for encouraging disease detection behaviors: A meta-analytic review</article-title>
          <source>J Commun.</source>
          <year>2009</year>
          <volume>59</volume>
          <fpage>296</fpage>
          <lpage>316</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1460-2466.2009.01417.x</pub-id>
        </citation>
      </ref>
      <ref id="B8-ijerph-09-02121">
        <label>8.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>O’Keefe</surname>
              <given-names>D.J.</given-names>
            </name>
            <name>
              <surname>Jensen</surname>
              <given-names>J.D.</given-names>
            </name>
          </person-group>
          <article-title>The relative persuasiveness of gain-framed and loss-framed messages for encouraging disease prevention behaviors: A meta-analytic review</article-title>
          <source>J Health Commun.</source>
          <year>2007</year>
          <volume>12</volume>
          <fpage>623</fpage>
          <lpage>644</lpage>
          <pub-id pub-id-type="doi">10.1080/10810730701615198</pub-id>
        </citation>
      </ref>
      <ref id="B9-ijerph-09-02121">
        <label>9.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Akl</surname>
              <given-names>E.A.</given-names>
            </name>
            <name>
              <surname>Oxman</surname>
              <given-names>A.D.</given-names>
            </name>
            <name>
              <surname>Herrin</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Vist</surname>
              <given-names>G.E.</given-names>
            </name>
            <name>
              <surname>Terrenato</surname>
              <given-names>I.</given-names>
            </name>
            <name>
              <surname>Sperati</surname>
              <given-names>F.</given-names>
            </name>
            <name>
              <surname>Costiniuk</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Blank</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Schünemann</surname>
              <given-names>H. </given-names>
            </name>
          </person-group>
          <article-title>Framing of health information messages</article-title>
          <source>Cochrane Database Syst. Rev.</source>
          <year>2011</year>
          <pub-id pub-id-type="doi">10.1002/14651858.CD006777.pub2.</pub-id>
        </citation>
      </ref>
      <ref id="B10-ijerph-09-02121">
        <label>10.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gallagher</surname>
              <given-names>K.M.</given-names>
            </name>
            <name>
              <surname>Updegraff</surname>
              <given-names>J.A.</given-names>
            </name>
          </person-group>
          <article-title>Health message framing effects on attitudes, intentions, and behavior: A meta-analytic review</article-title>
          <source>Ann. Behav. Med.</source>
          <year>2012</year>
          <volume>43</volume>
          <fpage>101</fpage>
          <lpage>116</lpage>
          <pub-id pub-id-type="doi">10.1007/s12160-011-9308-7</pub-id>
        </citation>
      </ref>
      <ref id="B11-ijerph-09-02121">
        <label>11.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Leygue</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Chappé</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Meyer</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Verlhiac</surname>
              <given-names>J.F.</given-names>
            </name>
          </person-group>
          <article-title>Health information framing and ambivalent attitudes toward sun exposure</article-title>
          <source>Health Psychol. Rev.</source>
          <year>2007</year>
          <volume>1</volume>
          <pub-id pub-id-type="doi">10.1080/17437190701472504</pub-id>
        </citation>
      </ref>
      <ref id="B12-ijerph-09-02121">
        <label>12.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Real</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Rimal</surname>
              <given-names>R.N.</given-names>
            </name>
          </person-group>
          <article-title>Assessing the Importance of Skin Cancer: Effects of Frames of Reference and Issue Involvement</article-title>
          <source>Presented at The Annual Meeting of the International Communication Association</source>
          <conf-loc>Washington, DC, USA</conf-loc>
          <conf-date>22-26 May 2001</conf-date>
        </citation>
      </ref>
      <ref id="B13-ijerph-09-02121">
        <label>13.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Knapp-Oliver</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Aunaetitrakul</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Toh</surname>
              <given-names>G.</given-names>
            </name>
            <name>
              <surname>Sapkota</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Penny</surname>
              <given-names>T. </given-names>
            </name>
          </person-group>
          <article-title>Message Framing Influences Cognitive Processing and Retention of Information Regarding Skin Cancer</article-title>
          <source>Presented at The 23rd Annual Association for Psychological Science Convention</source>
          <conf-loc>Washington, DC, USA</conf-loc>
          <conf-date>24-27 May 2011</conf-date>
        </citation>
      </ref>
      <ref id="B14-ijerph-09-02121">
        <label>14.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Buboltz</surname>
              <given-names>W.</given-names>
            </name>
            <name>
              <surname>Mahoney</surname>
              <given-names>K.T.</given-names>
            </name>
            <name>
              <surname>Walzcyk</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Reactance and Message Frames: Does it Matter?</article-title>
          <source>Presented at The Fourteenth Annual Meeting of the American Association of Behavioral and Social Sciences</source>
          <conf-loc>Las Vegas, NV, USA</conf-loc>
          <conf-date>10-11 February 2011</conf-date>
        </citation>
      </ref>
      <ref id="B15-ijerph-09-02121">
        <label>15.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Craciun</surname>
              <given-names>C.</given-names>
            </name>
          </person-group>
          <article-title>Motivational and Volitional Processes in Sunscreen Use: A Longitudinal Online Experiment. Ph.D. Thesis, Free University of Berlin, Berlin, Germany, 2010</article-title>
          <access-date>(accessed on 31 May 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://www.diss.fu-berlin.de/diss/receive/FUDISS_thesis_000000020465" ext-link-type="uri">http://www.diss.fu-berlin.de/diss/receive/FUDISS_thesis_000000020465</ext-link></comment>
        </citation>
      </ref>
      <ref id="B16-ijerph-09-02121">
        <label>16.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hevey</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Dolan</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Approach-inhibition disposition moderates the effects of framing skin cancer information on affective responses</article-title>
          <source>Psychol. Health</source>
          <year>2008</year>
          <volume>23</volume>
          <fpage>141</fpage>
          <lpage>142</lpage>
          <supplement>(Suppl 1)</supplement>
        </citation>
      </ref>
      <ref id="B17-ijerph-09-02121">
        <label>17.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Kang</surname>
              <given-names>H. </given-names>
            </name>
          </person-group>
          <article-title>The Influence of Fear Appeal on Persuasion Effects for Skin Cancer Public Service Announcements (PSAs) According to Fear Message Framing and Fear Type</article-title>
          <source>Presented at The Conference of the Association for Education in Journalism and Mass Communication</source>
          <conf-loc>St. Louis, MO, USA</conf-loc>
          <conf-date>10-13 August 2011</conf-date>
        </citation>
      </ref>
      <ref id="B18-ijerph-09-02121">
        <label>18.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rothman</surname>
              <given-names>A.J.</given-names>
            </name>
            <name>
              <surname>Salovey</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Antone</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Keough</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Martin</surname>
              <given-names>C.D.</given-names>
            </name>
          </person-group>
          <article-title>The influence of message framing on intentions to perform health behaviors</article-title>
          <source>J. Exp. Soc. Psychol.</source>
          <year>1993</year>
          <volume>29</volume>
          <fpage>408</fpage>
          <lpage>433</lpage>
          <pub-id pub-id-type="doi">10.1006/jesp.1993.1019</pub-id>
        </citation>
      </ref>
      <ref id="B19-ijerph-09-02121">
        <label>19.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Lemieux</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Hale</surname>
              <given-names>J.L.</given-names>
            </name>
            <name>
              <surname>Mongeau</surname>
              <given-names>P.A. </given-names>
            </name>
          </person-group>
          <article-title>Reducing Risk Behaviors Related to Sun Exposure: The Effects of Fear Appeals, Vividness, and Message Framing</article-title>
          <source>Presented at The Annual Meeting of the Speech Communication Association</source>
          <conf-loc>New Orleans, LA, USA</conf-loc>
          <conf-date>18-22 November 1994</conf-date>
        </citation>
      </ref>
      <ref id="B20-ijerph-09-02121">
        <label>20.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Block</surname>
              <given-names>L.G.</given-names>
            </name>
          </person-group>
          <article-title>The Effects of Perceived Efficacy, Message Framing and Vividness on the Persuasiveness of a Fear Appeal. Ph.D. Thesis, Columbia University, New York, NY, USA</article-title>
          <year>1993</year>
        </citation>
      </ref>
      <ref id="B21-ijerph-09-02121">
        <label>21.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Block</surname>
              <given-names>L.G.</given-names>
            </name>
            <name>
              <surname>Keller</surname>
              <given-names>P.A.</given-names>
            </name>
          </person-group>
          <article-title>When to accentuate the negative: The effects of perceived efficacy and message framing on intentions to perform a health-related behavior</article-title>
          <source>J. Mark. Res.</source>
          <year>1995</year>
          <volume>32</volume>
          <fpage>192</fpage>
          <lpage>203</lpage>
          <pub-id pub-id-type="doi">10.2307/3152047</pub-id>
        </citation>
      </ref>
      <ref id="B22-ijerph-09-02121">
        <label>22.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Cho</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Sands</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>Gain- and loss-frame sun safety messages and psychological reactance of adolescents</article-title>
          <source>Commun. Res. Rep.</source>
          <year>2011</year>
          <volume>28</volume>
          <fpage>308</fpage>
          <lpage>317</lpage>
          <pub-id pub-id-type="doi">10.1080/08824096.2011.616242</pub-id>
        </citation>
      </ref>
      <ref id="B23-ijerph-09-02121">
        <label>23.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hwang</surname>
              <given-names>Y.</given-names>
            </name>
            <name>
              <surname>Cho</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Sands</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Jeong</surname>
              <given-names>S.H.</given-names>
            </name>
          </person-group>
          <article-title>Effects of gain- and loss-framed messages on the sun safety behavior of adolescents: The moderating role of risk perceptions</article-title>
          <source>J. Health Psychol. </source>
          <year>2011</year>
          <pub-id pub-id-type="doi">10.1177/1359105311428536.</pub-id>
        </citation>
      </ref>
      <ref id="B24-ijerph-09-02121">
        <label>24.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hevey</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Pertl</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Thomas</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Maher</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Craig</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Chuinneagáin</surname>
              <given-names>S.N.</given-names>
            </name>
          </person-group>
          <article-title>Body consciousness moderates the effect of message framing on intentions to use sunscreen</article-title>
          <source>Int. J. Psychol.</source>
          <year>2008</year>
          <volume>43</volume>
          <pub-id pub-id-type="doi">10.1080/00207594.2008.10108483.</pub-id>
        </citation>
      </ref>
      <ref id="B25-ijerph-09-02121">
        <label>25.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hevey</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Pertl</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Thomas</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Maher</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Craig</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Chuinneagáin</surname>
              <given-names>S.N.</given-names>
            </name>
          </person-group>
          <article-title>Body consciousness moderates the effect of message framing on intentions to use sunscreen</article-title>
          <source>J. Health Psychol.</source>
          <year>2010</year>
          <volume>15</volume>
          <fpage>553</fpage>
          <lpage>559</lpage>
          <pub-id pub-id-type="doi">10.1177/1359105309355335</pub-id>
        </citation>
      </ref>
      <ref id="B26-ijerph-09-02121">
        <label>26.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Thomas</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Hevey</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Pertl</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Chuinneagáin</surname>
              <given-names>S.N.</given-names>
            </name>
            <name>
              <surname>Craig</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Maher</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>Appearance matters: The frame and focus of health messages influences beliefs about skin cancer</article-title>
          <source>Br. J. Health Psychol.</source>
          <year>2011</year>
          <volume>16</volume>
          <fpage>418</fpage>
          <lpage>429</lpage>
          <pub-id pub-id-type="doi">10.1348/135910710X520088</pub-id>
        </citation>
      </ref>
      <ref id="B27-ijerph-09-02121">
        <label>27.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Hoffner</surname>
              <given-names>C.A.</given-names>
            </name>
            <name>
              <surname>Ye</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>News about Sunscreen and Skin Cancer: The Role of Framing and Social Comparison</article-title>
          <source>Presented at The Annual Meeting of the International Communication Association</source>
          <conf-loc>New Orleans, LA, USA</conf-loc>
          <conf-date>27-31 May 2004</conf-date>
        </citation>
      </ref>
      <ref id="B28-ijerph-09-02121">
        <label>28.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hoffner</surname>
              <given-names>C.A.</given-names>
            </name>
            <name>
              <surname>Ye</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Young adults’ responses to news about sunscreen and skin cancer: The role of framing and social comparison</article-title>
          <source>Health Commun.</source>
          <year>2009</year>
          <volume>24</volume>
          <fpage>189</fpage>
          <lpage>198</lpage>
          <pub-id pub-id-type="doi">10.1080/10410230902804067</pub-id>
        </citation>
      </ref>
      <ref id="B29-ijerph-09-02121">
        <label>29.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Nan</surname>
              <given-names>X.</given-names>
            </name>
          </person-group>
          <article-title>Influence of Incidental Affect and Message Framing on Persuasion: The Case of promoting sun Protection Behaviors</article-title>
          <source>Presented at The Annual Conference of the Association for Education in Journalism and Mass Communication</source>
          <conf-loc>Chicago, IL, USA</conf-loc>
          <conf-date>6-9 August 2008</conf-date>
        </citation>
      </ref>
      <ref id="B30-ijerph-09-02121">
        <label>30.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Nan</surname>
              <given-names>X.</given-names>
            </name>
          </person-group>
          <article-title>Influence of incidental affect and message framing on persuasion: The case of promoting sun protection behaviors</article-title>
          <source>Int. Pub. Health J.</source>
          <year>2011</year>
          <volume>3</volume>
          <fpage>111</fpage>
          <lpage>121</lpage>
        </citation>
      </ref>
      <ref id="B31-ijerph-09-02121">
        <label>31.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Seo</surname>
              <given-names>K.W.</given-names>
            </name>
          </person-group>
          <article-title>Effects of Visual Images in Health Message Framing. M.S. Thesis, Pennsylvania State University, University Park, PA, USA</article-title>
          <year>2008</year>
          <access-date>(accessed on 31 May 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="https://etda.libraries.psu.edu/paper/8704/4021" ext-link-type="uri">https://etda.libraries.psu.edu/paper/8704/4021</ext-link></comment>
        </citation>
      </ref>
      <ref id="B32-ijerph-09-02121">
        <label>32.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Seo</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Shen</surname>
              <given-names>F. </given-names>
            </name>
          </person-group>
          <article-title>The Interactive Effects of Visual Images and Message Framing on Health-Related Persuasion</article-title>
          <source>Presented at The Annual Conference of the International Communication Association</source>
          <conf-loc>Chicago, IL</conf-loc>
          <conf-date>21-25 May 2009</conf-date>
        </citation>
      </ref>
      <ref id="B33-ijerph-09-02121">
        <label>33.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Shamaskin</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Getting the Message Across: Examining Information Presentation and Healthcare Decision Making among Older Adults. Undergraduate Honors Thesis, Human Development, Cornell University, Ithaca, NY, USA</article-title>
          <year>2009</year>
          <access-date>(accessed on 31 May 2012).</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="ecommons.cornell.edu/bitstream/1813/12656/1/THESIS.doc" ext-link-type="uri">ecommons.cornell.edu/bitstream/1813/12656/1/THESIS.doc</ext-link></comment>
        </citation>
      </ref>
      <ref id="B34-ijerph-09-02121">
        <label>34.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Shamaskin</surname>
              <given-names>A.M.</given-names>
            </name>
            <name>
              <surname>Mikels</surname>
              <given-names>J.A.</given-names>
            </name>
            <name>
              <surname>Reed</surname>
              <given-names>A.E.</given-names>
            </name>
          </person-group>
          <article-title>Getting the message across: Age differences in the positive and negative framing of health care messages</article-title>
          <source>Psychol. Aging</source>
          <year>2010</year>
          <volume>25</volume>
          <fpage>746</fpage>
          <lpage>751</lpage>
          <pub-id pub-id-type="doi">10.1037/a0018431</pub-id>
        </citation>
      </ref>
      <ref id="B35-ijerph-09-02121">
        <label>35.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Shen</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>The Interplay of Message Framing, Cognition and Affect in Persuasive Health Communication. Ph.D. Thesis, University of Wisconsin-Madison, Madison, MI, USA</article-title>
          <year>2005</year>
        </citation>
      </ref>
      <ref id="B36-ijerph-09-02121">
        <label>36.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Shen</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Dillard</surname>
              <given-names>J.P.</given-names>
            </name>
          </person-group>
          <article-title>The influence of behavioral inhibition/approach systems and message framing on the processing of persuasive health messages</article-title>
          <source>Commun. Res.</source>
          <year>2007</year>
          <volume>34</volume>
          <fpage>433</fpage>
          <lpage>467</lpage>
          <pub-id pub-id-type="doi">10.1177/0093650207302787</pub-id>
        </citation>
      </ref>
      <ref id="B37-ijerph-09-02121">
        <label>37.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Stoner</surname>
              <given-names>S.A. </given-names>
            </name>
          </person-group>
          <article-title>Goal Framing of Health Related Behaviors: What Factors Contribute to the Persuasiveness of a Message? Ph.D. Thesis, West Virginia University, Morgantown, WV, USA</article-title>
          <year>2010</year>
        </citation>
      </ref>
      <ref id="B38-ijerph-09-02121">
        <label>38.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Stoner</surname>
              <given-names>S.</given-names>
            </name>
          </person-group>
          <article-title>Goal framing of health related behaviors: What factors contribute to the persuasiveness of a message?</article-title>
          <source>Gerontologist</source>
          <year>2009</year>
          <volume>49</volume>
          <fpage>115</fpage>
          <supplement>(Suppl. 2)</supplement>
        </citation>
      </ref>
      <ref id="B39-ijerph-09-02121">
        <label>39.</label>
        <citation citation-type="other">
          <person-group person-group-type="author">
            <name>
              <surname>Borenstein</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Rothstein</surname>
              <given-names>H.</given-names>
            </name>
          </person-group>
          <source>Comprehensive Meta-Analysis, Version 2.2.023</source>
          <publisher-name>Biostat</publisher-name>
          <publisher-loc>Englewood, NJ, USA</publisher-loc>
          <year>2005</year>
        </citation>
      </ref>
      <ref id="B40-ijerph-09-02121">
        <label>40.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Cox</surname>
              <given-names>A.D.</given-names>
            </name>
            <name>
              <surname>Cox</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Zimet</surname>
              <given-names>G.</given-names>
            </name>
          </person-group>
          <article-title>Understanding consumer responses to product risk information</article-title>
          <source>J. Mark.</source>
          <year>2006</year>
          <volume>70</volume>
          <fpage>79</fpage>
          <lpage>91</lpage>
          <pub-id pub-id-type="doi">10.1509/jmkg.2006.70.1.79</pub-id>
        </citation>
      </ref>
      <ref id="B41-ijerph-09-02121">
        <label>41.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Currie</surname>
              <given-names>S.A. </given-names>
            </name>
          </person-group>
          <article-title>The influence of Message Framing and Health Locus of Control upon Intentions to Using Sunscreen. Undergraduate Thesis, Department of Psychology, University of Stirling, Stirling, Scotland, UK</article-title>
          <year>2010</year>
        </citation>
      </ref>
      <ref id="B42-ijerph-09-02121">
        <label>42.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Detweiler</surname>
              <given-names>J.B.</given-names>
            </name>
            <name>
              <surname>Bedell</surname>
              <given-names>B.T.</given-names>
            </name>
            <name>
              <surname>Salovey</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Pronin</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Rothman</surname>
              <given-names>A.J.</given-names>
            </name>
          </person-group>
          <article-title>Message framing and sunscreen use: Gain-framed messages motivate beach-goers</article-title>
          <source>Health Psychol.</source>
          <year>1999</year>
          <volume>18</volume>
          <fpage>189</fpage>
          <lpage>196</lpage>
          <pub-id pub-id-type="doi">10.1037/0278-6133.18.2.189</pub-id>
        </citation>
      </ref>
      <ref id="B43-ijerph-09-02121">
        <label>43.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Fischer</surname>
              <given-names>J.C.</given-names>
            </name>
            <name>
              <surname>Nabi</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Priming Frames: Can Framing Effects Extend Beyond Message Topic?</article-title>
          <source>Presented at The Annual Meeting of the International Communication Association</source>
          <conf-loc>Washington, DC, USA</conf-loc>
          <conf-date>24-28 November 2001</conf-date>
        </citation>
      </ref>
      <ref id="B44-ijerph-09-02121">
        <label>44.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Ku</surname>
              <given-names>A.W. </given-names>
            </name>
          </person-group>
          <article-title>The Impact of Health Advertising on Health Risk Perceptions and Behavioural Intention. M.S. Thesis, University of Guelph, Guelph, ON, Canada</article-title>
          <year>2008</year>
        </citation>
      </ref>
      <ref id="B45-ijerph-09-02121">
        <label>45.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Lee</surname>
              <given-names>A.Y.</given-names>
            </name>
            <name>
              <surname>Aaker</surname>
              <given-names>J.L.</given-names>
            </name>
          </person-group>
          <article-title>Bringing the frame into focus: The influence of regulatory fit on processing fluency and persuasion</article-title>
          <source>J. Pers. Soc. Psychol.</source>
          <year>2004</year>
          <volume>86</volume>
          <fpage>205</fpage>
          <lpage>218</lpage>
          <pub-id pub-id-type="doi">10.1037/0022-3514.86.2.205</pub-id>
        </citation>
      </ref>
      <ref id="B46-ijerph-09-02121">
        <label>46.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Lee</surname>
              <given-names>C.K.-C.</given-names>
            </name>
            <name>
              <surname>Brown</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Blood</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <article-title>The effects of efficacy, cognitive processing and message framing on persuasion</article-title>
          <source>Australas. Mark. J.</source>
          <year>2000</year>
          <volume>8</volume>
          <fpage>5</fpage>
          <lpage>17</lpage>
        </citation>
      </ref>
      <ref id="B47-ijerph-09-02121">
        <label>47.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>McCormick</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Does Lateral Attention Affect Health Behavior?: Investigating Hemispheric Influences in Framed Health Messages. M.S. Thesis, University of North Carolina at Greensboro, Greensboro, NC, USA</article-title>
          <year>2010</year>
        </citation>
      </ref>
      <ref id="B48-ijerph-09-02121">
        <label>48.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Robinson</surname>
              <given-names>N.G.</given-names>
            </name>
          </person-group>
          <article-title>Young Women’s Sun-protective Attitudes and Behaviours: The Role of Social Influence Factors. Ph.D. Thesis, Queensland University of Technology, Brisbane, Australia</article-title>
          <year>2004</year>
          <access-date>(accessed on 31 May 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://eprints.qut.edu.au/16042/1/Natalie_Robinson_Thesis.pdf" ext-link-type="uri">http://eprints.qut.edu.au/16042/1/Natalie_Robinson_Thesis.pdf</ext-link></comment>
        </citation>
      </ref>
      <ref id="B49-ijerph-09-02121">
        <label>49.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Saadi</surname>
              <given-names>Y.M. </given-names>
            </name>
          </person-group>
          <article-title>Policy and Prevention: An Analysis of the Effectiveness of Contingency-based Intervention on the Adoption of Cancer Screening Behavior. Undergraduate Thesis, University of Pittsburgh, Pittsburgh, PA, USA</article-title>
          <year>2009</year>
        </citation>
      </ref>
      <ref id="B50-ijerph-09-02121">
        <label>50.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Schubert</surname>
              <given-names>B.L.</given-names>
            </name>
          </person-group>
          <article-title>A UV Protection Intervention for Skin Cancer Prevention. Undergraduate Honors Thesis, Department of Psychology, Florida State University, Tallahassee, FL, USA</article-title>
          <year>2008</year>
        </citation>
      </ref>
      <ref id="B51-ijerph-09-02121">
        <label>51.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Shen</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Kollar</surname>
              <given-names>L.M.</given-names>
            </name>
          </person-group>
          <article-title>Searching for Moderators of Message Framing Effect: A Motivational Approach</article-title>
          <source>Presented at The Annual Conference of the National Communication Association</source>
          <conf-loc>New Orleans, LA, USA</conf-loc>
          <conf-date>17-20 November 2011.</conf-date>
        </citation>
      </ref>
      <ref id="B52-ijerph-09-02121">
        <label>52.</label>
        <citation citation-type="confproc">
          <person-group person-group-type="author">
            <name>
              <surname>Smith</surname>
              <given-names>L.L.</given-names>
            </name>
          </person-group>
          <article-title>Communicating Effective Skin Cancer Messages</article-title>
          <source>Presented at The International Communication Association Conference</source>
          <conf-loc>San Diego, CA, USA</conf-loc>
          <conf-date>23-27 May 2003.</conf-date>
        </citation>
      </ref>
      <ref id="B53-ijerph-09-02121">
        <label>53.</label>
        <citation citation-type="thesis">
          <person-group person-group-type="author">
            <name>
              <surname>Taber</surname>
              <given-names>J.M.</given-names>
            </name>
          </person-group>
          <article-title>Hypothetical Genetic Disease Risk Moderates the Effect of Message Framing on Sunscreen Attitudes and Intentions. M.S. Thesis, University of Utah, Salt Lake City, UT, USA</article-title>
          <year>2010</year>
          <access-date>(accessed on 31 May 2012)</access-date>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://content.lib.utah.edu/cdm4/document.php?CISOROOT=/us-etd2&amp;CISOPTR=199116" ext-link-type="uri">http://content.lib.utah.edu/cdm4/document.php?CISOROOT=/us-etd2&amp;CISOPTR=199116</ext-link></comment>
        </citation>
      </ref>
      <ref id="B54-ijerph-09-02121">
        <label>54.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Lipsey</surname>
              <given-names>M.W.</given-names>
            </name>
            <name>
              <surname>Wilson</surname>
              <given-names>D.B.</given-names>
            </name>
          </person-group>
          <source>Practical Meta-Analysis</source>
          <publisher-name>Sage Publications</publisher-name>
          <publisher-loc>Thousand Oaks, CA, USA</publisher-loc>
          <year>2001</year>
          <fpage>138</fpage>
          <lpage>140</lpage>
        </citation>
      </ref>
      <ref id="B55-ijerph-09-02121">
        <label>55.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hedges</surname>
              <given-names>L.V.</given-names>
            </name>
            <name>
              <surname>Pigott</surname>
              <given-names>T.D.</given-names>
            </name>
          </person-group>
          <article-title>The power of statistical tests in meta-analysis</article-title>
          <source>Psychol. Methods</source>
          <year>2001</year>
          <volume>6</volume>
          <fpage>203</fpage>
          <lpage>217</lpage>
          <pub-id pub-id-type="doi">10.1037/1082-989X.6.3.203</pub-id>
        </citation>
      </ref>
      <ref id="B56-ijerph-09-02121">
        <label>56.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Ioannidis</surname>
              <given-names>J.P.</given-names>
            </name>
          </person-group>
          <article-title>Why most published research findings are false</article-title>
          <source>PLoS Med.</source>
          <year>2005</year>
          <volume>2</volume>
          <fpage>696</fpage>
          <lpage>701</lpage>
        </citation>
      </ref>
      <ref id="B57-ijerph-09-02121">
        <label>57.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Ioannidis</surname>
              <given-names>J.P.</given-names>
            </name>
          </person-group>
          <article-title>Contradicted and initially stronger effects in highly cited clinical research</article-title>
          <source>JAMA</source>
          <year>2005</year>
          <volume>294</volume>
          <fpage>218</fpage>
          <lpage>228</lpage>
          <pub-id pub-id-type="doi">10.1001/jama.294.2.218</pub-id>
        </citation>
      </ref>
      <ref id="B58-ijerph-09-02121">
        <label>58.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Jackson</surname>
              <given-names>S.</given-names>
            </name>
          </person-group>
          <source>Message Effects Research: Principles of Design and Analysis</source>
          <publisher-name>Guilford Press</publisher-name>
          <publisher-loc>New York, NY, USA</publisher-loc>
          <year>1992</year>
        </citation>
      </ref>
      <ref id="B59-ijerph-09-02121">
        <label>59.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Jackson</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Brashers</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <article-title>M &gt; 1: Analysis of treatment x replication designs</article-title>
          <source>Hum. Commun. Res.</source>
          <year>1994</year>
          <volume>20</volume>
          <fpage>356</fpage>
          <lpage>389</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1468-2958.1994.tb00327.x</pub-id>
        </citation>
      </ref>
      <ref id="B60-ijerph-09-02121">
        <label>60.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Jackson</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Jacobs</surname>
              <given-names>S. </given-names>
            </name>
          </person-group>
          <article-title>Generalizing about messages: Suggestions for design and analysis of experiments</article-title>
          <source>Hum. Commun. Res.</source>
          <year>1983</year>
          <volume>9</volume>
          <fpage>169</fpage>
          <lpage>181</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1468-2958.1983.tb00691.x</pub-id>
        </citation>
      </ref>
    </ref-list>
  </back>
</article>
