<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xml:lang="en" article-type="research-article" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">risks</journal-id>
      <journal-title>Risks</journal-title>
      <abbrev-journal-title abbrev-type="publisher">Risks</abbrev-journal-title>
      <abbrev-journal-title abbrev-type="pubmed">Risks</abbrev-journal-title>
      <issn pub-type="epub">2227-9091</issn>
      <publisher>
        <publisher-name>MDPI</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.3390/risks1010034</article-id>
      <article-id pub-id-type="publisher-id">risks-01-00034</article-id>
      <article-categories>
        <subj-group>
          <subject>Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Understanding the &#x201C;Black Box&#x201D; of Employer Decisions about Health Insurance Benefits: The Case of Depression Products</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Rost</surname>
            <given-names>Kathryn</given-names>
          </name>
          <xref rid="af1-risks-01-00034" ref-type="aff">1</xref>
          <xref rid="c1-risks-01-00034" ref-type="corresp">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Papadopoulos</surname>
            <given-names>Airia</given-names>
          </name>
          <xref rid="af1-risks-01-00034" ref-type="aff">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Wang</surname>
            <given-names>Su</given-names>
          </name>
          <xref rid="af1-risks-01-00034" ref-type="aff">1</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Marshall</surname>
            <given-names>Donna</given-names>
          </name>
          <xref rid="af2-risks-01-00034" ref-type="aff">2</xref>
        </contrib>
      </contrib-group>
      <aff id="af1-risks-01-00034"><label>1</label>Department of Mental Health Law and Policy, College of Behavioral and Community Sciences, 13301 Bruce B. Downs Blvd., University of South Florida, Tampa FL 33612, USA; E-Mails: <email>asp@usf.edu</email> (A.P.); <email>wangs@usf.edu</email> (S.W.)</aff>
      <aff id="af2-risks-01-00034"><label>2</label>Colorado Business Group on Health, 12640 West Cedar Drive, Lakewood, CO 80228, USA; E-Mail: <email>donna.marshall@cbghealth.org</email></aff>
      <author-notes>
        <corresp id="c1-risks-01-00034"><label>*</label> Author to whom correspondence should be addressed; E-Mail: <email>kmrost@usf.edu</email>; Tel: 1-720-231-3679; Fax: 1-813-974-4602.</corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>29</day>
        <month>05</month>
        <year>2013</year>
      </pub-date>
      <pub-date pub-type="collection"><month>06</month>
        <year>2013</year>
      </pub-date>
      <volume>1</volume>
      <issue>1</issue>
      <fpage>34</fpage>
      <lpage>42</lpage>
      <history>
        <date date-type="received">
          <day>07</day>
          <month>03</month>
          <year>2013</year>
        </date>
        <date date-type="rev-recd">
          <day>20</day>
          <month>05</month>
          <year>2013</year>
        </date>
        <date date-type="accepted">
          <day>21</day>
          <month>05</month>
          <year>2013</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>&#x000A9; 2013 by the authors; licensee MDPI, Basel, Switzerland.</copyright-statement>
        <copyright-year>2013</copyright-year>
        <license xmlns:xlink="http://www.w3.org/1999/xlink" license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/">
          <p>This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p>
        </license>
      </permissions>
      <abstract>
        <p>In a randomized trial of two interventions on employer health benefit decision-making, 156 employers in the evidence-based (EB) condition attended a two hour presentation reviewing scientific evidence demonstrating depression products that increase high quality treatment of depression in the workforce provide the employer a return on investment. One-hundred sixty-nine employers participating in the usual care (UC) condition attended a similar length presentation reviewing scientific evidence supporting healthcare effectiveness data and information set (HEDIS) monitoring. This study described the decision-making process in 264 (81.2%) employers completing 12 month follow-up. The EB intervention did not increase the proportion of employers who discussed depression products with others in the company (29.2% <italic>versus</italic> 32.1%, <italic>p</italic> &gt; 0.10), but it did significantly influence the content of the discussions that occurred. Discussion in EB companies promoted the capacity of a depression product to realize a return on investment (18.4% <italic>versus</italic> 4.7%, <italic>p</italic> = 0.05) and to improve productivity (47.4% <italic>versus</italic> 25.6%, <italic>p</italic> = 0.06) more often than discussions in UC companies. Almost half of EB and UC employers reported that return on investment has a large impact on health benefit decision-making. These results demonstrate the difficulty of influencing employer decisions about health benefits using group presentations. </p>
      </abstract>
      <kwd-group>
        <kwd>: health benefits</kwd>
        <kwd>insurance</kwd>
        <kwd>depression</kwd>
        <kwd>employers</kwd>
        <kwd>return on investment</kwd>
        <kwd>productivity</kwd>
        <kwd>absenteeism</kwd>
        <kwd>collaborative care</kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>1. Introduction</title>
      <p>Health insurance purchasers need to actively support efforts to enhance primary care depression treatment to translate science to practice [<xref ref-type="bibr" rid="B1-risks-01-00034">1</xref>], because intervention models that improve outcomes [<xref ref-type="bibr" rid="B2-risks-01-00034">2</xref>,<xref ref-type="bibr" rid="B3-risks-01-00034">3</xref>] also increase the direct costs of care [<xref ref-type="bibr" rid="B4-risks-01-00034">4</xref>], at least initially [<xref ref-type="bibr" rid="B5-risks-01-00034">5</xref>]. Employers represent a substantial segment of purchasers, offering health insurance coverage to 88.8% of individuals in the workforce [<xref ref-type="bibr" rid="B6-risks-01-00034">6</xref>]. Employers suffer when 7.6% of the workforce suffers a major depressive episode [<xref ref-type="bibr" rid="B7-risks-01-00034">7</xref>], because the illness substantially reduces work functioning [<xref ref-type="bibr" rid="B8-risks-01-00034">8</xref>,<xref ref-type="bibr" rid="B9-risks-01-00034">9</xref>]. Employers interested in ensuring their workers receive these intervention models can purchase depression products from their health plans or disease management companies [<xref ref-type="bibr" rid="B10-risks-01-00034">10</xref>]. Randomized trials demonstrate that these models improve absenteeism and productivity at work [<xref ref-type="bibr" rid="B11-risks-01-00034">11</xref>] sufficiently for selected employers to realize a return on investment [<xref ref-type="bibr" rid="B12-risks-01-00034">12</xref>] with competitive pricing.</p>
      <p>The objective of the study is to test a randomly assigned intervention to influence employers to purchase depression products for their employees. In the trial, 156 evidence-based (EB) condition employers attended a presentation describing the scientific evidence supporting depression products, and 169 usual care (UC) condition employers attended a presentation describing the scientific evidence supporting healthcare effectiveness data and information set (HEDIS) monitoring. The EB presentation provided employers specific arguments to support the purchase of a depression product, including company-specific estimates derived from the scientific literature for return on investment [<xref ref-type="bibr" rid="B13-risks-01-00034">13</xref>]. The objective of this study is to test EB intervention impact on decision-making about depression products in the year following the presentation. Key content areas included arguments made for and against the purchase of a depression product, triggers to the future purchase of a depression product and the importance of return on investment in the company&#x2019;s health benefit decision-making.</p>
    </sec>
    <sec sec-type="results">
      <title>2. Results and Discussion</title>
      <sec>
        <title>2.1. Sample</title>
        <p>The sample consisted of 264 employers who responded at 12 month follow-up (81.2% of the baseline sample). The organizational characteristics of responding employers are described in <xref ref-type="table" rid="risks-01-00034-t001">Table 1</xref>. </p>
        <table-wrap id="risks-01-00034-t001" position="float">
          <object-id pub-id-type="pii">risks-01-00034-t001_Table 1</object-id>
          <label>Table 1</label>
          <caption>
  <p>Organizational characteristics (n = 264).</p>
          </caption>
          <table rules="all" style="border:solid thin">
            <tbody>
              <tr>
                <td align="center" valign="middle">
                  <bold>Size</bold>                </td>
                <td align="left" valign="middle"> </td>
              </tr>
              <tr>
                <td align="left" valign="middle">% small (100 to 500 employees)</td>
                <td align="left" valign="middle">35.2</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% medium (501 to 2,500 employees)</td>
                <td align="left" valign="middle">33.0</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% large (2,501 plus employees)</td>
                <td align="left" valign="middle">31.8</td>
              </tr>
              <tr>
                <td align="center" valign="middle">
                  <bold>Type</bold>                </td>
                <td align="left" valign="middle"> </td>
              </tr>
              <tr>
                <td align="left" valign="middle">% for-profit</td>
                <td align="left" valign="middle">54.2</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% not-for-profit</td>
                <td align="left" valign="middle">26.3</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% public sector</td>
                <td align="left" valign="middle">19.5</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Company age (SD)</td>
                <td align="left" valign="middle">73.6 (47.5)</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Health plan carriers (SD)</td>
                <td align="left" valign="middle">1.9 (2.1)</td>
              </tr>
              <tr>
                <td align="center" valign="middle">
                  <bold>Insurance Risk</bold>                </td>
                <td align="left" valign="middle"> </td>
              </tr>
              <tr>
                <td align="left" valign="middle">% fully insured</td>
                <td align="left" valign="middle">24.3</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% self-insured</td>
                <td align="left" valign="middle">51.0</td>
              </tr>
              <tr>
                <td align="left" valign="middle">% mixture of fully and self-insured</td>
                <td align="left" valign="middle">24.7</td>
              </tr>
            </tbody>
          </table>
        </table-wrap>
        <p>Although the EB and UC cohorts contained companies of statistically comparable size (<italic>p</italic> &gt; 0.10), large employers were less likely to complete 12 month follow-up (<italic>p</italic> &lt; 0.05). Thus, we controlled for company size in the comparisons we present in this manuscript. At 12 months, 29.2% (n = 38) of EB employers reported internal discussion of depression products by email exchange, telephone call, in-person meeting or group meeting with other employees of the organization only, compared to 33.1% (n = 43) of UC employers (<italic>p</italic> = 0.82). </p>
      </sec>
      <sec>
        <title>2.2. Arguments Made in Support of and Against Depression Product Purchase</title>
        <p>Employers reporting internal discussion were asked about arguments made in support of and against depression product purchase. As <xref ref-type="table" rid="risks-01-00034-t002">Table 2</xref> demonstrates, EB and UC employers reported their discussions included generally similar arguments in support of purchasing a depression product. Given that the EB presentation emphasized the scientific evidence demonstrating that depression products increase productivity and provide a return on investment, it was not surprising that these arguments occurred more often in EB than UC discussions. </p>
        <p>One EB employer indicated that &#x201C;associates who are directly or indirectly impacted by depression need some type of assistance to help them through the depression&#x201D; and then went on to say that &#x201C;in addition to direct health care costs&#x2026;there can be lower productivity for the associate and co-workers.&#x201D; Another EB employer indicated that offering a depression product &#x201C;benefits us as the employer because the employee can get the help they need to get well and ultimately return to work as a major contributor.&#x201D; A third EB employer succinctly stated that having a product would &#x201C;keep overall costs down and production up.&#x201D; UC employers echoed these arguments when they noted a &#x201C;healthier workforce and less absenteeism (equals) greater productivity,&#x201D; and the importance of &#x201C;(keeping) employees healthy&#x201D; in order to &#x201C;keep medical costs from going up due to untreated depression.&#x201D; </p>
        <table-wrap id="risks-01-00034-t002" position="float">
          <object-id pub-id-type="pii">risks-01-00034-t002_Table 2</object-id>
          <label>Table 2</label>
          <caption>
            <p>Arguments made in support of depression product purchase (n = 81).</p>
          </caption>
          <table rules="all" style="border:solid thin">
          <thead>
          <tr>
                <th align="left" valign="middle">&#x201C;What kinds of arguments were made in support of purchasing a depression product?&#x201D;</th>
                <th align="left" valign="middle">Percentage of EB Employer Responses by Theme (n = 38)</th>
                <th align="left" valign="middle">Percentage of UC Employer Responses by Theme (n = 43)</th>
              </tr>
          </thead>
            <tbody>
              <tr>
                <td align="left" valign="middle">Greater productivity**</td>
                <td align="left" valign="middle">47.4%</td>
                <td align="left" valign="middle">25.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Want to provide for employee&#x2019;s needs</td>
                <td align="left" valign="middle">29.0%</td>
                <td align="left" valign="middle">20.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Consider depression to be valuable and a needed product</td>
                <td align="left" valign="middle">26.3%</td>
                <td align="left" valign="middle">16.3%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Healthy workforce</td>
                <td align="left" valign="middle">21.1%</td>
                <td align="left" valign="middle">20.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Company costs/return on investment (ROI)*</td>
                <td align="left" valign="middle">18.4%</td>
                <td align="left" valign="middle">4.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Concerns about health care costs</td>
                <td align="left" valign="middle">15.8%</td>
                <td align="left" valign="middle">27.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Having a depression product helps meet employer&#x2019;s goals</td>
                <td align="left" valign="middle">7.9%</td>
                <td align="left" valign="middle">11.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">A product is already available</td>
                <td align="left" valign="middle">5.3%</td>
                <td align="left" valign="middle">4.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">No arguments made in support</td>
                <td align="left" valign="middle">5.3%</td>
                <td align="left" valign="middle">11.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Co-morbid physical and mental health issues</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">4.7%</td>
              </tr>
            </tbody>
          </table>
        <table-wrap-foot><fn><p>EB, evidence-based; UC, usual care; *<italic>p</italic> = 0.05, **<italic>p</italic> = 0.06.</p></fn></table-wrap-foot>
        </table-wrap>
        <p>As <xref ref-type="table" rid="risks-01-00034-t003">Table 3</xref> demonstrates, the arguments made against a depression product purchase were generally comparable in EB and UC discussions. </p>
        <table-wrap id="risks-01-00034-t003" position="float">
          <object-id pub-id-type="pii">risks-01-00034-t003_Table 3</object-id>
          <label>Table 3</label>
          <caption>
            <p>Arguments made against depression product purchase (n = 81).</p>
          </caption>
          <table rules="all" style="border:solid thin">
          <thead>
          <tr>
                <th align="left" valign="middle">&#x201C;What kinds of arguments were made against purchasing a depression product?&#x201D;</th>
                <th align="left" valign="middle">Percentage of EB Employer Responses by Theme (n = 38)</th>
                <th align="left" valign="middle">Percentage of UC Employer Responses by Theme (n = 43)</th>
              </tr>
          </thead>
            <tbody>
              
              <tr>
                <td align="left" valign="middle">No arguments made</td>
                <td align="left" valign="middle">47.4%</td>
                <td align="left" valign="middle">30.2%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Cost or benefit to employer</td>
                <td align="left" valign="middle">31.6%</td>
                <td align="left" valign="middle">46.5%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Confidentiality concerns</td>
                <td align="left" valign="middle">18.4%</td>
                <td align="left" valign="middle">11.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Value is not certain</td>
                <td align="left" valign="middle">15.8%</td>
                <td align="left" valign="middle">7.0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">It is (or should be) covered by health insurance</td>
                <td align="left" valign="middle">7.9%</td>
                <td align="left" valign="middle">7.0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Not needed or used by employees</td>
                <td align="left" valign="middle">7.9%</td>
                <td align="left" valign="middle">20.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Government mandate</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">4.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Too stigmatized an issue for employer to offer for employees</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">4.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Not employer&#x2019;s business</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">2.3%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Less valuable than other health conditions</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">2.3%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Not sure how to publicize</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">2.3%</td>
              </tr>
            </tbody>
          </table>
        <table-wrap-foot><fn><p>EB, evidence-based; UC, usual care </p></fn></table-wrap-foot>
        </table-wrap>
        <p>One EB employer reflected the information in the presentation by noting &#x201C;this [purchasing a depression product] is a no brainer.&#x201D; Contradicting information in the presentation, a second EB employer commented that &#x201C;depression products are so person to person specific [that] it is impossible to gauge what will be helpful and what will not&#x201D; and a third commented &#x201C;does anything work?&#x201D; Many UC employers, who had not been educated about the product&#x2019;s return on investment indicated that &#x201C;cost&#x201D; was an argument made against depression product adoption without elaborating; however, one employer considered the benefits of a depression product to be a &#x201C;poor performer [with regard to] costs.&#x201D; </p>
      </sec>
      <sec>
        <title>2.3. Triggers to Depression Product Purchase</title>
        <p>All employers not currently in the purchasing process were asked what would trigger their organization&#x2019;s purchase of a depression product. As <xref ref-type="table" rid="risks-01-00034-t004">Table 4</xref> demonstrates, EB and UC employers reported similar triggers might stimulate the purchase of a depression product. The most commonly reported trigger in both groups was a visible episode of depression in the company, often referred to as a &#x201C;poster child.&#x201D; Other common triggers were company-specific data on lost productivity, (further) increases in healthcare costs, management change and economic/financial improvement. </p>
        <table-wrap id="risks-01-00034-t004" position="float">
          <object-id pub-id-type="pii">risks-01-00034-t004_Table 4</object-id>
          <label>Table 4</label>
          <caption>
            <p>Triggers to depression product purchase (n = 246).</p>
          </caption>
          <table rules="all" style="border:solid thin">
          <thead>
          <tr>
                <th align="left" valign="middle">&#x201C;Your organization has not purchased a depression product. Imagine that two years from now, your organization decided to purchase a depression product. Can you describe the changes that must have occurred for your employer to make that decision?&#x201D;</th>
                <th align="left" valign="middle">Percentage of EB Employer Responses by Theme (n = 122)</th>
                <th align="left" valign="middle">Percentage of UC Employer Responses by Theme (n = 124)</th>
              </tr>
          </thead>
            <tbody>
              
              <tr>
                <td align="left" valign="middle">Visible (public) depression episode or otherwise demonstrated need</td>
                <td align="left" valign="middle">25.4%</td>
                <td align="left" valign="middle">20.2%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Data showing lost productivity or poor performance</td>
                <td align="left" valign="middle">21.3%</td>
                <td align="left" valign="middle">17.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Increased health care costs</td>
                <td align="left" valign="middle">17.2%</td>
                <td align="left" valign="middle">14.5%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Change in/support from management</td>
                <td align="left" valign="middle">10.7%</td>
                <td align="left" valign="middle">13.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Economy/company finances have to change</td>
                <td align="left" valign="middle">11.5%</td>
                <td align="left" valign="middle">5.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Demonstrated return on investment (ROI) or cost-benefit analysis</td>
                <td align="left" valign="middle">8.2%</td>
                <td align="left" valign="middle">5.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">None, does not apply or no response</td>
                <td align="left" valign="middle">7.4%</td>
                <td align="left" valign="middle">5.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Better products made available</td>
                <td align="left" valign="middle">6.6%</td>
                <td align="left" valign="middle">2.4%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Need additional information, understanding or training</td>
                <td align="left" valign="middle">5.7%</td>
                <td align="left" valign="middle">4.8%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Products should be part of health package</td>
                <td align="left" valign="middle">4.9%</td>
                <td align="left" valign="middle">7.3%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Company has or is taking steps to implement program</td>
                <td align="left" valign="middle">3.3%</td>
                <td align="left" valign="middle">4.8%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">No need for product/need would have to be demonstrated</td>
                <td align="left" valign="middle">3.3%</td>
                <td align="left" valign="middle">6.5%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Not sure</td>
                <td align="left" valign="middle">2.5%</td>
                <td align="left" valign="middle">2.4%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Requests from employees</td>
                <td align="left" valign="middle">1.6%</td>
                <td align="left" valign="middle">2.4%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Change in provider network</td>
                <td align="left" valign="middle">1.6%</td>
                <td align="left" valign="middle">0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Confidentiality</td>
                <td align="left" valign="middle">1.6%</td>
                <td align="left" valign="middle">0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Want to offer support to employees</td>
                <td align="left" valign="middle">1.6%</td>
                <td align="left" valign="middle">0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Other more urgent health issues must be resolved first</td>
                <td align="left" valign="middle">0.8%</td>
                <td align="left" valign="middle">0.8%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Government mandate</td>
                <td align="left" valign="middle">0.8%</td>
                <td align="left" valign="middle">1.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Better relationship with HMO/providers</td>
                <td align="left" valign="middle">0.8%</td>
                <td align="left" valign="middle">0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">A depression product should be simple to use</td>
                <td align="left" valign="middle">0.8%</td>
                <td align="left" valign="middle">0%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Do not want to appear to encourage treatment for depression</td>
                <td align="left" valign="middle">0%</td>
                <td align="left" valign="middle">0.8%</td>
              </tr>
            </tbody>
          </table>
        <table-wrap-foot><fn><p>EB, evidence-based; UC, usual care</p></fn></table-wrap-foot>
        </table-wrap>
        <p>One EB employer noted: &#x201C;huge increase in costs related to depression&#x2014;or a tragedy like the suicide of one of our employees due to depression.&#x201D; Another responded: &#x201C;obvious loss of productivity clearly tied to incidents of prolonged depression.&#x201D; Despite having received an estimate of the return on investment for his/her company for a depression product, a third EB employer said: &#x201C;the demand for the product and impact on productivity must have been identified and the cost of now providing the product estimated to be higher than the cost.&#x201D; One UC employer responded: &#x201C;a trend where employees are absent more frequently using short-term disability pay with the diagnosis of depression.&#x201D; Another said: &#x201C;We are 100% self-insured. Until we recover financially, we will not be able to purchase any product. It is purely financial.&#x201D; A third said &#x201C;depression would have to be in our top five chronic conditions for us to purchase a depression depression management product.&#x201D; </p>
      </sec>
      <sec>
        <title>2.4. Influence of Return on Investment in Benefit Decision-Making</title>
        <p>All employers were asked about how return on investment impacted benefit decision-making. Reflecting the organizational comparability of EB and UC companies, it is not surprising the two groups reported that return on investment had a similar impact on decision-making about additional health benefits. As shown in <xref ref-type="table" rid="risks-01-00034-t005">Table 5</xref>, close to half of employers in each group reported return on investment had a large impact, while 20% indicated it had no impact or failed to answer the question. </p>
        <table-wrap id="risks-01-00034-t005" position="float">
          <object-id pub-id-type="pii">risks-01-00034-t005_Table 5</object-id>
          <label>Table 5</label>
          <caption>
            <p>Influence of return on investment in benefit decision-making (n = 257).</p>
          </caption>
          <table rules="all" style="border:solid thin">
          <thead>
          <tr>
                <th align="left" valign="middle">&#x201C;Some health benefits/initiatives have a positive return on investment to the organization, while others do not. During the past 12 months, to what degree did return on investment influence your decision-making about additional health benefits/initiatives?&#x201D;</th>
                <th align="left" valign="middle">Percentage of EB Employer Responses by Theme (n = 127)</th>
                <th align="left" valign="middle">Percentage of UC Employer Responses by Theme (n = 130)</th>
              </tr>
          </thead>
            <tbody>
              
              <tr>
                <td align="left" valign="middle">Large influence/this is an important issue</td>
                <td align="left" valign="middle">44.1%</td>
                <td align="left" valign="middle">45.4%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">None/did not answer</td>
                <td align="left" valign="middle">21.3%</td>
                <td align="left" valign="middle">14.6%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Some influence</td>
                <td align="left" valign="middle">19.7%</td>
                <td align="left" valign="middle">17.7%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Not sure</td>
                <td align="left" valign="middle">11.0%</td>
                <td align="left" valign="middle">16.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Hard to calculate, but trying to determine</td>
                <td align="left" valign="middle">6.3%</td>
                <td align="left" valign="middle">6.2%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Does not apply</td>
                <td align="left" valign="middle">3.9%</td>
                <td align="left" valign="middle">6.9%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Hard to calculate and not trying to determine</td>
                <td align="left" valign="middle">3.9%</td>
                <td align="left" valign="middle">2.3%</td>
              </tr>
              <tr>
                <td align="left" valign="middle">Have other priorities now</td>
                <td align="left" valign="middle">2.4%</td>
                <td align="left" valign="middle">3.9%</td>
              </tr>
            </tbody>
          </table>
        <table-wrap-foot><fn><p>EB, evidence-based; UC, usual care</p></fn></table-wrap-foot>
        </table-wrap>
      </sec>
      <sec>
        <title>2.5. Discussion</title>
        <p>Approximately 30% of employers in both the EB and UC groups raised the idea that their companies should consider depression products in internal discussions in their organizations. From the glass half empty perspective, two out of every three EB employers failed to &#x2018;bring home&#x2019; any ideas from a two hour presentation. While the presentation contained one role play between the presenter and the audience, it is possible that future interventions could be strengthened by utilizing more targeted role plays to increase employer skill/comfort to lead these discussions. However, we suspect that EB employers who chose to keep silent speak volumes about their company&#x2019;s interest in improving depression treatment in the workforce. Earlier interest may have been &#x201C;knocked off the radar screen&#x201D; by the considerable retooling that healthcare reform required from already overstretched health benefit professionals. From the glass half full perspective, the intervention appears to have equipped committed health benefit professionals to be stronger advocates for depression products. Almost half of EB discussions noted that depression products can improve productivity; however, that message may be already circulating among health benefit professionals, as one quarter of UC discussions recognized that as an advantage. Also encouraging is that almost half of participating employers recognized that return on investment had a large influence on new benefits. Our anecdotal data indicate that future research is needed to deconstruct their understanding of return on investment and the level of evidence necessary to establish it. </p>
        <p>Employers provided unanticipated perspectives on company changes that would trigger the purchase of a depression product. While disappointing, it probably should not be surprising that a visible episode of depression in the workforce (&#x201C;poster child&#x201D;) was the most often reported trigger. Visible episodes of depression are rarely evident in the workplace, because depression is more likely to erode performance &#x201C;in the cubicle&#x201D; than in dramatic venues. More surprising was the finding that company-specific data on poor performance could act as a trigger. Rather than accept findings from &#x201C;somebody else&#x2019;s company,&#x201D; employers may believe that their company is not beset by productivity loss when employees become depressed. While this may be true in some circumstances, national studies [<xref ref-type="bibr" rid="B8-risks-01-00034">8</xref>,<xref ref-type="bibr" rid="B9-risks-01-00034">9</xref>] suggest that reduced productivity is the rule, not the exception. </p>
        <p>These findings are limited by the purposive sample we studied. Employers represent a group of potentially early innovators with sufficient interest in the topic to volunteer to participate in a longitudinal study. Because it should be easier to persuade this group than a nationally representative sample, we do not think this limitation reduces our certainty about the challenges of influencing employer benefit decisions using group presentations. Thus, we encourage future researchers to develop more innovative interventions to motivate employers to translate science to benefit design.</p>
      </sec>
    </sec>
    <sec>
      <title>3. Experimental Section</title>
      <p>This manuscript utilizes a cross-sectional design in analyzing the second wave of a three wave study. The design of the three wave study has been previously published [<xref ref-type="bibr" rid="B14-risks-01-00034">14</xref>]. In brief, the research team collaborated with 21 National Business Coalition on Health regional coalitions [<xref ref-type="bibr" rid="B15-risks-01-00034">15</xref>] and 12 related professional associations. Regional coalitions/associations recruited health benefit professionals (referred to in this manuscript as employers) from their membership, who indicated an interest in depression in the workplace. The data analyzed for this paper are derived from 5 open-ended questions embedded in a 57-item web-based survey completed by 264 employers (81.2%) approximately 12 months after the presentations. The second author developed a coding scheme to capture the major themes for each item before coding each response. Respondents frequently provided answers that identified more than one theme, so percentages do not add up to 100%. A second analyst coded 20% of responses to the first three items independently, demonstrating an average inter-rater agreement of 76% or higher. Because EB and UC employers reported similar organizational characteristics at baseline and were comparably likely to complete 12 month follow-up, we attribute the differences we observed to the different presentations in which EB and UC employers participated.</p>
    </sec>
    <sec sec-type="conclusions">
      <title>4. Conclusions</title>
      <p>In summary, the EB intervention was not successful in increasing the internal discussion of depression products, but it did influence the content of discussions that occurred. Discussion in EB companies promoted the capacity of depression products to improve productivity and to realize a return on investment more often than discussion in UC companies. Almost half of EB and UC employers reported that return on investment has a large impact on health benefit decision-making. These results demonstrate the difficulty of influencing employer decisions about health benefits using group presentations. Alternative intervention strategies need to be developed and tested. </p>
    </sec>
  </body>
  <back>
    <ack>
      <title>Acknowledgments</title>
      <p>The authors wish to acknowledge the organizations that assisted the research team, including the National Business Coalition on Health, Mental Health America, the Business Health Care Group, Dallas Fort Worth Business Group on Health, Employer Coalition for Healthcare Options, Employers&#x2019; Coalition on Health, Employers' Health Coalition, Employers Health Purchasing Corporation of Ohio, Indianapolis Business Group on Health, Louisiana Business Group on Health, Maine Health Management Coalition, Memphis Business Group on Health, Mental Health America of Georgia, Mental Health America of Greater Houston, Midwest Business Group on Health, Nevada Health Care Coalition, Northeast Business Group on Health Oregon Coalition of Health Care Purchasers, Pacific Business Group on Health, Savannah Business Group, South Carolina Business Coalition on Health, St. Louis Area Business Health Coalition, State and Local Government Benefits Association, Tri-State Health Care Coalition, Virginia Business Coalition on Health and Volunteers of America of Greater New Orleans. The authors wish to express their deep appreciation to Kristen Berg, JD, Susan Henke, Patty Shamrock, MSW, Ben Shearer, PhD, and Shannon Vaughn, JD, for their many contributions to the project. This project was funded by the National Institute of Mental Health MH76277.</p>
    </ack>
    <ref-list>
      <title>References and Notes</title>
      <ref id="B1-risks-01-00034">
        <label>1.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Pincus</surname>
              <given-names>H.A.</given-names>
            </name>
          </person-group>
          <article-title>Depression and primary care: Drowning in the mainstream or left on the banks?</article-title>
          <source>J. Manag. Care Phar.</source>
          <year>2006</year>
          <volume>12</volume>
          <fpage>3</fpage>
          <lpage>9</lpage>
        </citation>
      </ref>
      <ref id="B2-risks-01-00034">
        <label>2.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gilbody</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Bower</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Fletcher</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Richards</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Sutton</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Collaborative care for depression: A cumulative meta-analysis and review of longer-term outcomes</article-title>
          <source>Arch. Intern. Med.</source>
          <year>2006</year>
          <volume>166</volume>
          <fpage>2314</fpage>
          <lpage>2321</lpage>
          <pub-id pub-id-type="doi">10.1001/archinte.166.21.2314</pub-id>
        </citation>
      </ref>
      <ref id="B3-risks-01-00034">
        <label>3.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Bower</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Gilbody</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Richards</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Sutton</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Collaborative care for depression in primary care: Making sense of a complex intervention: Systematic review and meta-regression</article-title>
          <source>Brit. J. Psychiat.</source>
          <year>2006</year>
          <volume>189</volume>
          <fpage>484</fpage>
          <lpage>493</lpage>
          <pub-id pub-id-type="doi">10.1192/bjp.bp.106.023655</pub-id>
        </citation>
      </ref>
      <ref id="B4-risks-01-00034">
        <label>4.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Van Steenbergen-Weijenburg</surname>
              <given-names>K.M.</given-names>
            </name>
            <name>
              <surname>van der Feltz-Cornelis</surname>
              <given-names>C.M.</given-names>
            </name>
            <name>
              <surname>Horn</surname>
              <given-names>E.K.</given-names>
            </name>
          </person-group>
          <article-title>Cost-effectiveness of collaborative care for the treatment of major depressive disorder in primary care: A systematic review</article-title>
          <source>BMC Health Serv. Res.</source>
          <year>2010</year>
          <volume>10</volume>
          <fpage>19</fpage>
          <lpage>28</lpage>
          <pub-id pub-id-type="doi">10.1186/1472-6963-10-19</pub-id>
        </citation>
      </ref>
      <ref id="B5-risks-01-00034">
        <label>5.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rost</surname>
              <given-names>K.M.</given-names>
            </name>
            <name>
              <surname>Pyne</surname>
              <given-names>J.M.</given-names>
            </name>
            <name>
              <surname>Dickinson</surname>
              <given-names>L.M.</given-names>
            </name>
            <name>
              <surname>LoSasso</surname>
              <given-names>A.T.</given-names>
            </name>
          </person-group>
          <article-title>Cost-effectiveness of enhancing primary care depression management on an ongoing basis</article-title>
          <source>Ann. Fam. Med.</source>
          <year>2005</year>
          <volume>3</volume>
          <fpage>7</fpage>
          <lpage>14</lpage>
          <pub-id pub-id-type="doi">10.1370/afm.256</pub-id>
        </citation>
      </ref>
      <ref id="B6-risks-01-00034">
        <label>6.</label>
        <citation citation-type="gov">
          <person-group person-group-type="author">
            <name>
              <surname>Crimmel</surname>
              <given-names>B.L.</given-names>
            </name>
            <name>
              <surname>Sommers</surname>
              <given-names>J.P.</given-names>
            </name>
          </person-group>
          <article-title>Employer-sponsored health insurance for state and local governments, by Census Division</article-title>
          <publisher-name>Agency for Healthcare Research and Quality</publisher-name>
          <publisher-loc>Rockville, MD</publisher-loc><gov>Statistical Brief #223</gov>
          <year>2006</year>
          
        </citation>
      </ref>
      <ref id="B7-risks-01-00034">
        <label>7.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Birnbaum</surname>
              <given-names>H.G.</given-names>
            </name>
            <name>
              <surname>Kessler</surname>
              <given-names>R.C.</given-names>
            </name>
            <name>
              <surname>Kelley</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Ben-Hamadi</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Joish</surname>
              <given-names>V.N.</given-names>
            </name>
            <name>
              <surname>Greenberg</surname>
              <given-names>P.E.</given-names>
            </name>
          </person-group>
          <article-title>Employer burden of mild, moderate and severe major depressive disorder: Mental health services utilization and costs and work performance</article-title>
          <source>Depress. Anxiety</source>
          <year>2010</year>
          <volume>27</volume>
          <fpage>78</fpage>
          <lpage>89</lpage>
          <pub-id pub-id-type="doi">10.1002/da.20580</pub-id>
        </citation>
      </ref>
      <ref id="B8-risks-01-00034">
        <label>8.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Stewart</surname>
              <given-names>W.F.</given-names>
            </name>
            <name>
              <surname>Ricci</surname>
              <given-names>J.A.</given-names>
            </name>
            <name>
              <surname>Chee</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Hahn</surname>
              <given-names>S.R.</given-names>
            </name>
            <name>
              <surname>Morganstein</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <article-title>Cost of lost productive work time among US workers with depression</article-title>
          <source>JAMA</source>
          <year>2003</year>
          <volume>289</volume>
          <fpage>3135</fpage>
          <lpage>3144</lpage>
          <pub-id pub-id-type="doi">10.1001/jama.289.23.3135</pub-id>
        </citation>
      </ref>
      <ref id="B9-risks-01-00034">
        <label>9.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Kessler</surname>
              <given-names>R.C.</given-names>
            </name>
            <name>
              <surname>Akiskal</surname>
              <given-names>H.S.</given-names>
            </name>
            <name>
              <surname>Ames</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Prevalence and effects of mood disorders on work performance in a nationally representative sample of US workers</article-title>
          <source>Am. J. Psychiat.</source>
          <year>2006</year>
          <volume>163</volume>
          <fpage>1561</fpage>
          <lpage>1568</lpage>
          <pub-id pub-id-type="doi">10.1176/appi.ajp.163.9.1561</pub-id>
        </citation>
      </ref>
      <ref id="B10-risks-01-00034">
        <label>10.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rost</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Marshall</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Shearer</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Dietrich</surname>
              <given-names>A.J.</given-names>
            </name>
          </person-group>
          <article-title>Depression care management: Can employers purchase improved outcomes?</article-title>
          <source>Depress. Res. Treat.</source>
          <year>2011</year>
          <comment>Article ID 942519</comment>
          <pub-id pub-id-type="doi">10.1155/2011/942519</pub-id>
        </citation>
      </ref>
      <ref id="B11-risks-01-00034">
        <label>11.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rost</surname>
              <given-names>K.M.</given-names>
            </name>
            <name>
              <surname>Smith</surname>
              <given-names>J.L.</given-names>
            </name>
            <name>
              <surname>Dickinson</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>The effect of improving primary care depression management on employee absenteeism and productivity: A randomized trial</article-title>
          <source>Med. Care</source>
          <year>2004</year>
          <volume>42</volume>
          <fpage>1202</fpage>
          <lpage>1210</lpage>
          <pub-id pub-id-type="doi">10.1097/00005650-200412000-00007</pub-id>
        </citation>
      </ref>
      <ref id="B12-risks-01-00034">
        <label>12.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>LoSasso</surname>
              <given-names>A.T.</given-names>
            </name>
            <name>
              <surname>Rost</surname>
              <given-names>K.M.</given-names>
            </name>
            <name>
              <surname>Beck</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Modeling the impact of enhanced depression treatment on workplace functioning and costs: A cost-benefit approach</article-title>
          <source>Med. Care</source>
          <year>2006</year>
          <volume>44</volume>
          <fpage>352</fpage>
          <lpage>358</lpage>
        </citation>
      </ref>
      <ref id="B13-risks-01-00034">
        <label>13.</label>
        <citation citation-type="web">
              <collab>Colorado Business Group on Health</collab>
          <article-title>Depression care management</article-title>
          <year>2012</year>
          <comment>Available online:<ext-link xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="http://caremanagementfordepression.org" ext-link-type="uri">http://caremanagementfordepression.org</ext-link></comment>
          <access-date>(accessed on 23 May 2013)</access-date>
        </citation>
      </ref>
      <ref id="B14-risks-01-00034">
        <label>14.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rost</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Marshall</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <article-title>Marketing depression care management to employers: Design of a randomized controlled trial</article-title>
          <source>Implement. Sci.</source>
          <year>2010</year>
          <volume>5</volume>
          <fpage>22</fpage>
          <pub-id pub-id-type="doi">10.1186/1748-5908-5-22</pub-id>
        </citation>
      </ref>
      <ref id="B15-risks-01-00034">
        <label>15.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Camillus</surname>
              <given-names>J.A.</given-names>
            </name>
            <name>
              <surname>Rosenthal</surname>
              <given-names>M.B.</given-names>
            </name>
          </person-group>
          <article-title>Health care coalitions: From joint purchasing to local health reform</article-title>
          <source>Inquiry</source>
          <year>2008</year>
          <volume>45</volume>
          <fpage>142</fpage>
          <lpage>153</lpage>
          <pub-id pub-id-type="doi">10.5034/inquiryjrnl_45.02.142</pub-id>
        </citation>
      </ref>
    </ref-list>
  </back>
</article>
