<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD Journal Publishing DTD v2.3 20070202//EN" "journalpublishing.dtd">
<article xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xml:lang="en" article-type="research-article">
  <front>
    <journal-meta>
      <journal-id journal-id-type="publisher-id">viruses</journal-id>
      <journal-title>Viruses</journal-title>
      <abbrev-journal-title abbrev-type="publisher">Viruses</abbrev-journal-title>
      <abbrev-journal-title abbrev-type="pubmed">Viruses</abbrev-journal-title>
      <issn pub-type="epub">1999-4915</issn>
      <publisher>
        <publisher-name>MDPI</publisher-name>
      </publisher>
    </journal-meta>
    <article-meta>
      <article-id pub-id-type="doi">10.3390/v4081212</article-id>
      <article-id pub-id-type="publisher-id">viruses-04-01212</article-id>
      <article-categories>
        <subj-group>
          <subject>Article</subject>
        </subj-group>
      </article-categories>
      <title-group>
        <article-title>Persistence <italic>versus</italic> Reversion of 3TC Resistance in HIV-1 Determine the Rate of Emergence of NVP Resistance</article-title>
      </title-group>
      <contrib-group>
        <contrib contrib-type="author">
          <name>
            <surname>Rath</surname>
            <given-names>Barbara A.</given-names>
          </name>
          <xref rid="af1-viruses-04-01212" ref-type="aff">1</xref>
          <xref rid="af2-viruses-04-01212" ref-type="aff">2</xref>
          <xref rid="c1-viruses-04-01212" ref-type="corresp">*</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Olshen</surname>
            <given-names>Richard A.</given-names>
          </name>
          <xref rid="af3-viruses-04-01212" ref-type="aff">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Halpern</surname>
            <given-names>Jerry</given-names>
          </name>
          <xref rid="af3-viruses-04-01212" ref-type="aff">3</xref>
        </contrib>
        <contrib contrib-type="author">
          <name>
            <surname>Merigan</surname>
            <given-names>Thomas C.</given-names>
          </name>
          <xref rid="af1-viruses-04-01212" ref-type="aff">1</xref>
        </contrib>
      </contrib-group>
      <aff id="af1-viruses-04-01212"><label>1 </label>Center for AIDS Research, Division of Infectious Diseases and Geographic Medicine, Stanford University School of Medicine, Stanford, CA 94305, USA; Email: <email>merigan@stanford.edu</email></aff>
      <aff id="af2-viruses-04-01212"><label>2 </label>Department of Pediatrics, Division of Pneumonology-Immunology, Charité University Medical Center, Berlin 13353, Germany</aff>
      <aff id="af3-viruses-04-01212"><label>3 </label>Division of Biostatistics, Stanford University School of Medicine, Stanford, CA 94305, USA; Email: <email>olshen@stanford.edu</email> (R.A.O.); <email>jerry.halpern@stanford.edu</email> (J.H.)</aff>
      <author-notes>
        <corresp id="c1-viruses-04-01212"><label>*</label> Author to whom correspondence should be addressed; Email: <email>Barbara.Rath@gmail.com</email>; Tel.: +49-30-450-666664; Fax: +49-30-690-88616.</corresp>
      </author-notes>
      <pub-date pub-type="epub">
        <day>07</day>
        <month>08</month>
        <year>2012</year>
      </pub-date>
      <pub-date pub-type="collection">
        <month>08</month>
        <year>2012</year>
      </pub-date>
      <volume>4</volume>
      <issue>8</issue>
      <fpage>1212</fpage>
      <lpage>1234</lpage>
      <history>
        <date date-type="received">
          <day>11</day>
          <month>07</month>
          <year>2012</year>
        </date>
        <date date-type="rev-recd">
          <day>03</day>
          <month>08</month>
          <year>2012</year>
        </date>
        <date date-type="accepted">
          <day>06</day>
          <month>08</month>
          <year>2012</year>
        </date>
      </history>
      <permissions>
        <copyright-statement>© 2012 by the authors; licensee MDPI, Basel, Switzerland.</copyright-statement>
        <copyright-year>2012</copyright-year>
        <license xmlns:xlink="http://www.w3.org/1999/xlink" license-type="open-access" xlink:href="http://creativecommons.org/licenses/by/3.0/">
          <p>This article is an open-access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).</p>
        </license>
      </permissions>
      <abstract>
        <p>When HIV-1 is exposed to lamivudine (3TC) at inhibitory concentrations, resistant variants carrying the reverse transcriptase (RT) substitution M184V emerge rapidly. This substitution confers high-level 3TC resistance and increased RT fidelity. We established a novel <italic>in vitro</italic> system to study the effect of starting nevirapine (NVP) in 3TC-resistant/NNRTI-naïve clinical isolates, and the impact of maintaining <italic>versus</italic> dropping 3TC pressure in this setting. Because M184V mutant HIV-1 seems hypersusceptible to adefovir (ADV), we also tested the effect of ADV pressure on the same isolates. We draw four conclusions from our experiments simulating combination therapy <italic>in vitro</italic>. (1) The presence of low-dose (1 μM) 3TC prevented reversal to wild-type from an M184V mutant background. (2) Adding low-dose 3TC in the presence of NVP delayed the selection of NVP-associated mutations. (3) The presence of ADV, in addition to NVP, led to more rapid reversal to wild-type at position 184 than NVP alone. (4) ADV plus NVP selected for greater numbers of mutations than NVP alone. Inference about the “selection of mutation” is based on two statistical models, one at the viral level, more telling, and the other at the level of predominance of mutation within a population. Multidrug pressure experiments lend understanding to mechanisms of HIV resistance as they bear upon new treatment strategies. </p>
      </abstract>
      <kwd-group>
        <kwd>HIV-1</kwd>
        <kwd>lamivudine</kwd>
        <kwd>nevirapine</kwd>
        <kwd>adefovir</kwd>
        <kwd>resistance</kwd>
        <kwd>selection</kwd>
        <kwd>serial passage. </kwd>
      </kwd-group>
    </article-meta>
  </front>
  <body>
    <sec sec-type="intro">
      <title>1. Introduction</title>
      <sec>
        <title>1.1. In vitro ‘Combination Therapy’</title>
        <p>Several antiretroviral agents have been licensed to treat infections with the human immunodeficiency virus Type 1 (HIV-1). Antiviral drugs that inhibit RT activity in wild-type HIV-1 select rapidly for drug-resistant variants. Current guidelines therefore recommend the use of several antiretroviral agents concomitantly rather than sequentially [<xref ref-type="bibr" rid="B1-viruses-04-01212">1</xref>,<xref ref-type="bibr" rid="B2-viruses-04-01212">2</xref>,<xref ref-type="bibr" rid="B3-viruses-04-01212">3</xref>].</p>
        <p>Two classes of drugs are active specifically against the reverse transcriptase enzyme of HIV-1. The nucleotide analogue RT inhibitors (NRTI) compete with the natural substrate and act as chain terminators in the RT catalytic site. The nonnucleoside analogue reverse transcriptase inhibitors (NNRTIs) are noncompetitive inhibitors that bind exclusively to a hydrophobic pocket in HIV type 1 RT [<xref ref-type="bibr" rid="B4-viruses-04-01212">4</xref>]. Interactions between NRTI and NNRTI can be complex and difficult to assess experimentally. </p>
        <p>We established a novel <italic>in vitro</italic> system to test the impact of NRTI pressure on the development of resistance to the NNRTI nevirapine (NVP) in highly NRTI-resistant but NNRTI-naïve isolates.</p>
      </sec>
      <sec>
        <title>1.2. Lamivudine (3TC) Resistance—The M184V Substitution</title>
        <p>When HIV-1 is exposed to the NRTI lamivudine (3TC) at inhibitory concentrations, resistant HIV variants carrying the RT substitution M184V (ATGàGTG) emerge rapidly [<xref ref-type="bibr" rid="B5-viruses-04-01212">5</xref>,<xref ref-type="bibr" rid="B6-viruses-04-01212">6</xref>,<xref ref-type="bibr" rid="B7-viruses-04-01212">7</xref>]. The M184V substitution confers the highest level of resistance (up to 1000-fold) for any NRTI that has been described to date [<xref ref-type="bibr" rid="B8-viruses-04-01212">8</xref>]. In cell-free RT assays the M184V mutant virus exhibits altered enzymatic properties. RT with the 184-Val substitution is less able to initiate reverse transcription, to incorporate dNTP, to perform chain elongation, and to undergo compensatory mutagenesis [<xref ref-type="bibr" rid="B9-viruses-04-01212">9</xref>,<xref ref-type="bibr" rid="B10-viruses-04-01212">10</xref>,<xref ref-type="bibr" rid="B11-viruses-04-01212">11</xref>,<xref ref-type="bibr" rid="B12-viruses-04-01212">12</xref>,<xref ref-type="bibr" rid="B13-viruses-04-01212">13</xref>]. Decreased fitness and increased fidelity of 3TC-resistant virus limit the production of randomly mutant forms, many of which are not viable [<xref ref-type="bibr" rid="B14-viruses-04-01212">14</xref>,<xref ref-type="bibr" rid="B15-viruses-04-01212">15</xref>,<xref ref-type="bibr" rid="B16-viruses-04-01212">16</xref>]. In M184V mutant enzyme, the process of polymerization becomes more accurate; fewer viral variants are produced; and adaptation to environmental stimuli is impaired [<xref ref-type="bibr" rid="B17-viruses-04-01212">17</xref>,<xref ref-type="bibr" rid="B18-viruses-04-01212">18</xref>,<xref ref-type="bibr" rid="B19-viruses-04-01212">19</xref>]. </p>
      </sec>
      <sec>
        <title>1.3. Maintaining 3TC Pressure When NNRTI Are Introduced</title>
        <p>To simulate an environment that promotes strong evolutionary pressure, we performed serial passages in escalating doses of the NNRTI nevirapine ([NVP]). Resistance against NVP develops rapidly <italic>in vitro</italic> and <italic>in vivo</italic> [<xref ref-type="bibr" rid="B20-viruses-04-01212">20</xref>].</p>
        <p>We hypothesize that if 3TC pressure is withdrawn and at the same time an NNRTI is introduced, then the M184V mutant strains will be at a competitive disadvantage to the more “fit” and “flexible” wild-type variants, which can adapt to the new drug more easily [<xref ref-type="bibr" rid="B19-viruses-04-01212">19</xref>,<xref ref-type="bibr" rid="B21-viruses-04-01212">21</xref>]. The concentration of 3TC used in our experiments is within the normal range of wild-type IC50. Since 3TC is known to exert selective pressure on M184V, we would expect inhibition of reversal to wild-type at position 184. In this study we address these questions. Can the anticipated 3TC effect be simulated in multidrug pressure experiments? Does 3TC have the expected impact on reversal and mutation rates, even in the context of high-level 3TC resistance? </p>
      </sec>
      <sec>
        <title>1.4. Adding Adefovir (ADV)</title>
        <p>We studied the 3TC-induced “antimutator phenotype” [<xref ref-type="bibr" rid="B22-viruses-04-01212">22</xref>] further in the presence of adefovir (ADV). M184V mutant HIV has been shown to be hypersusceptible to ADV (as well as its successor, tenofovir) <italic>in vitro</italic> [<xref ref-type="bibr" rid="B23-viruses-04-01212">23</xref>]. When ADV is added in the absence of 3TC, does ADV select for wild-type virus at position 184? Does the reversal to wild-type virus at position 184 (M184V-reversal) facilitate the development of NVP resistance? </p>
        <p>The studies reported here come against a backdrop of tension between diminishing viral load through the administration of drugs on the one hand, and constraining viral escape of resistant strains on the other. </p>
      <fig id="viruses-04-01212-f001" position="anchor">
        <label>Figure 1</label>
        <caption>
          <p>Sequencing Data—Review of Mutations and Reversals in Different Drug Combinations:A complete review of RT sequence changes under the following drug conditions: <italic>NVP_only</italic>, <italic>NVP+3TC</italic>, <italic>NVP+ADV</italic>, <italic>NVP+3TC+ADV</italic>, <italic>3TC+ADV</italic>, <italic>No_drug</italic>. Individual isolates are displayed in different colors: #1 (green), #2 (dark blue), # 3 (light blue), #4 (pink), and #5 (orange). Sequence changes are listed with the passage number (PASS) and [NVP] where they were first observed. Any mutation away from wild-type is listed under ‘MUT’, reversal to wild-type under ‘REV’. Shaded areas within ‘REV’ indicate M184V-reversal. </p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-g001.tif"/>
      </fig>
      </sec>
    </sec>
    <sec sec-type="results">
      <title>2. Results and Discussion</title>
      <p><xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref>, <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref> and <xref ref-type="fig" rid="viruses-04-01212-f003">Figure 3</xref> summarize explicit baseline mutations and experimental mutations by isolate and drug combination. They also summarize counts of mutations together with incidence of V184M-reversal by isolate and passage number. </p>
      <sec>
        <title>2.1. Mutations and Reversals in Different Drug Combinations</title>
        <p>Reverse transcriptase (RT) mutational patterns and selected mutations/reversals of the individual isolates #1-5 at baseline and throughout twelve serial passages (P1-P12) are shown in <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref>, below. All newly selected mutations and reversals persisted throughout P12. No mutations were observed in the <italic>No_drug</italic> control setup. </p>
        <sec>
          <title>2.1.1. Introducing First-time NNRTI in NRTI-Resistant/NNRTI-naïve Clinical Isolates</title>
          <p>Baseline isolates #1-5 (see legends) exhibit RT resistance patterns that commonly are observed in salvage therapy, all having changes at positions 184 and 215. It is noteworthy that of 55 baseline mutations, none is known to be in the NNRTI binding pocket, which includes positions 101, 103, 106, 108, 179, 181, 188, 190, 224, 227, and 228. </p>
          <p>All isolates exposed to escalating doses of NVP showed a gradual appearance of one to three mutations, a total of 42 mutations. Of them, 38 were known to be in the NNRTI binding pocket, the remainder are considered noncanonical mutations or polymorphism. All RT mutations were tracked, including those not known to be associated with drug resistance. Please note the remarkably small p-values for the null hypothesis that these 38 mutations were “equidistributed” (that is to say, exchangeable) among possible codons.</p>
        </sec>
        <sec>
          <title>2.1.2. Significance of NNRTI Binding Pocket Mutations</title>
          <p>For the 19 isolates for which treatment included escalating doses of NVP, there were 38 NNRTI binding pocket mutations. Of these, 13 were at codon 106, seven at 181, and five at 108. The p-values for the findings that the “most popular” codon of 11 had at least 13 mutations, alternatively that the “second most popular” had at least 11, under the common null hypothesis that codons are “equidistributed” (exchangeable) were computed thus.</p>
          <p>Isolates are taken to be independent, codons within isolates chosen at random without replacement from among the 11. Reading from isolate #1 through #5, successively from <italic>NVP only</italic> through <italic>NVP+3TC+ADV</italic>, the respective numbers of NNRTI binding pocket mutations were seen to be 2,1,3,2,1,1,2,1,2,1,1,3,2,3,1,2,2,3,3. Therefore, the number of ways NNRTI binding pocket codons could be chosen is</p>
          <p><disp-formula id="viruses-04-01212-i002">
          <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i002.tif"/>
          </disp-formula></p>
          <p>We made this choice at random 50,000 times, each time noting the codon chosen the largest, respectively next largest, number of times, thereby obtaining the joint sampling distribution of these two random quantities. Of the 50,000 trials, the “most popular” codon seen was seen only 12 times, and that occurred for only four trials. The “next most popular” was seen seven times (2056 trials), eight times (129 trials), and nine times (seven trials). It follows that the respective estimated p-values are 1/50,001 (which is about 0.00002) and (2057+129+7)/50,001 (which is about 0.044) when the null hypotheses are as given. The first hypothesis seems untenable, and possibly not the second, either.</p>
        </sec>
        <sec>
          <title>2.1.3. Maintaining <italic>versus</italic> Withdrawing 3TC Pressure</title>
          <p>Maintaining 3TC Pressure prevented M184V reversal in all instances. Whenever 3TC was withdrawn, we selected for M184V-reversal, except for #4 in <italic>NVP_only</italic> (reversal at 215, 208, and 35 instead) and #1 in <italic>No_drug. </italic></p>
        </sec>
        <sec>
          <title>2.1.4. The Impact of Chance Effects</title>
          <p>Isolates #2 and #3 were derived from the same baseline isolate. During lower passage numbers, these two isolates generated similar patterns. The impact of chance effects (‘stochasticity’) on the evolution of these two separate populations became more obvious at later passages. As expected, the two isolates #2 and #3 did not develop identically throughout combination passage experiments, but more similarly than isolates derived from different baseline patient isolates. In all isolates tested, preexisting sequence differences at baseline and viral variants below levels of detection may have contributed to the observed differences in mutational patterns. Since all baseline isolates underwent the same treatments, comparisons can be drawn across treatment groups. </p>
          <p>It is evident that in this experimental setting, selective forces due to increasing evolutionary pressure override the impact of genetic differences at baseline<bold>. </bold>We note that when a mutation was selected at a particular codon for a particular triple, the mutation persisted in subsequent isolates. To be conservative, for “significance” we require a difference in numbers of detected mutations when isolates are compared for a given passage. In the particle model, we also test for whichever treatment has the smaller number of mutations, since the number of particles remains stable with subsequent passage. </p>
        </sec>
      </sec>
      <sec>
        <title>2.2. Progression of Mutations with and without M184V Reversal</title>
        <p>For improved visualization of HIV evolution and dynamics during serial passage experiments, we summarized <italic>in vitro</italic> responses to different drug combinations in an innovative fashion using a Serial Passage Integrated Display (“Cube Model”) with 2-by-4 tables based on reversal/no reversal and the number of newly selected mutations per clinical isolate (“cube”). </p>
        <p><xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref> illustrates how different drug combinations direct the movement of cubes into preferred directions: downward (new mutations), to the right (reversal), or diagonal (both). </p>
      <fig id="viruses-04-01212-f002" position="anchor">
        <label>Figure 2</label>
        <caption>
          <p>Progression of Mutations With and Without M184V-reversal. All mutations and M184V-reversals for every passage and isolate are summarized. Isolates #1-5 (represented by colored cubes) started with <italic>a priori</italic> no mutations ‘MUT’ and no M184V-reversal (0MUT/0REV). At P1-P12, each cube could either remain in its position or move vertically to 1, 2, or 3 mutations and/or horizontally from 0 to 1 M184V-reversal. ‘Movements’ of cubes under defined drug pressures can be followed along P1-P12 or compared across equivalent passages. </p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-g002.tif"/>
      </fig>
        <sec>
          <title>2.2.1. NVP_only</title>
          <p><bold><italic>NVP_only</italic></bold> simulates the effect of NVP monotherapy and serves as the basic experiment for the comparison with the other NVP escalation experiments. When all isolates in <italic>NVP_only</italic> are viewed together, we see the selection of wild-type at position 184 (M184V-reversal) in most (4/5) cases, though only one through the first six passages. There are 1, 2, or 3 newly selected mutations at least by P12, mostly known NVP resistance mutations (see <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref>). </p>
        </sec>
        <sec>
          <title>2.2.2. NVP+3TC</title>
          <p>With the addition of 3TC (<bold><italic>NVP+3TC</italic></bold>) we observe several changes in comparison to <italic>NVP_only</italic>. M184V-reversal was prevented by the addition of low-level 3TC in all cases despite an exponential increase in NVP doses of up to &gt;2000-fold. In the presence of 3TC, no RT changes could be found when NVP was escalated from P1 through P4 (1 to 8-fold [NVP] and from P7 to P10 (64 to 510-fold NVP). Under extreme pressure (P12, 2048-fold NVP) we observe total numbers of 2x1, 2x2 and 1x3 mutations, but no M184V-reversal. Testing the correlation in the viral particle model, there is a significant difference in the two regimes at the 5% level according to in the suspected direction for isolate #2 at P2 through P5 and for isolate #4 at P4. There are significant differences in the opposite direction for isolate #1 at P5 and isolate #4 at P6. </p>
        </sec>
        <sec>
          <title>2.2.3. NVP+ADV</title>
          <p>The addition of ADV to <italic>NVP_only (<bold>NVP+ADV</bold>) </italic>selects rapidly for M184V-reversal (P3). At P12 all isolates have reverted. Moreover, we see a higher total number of NNRTI mutations in comparison to both <italic>NVP_only </italic>and <italic>NVP+3TC</italic>. When <italic>NVP </italic>alone is compared to <italic>NVP+ADV </italic>by the viral particle model, there are significant differences in the anticipated direction for isolate #3 at P3 and for isolate #5 at P5 and P6. There is a significant difference in the opposite direction for isolate #4 at P3. </p>
        </sec>
        <sec>
          <title>2.2.4. NVP+3TC+ADV</title>
          <p><bold><italic>NVP+3TC+ADV </italic></bold>can be viewed as the 3TC with <italic>ADV+NVP</italic>, as <italic>NVP_only</italic> plus <italic>3TC+ADV, </italic>or as <italic>ADV </italic>with <italic>NVP+3TC; </italic>3TC again prevented M184V-reversal in all cases. However, the addition of ADV to <italic>NVP+3TC</italic> increased the number of NVP mutations selected at lower passage numbers. The high degree of heterogeneity in the presence of ADV was independent of M184V-reversal, which was prevented by 3TC. Comparing <italic>NVP+3TC</italic> with <italic>NVP+3TC+ADV </italic>in the viral particle model, the only significant differences in mutation (other than reversals) are for isolate #4, P2 through P4. They are all in the suspected direction: more mutations appeared when <italic>ADV</italic> was part of the treatment regime. </p>
        </sec>
        <sec>
          <title>2.2.5. 3TC+ADV</title>
          <p><bold><italic>3TC+ADV </italic></bold>serves as a control experiment; [3TC] and [ADV] were maintained at the same level from P1 through P12. The low number of total mutations suggests that the degree of evolutionary pressure was not comparable with the NVP-escalation experiments; ([ADV] at 2 μM) as an active drug exerted evolutionary pressure and generated mutations. Interestingly, E122K (#2/P11) and H208Y (#5/P3) would not be considered resistance mutations to ADV [<xref ref-type="bibr" rid="B24-viruses-04-01212">24</xref>]. </p>
        </sec>
        <sec>
          <title>2.2.6. No_Drug</title>
          <p><bold><italic>No_drug</italic></bold> simulates a treatment interruption and demonstrates that upon 3TC withdrawal, M184V tends to revert, even if the environment is stable. By P4, 3/4 isolates had reverted. </p>
        </sec>
        <sec>
          <title>2.2.7. Testing the 3TC-Effect</title>
          <p>The null hypothesis that 3TC does not lead to altered 184 reversal has p- value 5.982×10-6 , at least if 3TC is specified in advance of the computation. <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref> will convince a reader that the attained significance level for any reasonable model should be very small since there was no reversal with 3TC. </p>
          <p>Further inference in this section is devoted to testing the null hypotheses that numbers of mutations result in identical sampling distributions no matter which of two combinations of drugs was administered. In order that tests are conservative, we computed p-values for two-sided alternatives; that is, in principle either combination of drugs could have resulted in a sampling distribution of mutations stochastically smaller or larger than that of the other. </p>
          <p>We employed exact distributions of a Mann-Whitney (equivalently Wilcoxon rank-sum) statistics in computing attained significance [<xref ref-type="bibr" rid="B25-viruses-04-01212">25</xref>], respecting that resulting 2×4 tables [with rows representing treatment and columns numbers of mutations (0, 1, 2, or 3)] have many tied observations. Our statistics are, in fact, permutation statistics. When we say “significant” in the table that follows, we mean that the (two-sided) p-value was &lt;0.05. Alert readers will see that we have made no attempt to correct for multiple testing and have not employed false discovery rates [<xref ref-type="bibr" rid="B26-viruses-04-01212">26</xref>]. Evidence for our claims is transparent from cursory examination of <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref> and <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref>; we feel that the conservative p-values we supply are sufficient to make our points. (<xref ref-type="table" rid="viruses-04-01212-t001">Table 1</xref>).</p>
		  <list>
		  <list-item>
          <p>(A) <italic>NVP_only</italic> has significantly more mutations than <italic>3TC+ADV</italic> at passages 8 through 10 and 12.</p>
		  </list-item>
		  <list-item>
          <p>(B) <italic>NVP+3TC</italic> has significantly fewer mutations than <italic>NVP+3TC+ADV</italic> at passages 9 and 10.</p>
		  </list-item>
		  <list-item>
          <p>(C) <italic>NVP+3TC</italic> has significantly more mutations than <italic>3TC+ADV</italic> at passages 7 through 10.</p>
		  </list-item>
		  <list-item>
          <p>(D) <italic>NVP+ADV</italic> has significantly more mutations than <italic>3TC+ADV</italic> at passages 6 through 12. </p>
		  </list-item>
		  </list>
          <p>These are the most extreme comparisons with respective p-values 0 .048, 0.040, 0.032, 0.032, 0.024, 0.032, and 0.008.</p>
		  <list>
		  <list-item>
          <p>(E) <italic>NVP+3TC+ADV</italic> has significantly more mutations than <italic>3TC+ADV</italic> at passages 9 through 12.</p>
		  </list-item>
		  </list>
          <table-wrap id="viruses-04-01212-t001" position="anchor">
            <object-id pub-id-type="pii">viruses-04-01212-t001_Table 1</object-id>
            <label>Table 1</label>
            <caption>
              <p>Comparison across passage numbers and drug combinations; testing the null hypotheses that numbers of mutations result in identical sampling distributions no matter which of two combinations of drugs was administered. P-values (&lt;0.05 in <bold>bold</bold>) for comparisons (A) to (E); passage numbers 6–12.</p>
            </caption>
            <table>
              <thead>
                <tr>
                  <th rowspan="2" align="left" valign="middle">Comparison</th>
                  <th colspan="7" align="center" valign="middle">Passage Number</th>
                </tr>
                <tr style="border-top: solid thin">
                  <th align="center" valign="middle">6</th>
                  <th align="center" valign="middle">7</th>
                  <th align="center" valign="middle">8</th>
                  <th align="center" valign="middle">9</th>
                  <th align="center" valign="middle">10</th>
                  <th align="center" valign="middle">11</th>
                  <th align="center" valign="middle">12</th>
                </tr>
              </thead>
              <tbody>
                <tr>
                  <td align="left" valign="middle">A) <italic>NVP_only versus 3TC+ADV</italic></td>
                  <td align="center" valign="middle">0.5238</td>
                  <td align="center" valign="middle">0.1429</td>
                  <td align="center" valign="middle">
                    <bold>0.0317</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0476</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0476</bold>
                  </td>
                  <td align="center" valign="middle">0.0794</td>
                  <td align="center" valign="middle">
                    <bold>0.0317</bold>
                  </td>
                </tr>
                <tr>
                  <td align="left" valign="middle">B) <italic>NVP+3TC versus NVP+3TC+ADV</italic></td>
                  <td align="center" valign="middle">0.9762</td>
                  <td align="center" valign="middle">1.000</td>
                  <td align="center" valign="middle">0.2063</td>
                  <td align="center" valign="middle">
                    <bold>0.0476</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">0.1190</td>
                  <td align="center" valign="middle">0.1429</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">C) <italic>NVP+3TC versus 3TC+ADV</italic></td>
                  <td align="center" valign="middle">0.4444</td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">0.1587</td>
                  <td align="center" valign="middle">0.0794</td>
                </tr>
                <tr>
                  <td align="left" valign="middle">D) <italic>NVP+ADV versus 3TC+ADV</italic></td>
                  <td align="center" valign="middle">
                    <bold>0.0476</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0397</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0317</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0317</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0238</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0317</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0079</bold>
                  </td>
                </tr>
                <tr>
                  <td align="left" valign="middle">E) <italic>NVP+3TC+ADV versus 3TC+ADV</italic></td>
                  <td align="center" valign="middle">0.3714</td>
                  <td align="center" valign="middle">0.3714</td>
                  <td align="center" valign="middle">0.0571</td>
                  <td align="center" valign="middle">
                    <bold>0.0286</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0286</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0286</bold>
                  </td>
                  <td align="center" valign="middle">
                    <bold>0.0286</bold>
                  </td>
                </tr>
              </tbody>
            </table>
          </table-wrap>
        </sec>
      </sec>
      <sec>
        <title>2.3. Appearance of New Mutations before and after 184 Reversal</title>
        <p><xref ref-type="fig" rid="viruses-04-01212-f003">Figure 3</xref> summarizes the selection of mutations prior to and after M184V-reversal, respectively. Though numerical averages may be of limited descriptive value for random quantities that change by doubling, for completeness these numerical averages are displayed as horizontal white bars. </p>
        <p><bold><italic>NVP_only </italic></bold>shows a mixed picture. Mutations were selected at P2, P3, P5, and P6 without prior or simultaneous reversal at position 184 (<italic>M184V</italic>; left column). The first new mutation with reversal (<italic>After M184V Reversal</italic>; right column) became prevalent at P7. More mutations after reversal appeared at P8, P11, and P12, though additional mutations were selected at P7 and P9 without reversal. </p>
      <fig id="viruses-04-01212-f003" position="anchor">
        <label>Figure 3</label>
        <caption>
          <p>Appearance of new mutations before and after 184 Reversal: All mutations generated (diamonds) per drug setting, before (<italic>M184V</italic>, left column) and after M184V-reversal (<italic>After 184 Reversal</italic>, right column) are summarized. We display the appearance of each selected mutation in relation to the respective passage number and NVP concentration on the y-axis. <italic>FOLD [NVP] </italic>represents the concentration at which a mutation first became prevalent. <italic>FOLD [NVP]</italic> =2<sup>p</sup> (with P = passage number). As reported in <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref>, all observed mutations persisted up to P12. During drug escalation, the event of M184V-reversal is required for a mutation to appear in the right column. Diamonds in either column can therefore only be compared between different drug settings. Horizontal bars in the logarithmic <italic>FOLD [NVP] </italic>scale indicate the average [NVP] for mutations to appear.</p>
        </caption>
        <graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-g003.tif"/>
      </fig>
        <p>With <bold><italic>NVP+3TC </italic></bold>there was no M184V-reversal. With <italic>3TC+NVP</italic> we selected for a total number of 9 mutations, which was the lowest among all NVP escalation experiments. Importantly, the first mutation that appeared with <italic>NVP+3TC</italic> was selected under substantially higher NVP concentrations (P5; 16-fold), by contrast with what was seen with <italic>NVP_only</italic> (P2; 2-fold) or in any other setting. </p>
        <p>With <bold><italic>NVP+ADV</italic></bold>, mutations appeared after M184V-reversal, the first one at very low NVP concentration (P3; 4-fold). The average [NVP] was lower than in <italic>NVP_only</italic> for both <italic>M184V </italic>(left column, 24-fold <italic>versus</italic> 62-fold) and <italic>After M184V Reversal</italic> (right column: 682-fold <italic>versus</italic> 816-fold). </p>
        <p>In the <bold><italic>NVP+3TC+ADV </italic></bold>experiments, 3TC precluded M184V-reversal. The total number of selected mutations (11) was lower than in <italic>NVP+ADV</italic> (13) and higher than in <italic>NVP+3TC</italic> (9). It must be noted, however, that <italic>NVP+3TC+ADV</italic> was done with only four isolates (<italic>versus</italic> five in the other NVP-settings). The first mutation appeared at P2 (2-fold [NVP]). However, the average concentration needed to generate mutations was high (483-fold in <italic>NVP+3TC+ADV</italic>), but lower than without ADV (595-fold in <italic>NVP+3TC</italic>).</p>
      </sec>
      <sec>
        <title>2.4. Summary of Results</title>
        <p>We draw four conclusions from our experiments simulating combination therapy <italic>in vitro</italic>.</p>
		<list>
		<list-item>
        <p>1. The presence of low-dose (1μM) 3TC prevented reversal to wild-type from an M184V mutant background. </p>
		</list-item>
		<list-item>
        <p>2. Adding low-dose 3TC in the presence of NVP delayed the selection of NVP-associated mutations.</p>
		</list-item>
		<list-item>
        <p>3. The presence of ADV, in addition to NVP, led to more rapid reversal to wild-type at position 184 than NVP alone. </p>
		</list-item>
		<list-item>
        <p>4. ADV plus NVP selected for greater numbers of mutations than NVP alone. </p>
		</list-item>
		</list>
        <p>Inference about the “selection of mutation” is based on two statistical models, one at the viral level, more telling, and the other at the level of predominance of mutation within a population.</p>
      </sec>
      <sec>
        <title>2.5. Discussion</title>
        <p>It is evident from <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref>, <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref> through <xref ref-type="fig" rid="viruses-04-01212-f003">Figure 3</xref> that during each passage, there is tension between diminishing viral load through the administration of drugs and constraining viral escape through the selection of mutant forms. Our contributions begin with the establishment of an <italic>in vitro</italic> system to study the impact of continued 3TC pressure on the selection of both M184V-reversal and resistance to NVP. </p>
        <p>Several clinical trials demonstrated that the use of genotypic resistance data is associated with improved virologic and clinical outcome in salvage therapy and can be cost-effective [<xref ref-type="bibr" rid="B27-viruses-04-01212">27</xref>,<xref ref-type="bibr" rid="B28-viruses-04-01212">28</xref>,<xref ref-type="bibr" rid="B29-viruses-04-01212">29</xref>]. When sequence data are available to direct the choice of a new regimen and a known resistance mutation is found, it seems plausible that the respective drug has lost antiviral activity and should be discontinued. Specific combinations of antiretroviral agents can exert conflicting genetic pressures [<xref ref-type="bibr" rid="B30-viruses-04-01212">30</xref>]. A novel strategy that remains to be established is the continued use of certain individual compounds with the goal to preserve “suppressor mutations” impairing the evolution of resistance to other compounds [<xref ref-type="bibr" rid="B4-viruses-04-01212">4</xref>,<xref ref-type="bibr" rid="B15-viruses-04-01212">15</xref>,<xref ref-type="bibr" rid="B22-viruses-04-01212">22</xref>,<xref ref-type="bibr" rid="B31-viruses-04-01212">31</xref>].</p>
        <p>Some authors have suggested continuing 3TC therapy even in the context of high-level 3TC resistance [<xref ref-type="bibr" rid="B18-viruses-04-01212">18</xref>,<xref ref-type="bibr" rid="B19-viruses-04-01212">19</xref>,<xref ref-type="bibr" rid="B32-viruses-04-01212">32</xref>,<xref ref-type="bibr" rid="B33-viruses-04-01212">33</xref>]. The strategy is to preserve the resistance mutation M184V, which has been linked to an HIV-1 reverse transcriptase with altered biochemical properties. Previous <italic>in vitro</italic> studies have shown that M184V may not delay the emergence of some protease inhibitors (PI) mutations [<xref ref-type="bibr" rid="B34-viruses-04-01212">34</xref>], but of some PI and NNRTI [<xref ref-type="bibr" rid="B12-viruses-04-01212">12</xref>]. In our study we test for NRTI-NNRTI interactions allowing for structural or functional constraints within the RT enzyme to interfere with the acquisition of new mutations. </p>
        <p>Jonckheere <italic>et al.</italic> compared HIV wild-type to M184V mutant virus with three different stable doses of NVP in the absence of 3TC pressure [<xref ref-type="bibr" rid="B35-viruses-04-01212">35</xref>]. Breakthrough of NVP-resistant virus was generally observed one passage later with M184V mutant than with wild-type virus. This study is in agreement with our results, but did not address the effect of concomitant 3TC pressure on diverse clinical isolates. Diallo and Balzarini <italic>et al.</italic> tested the combination 3TC with NNRTI (NVP and efavirenz, respectively) [<xref ref-type="bibr" rid="B12-viruses-04-01212">12</xref>,<xref ref-type="bibr" rid="B36-viruses-04-01212">36</xref>]. Again, viral breakthrough was delayed significantly when wild-type and 184V recombinant HIV were exposed to 3TC plus NNRTI. The above experiments by Jonckheere, Balzarini and Diallo <italic>et al.</italic> used clonal HIV-1 IIIB laboratory isolates passaged in tumor cell lines, which would be considered the standard method when examining the effect of individual mutations on the emergence of drug resistance mutations. In our experiments we confirmed that this additive 3TC-NNRTI effect is preserved even in the context of “real-life” patient isolates carrying the M184V “naturally”, <italic>i.e.</italic>, after <italic>in vivo</italic> exposure to 3TC. This is even more remarkable as our method used diverse clinical isolates, which may have contained minority variants below the 20% detection level with population-based sequencing [<xref ref-type="bibr" rid="B37-viruses-04-01212">37</xref>]. Future developments of this method should employ second generation sequencing methodologies to examine the role of minority variants in the mix, or to compare artificial mixtures of minority variants outcompeting each other under drug pressure.</p>
        <p>It remains to be noted that in our assay, we used pooled donor PBMC rather than immortalized laboratory cell lines, aiming to simulate the real-life scenario as closely as possible. While pooled PBMC may pose a potential caveat due to the variability in the composition of PBMC over time, the pooled PBMC culture technique has been developed and established at the Stanford Center for AIDS Research (CFAR) in the early 1990s [<xref ref-type="bibr" rid="B38-viruses-04-01212">38</xref>,<xref ref-type="bibr" rid="B39-viruses-04-01212">39</xref>,<xref ref-type="bibr" rid="B40-viruses-04-01212">40</xref>,<xref ref-type="bibr" rid="B41-viruses-04-01212">41</xref>,<xref ref-type="bibr" rid="B42-viruses-04-01212">42</xref>] and has since then become part of standard quantitative PBMC culture protocols in the NIAID Virology Manual for HIV Laboratories [<xref ref-type="bibr" rid="B43-viruses-04-01212">43</xref>]. Quan <italic>et al.</italic> observed an additive effect of 3TC+NVP in enzymatic assays when measuring the amount of full-length RT product in M184V mutant virus. The authors suggested that 2.5–20 μM 3TC might exhibit a modest antiviral effect in M184V mutant virus despite high-level resistance [<xref ref-type="bibr" rid="B32-viruses-04-01212">32</xref>]. Our data are in agreement with this hypothesis, but for 3TC-concentrations as low as 1 μM. </p>
        <p>Our results underline the importance of drug combination testing in patient isolates that are resistant at baseline. In 38 of 42 isolates exposed to NVP we selected for mutations that are located in the NNRTI binding pocket. We note that of them, 13 were at site 106, seven at 181, and five at 108. It seems plausible that structural constraints favor NNRTI mutations in positions 103-108 over changes in positions 181 or 188 as long as M184V predominates. The structure of M184I-HIV-1 has been solved and published [<xref ref-type="bibr" rid="B8-viruses-04-01212">8</xref>], NNRTI have been co-crystallized with wild-type as well as Y181C and Y188L mutant RT [<xref ref-type="bibr" rid="B44-viruses-04-01212">44</xref>]. For a better understanding of NRTI-NNRTI interactions complex three-dimensional models of dual/triple resistant virus will be required.</p>
        <p>In our study we investigate the overall effect of maintaining <italic>versus</italic> withdrawing 3TC pressure in clinical isolates at the first-time use of NNRTI. It is well known that NNRTI mutations are generated quickly <italic>de novo</italic>, even in wild-type laboratory strains. Clinical studies have shown that NNRTI- naïve patients may harbor HIV-1 viral variants with reduced NVP-susceptibility [<xref ref-type="bibr" rid="B45-viruses-04-01212">45</xref>,<xref ref-type="bibr" rid="B46-viruses-04-01212">46</xref>]. In our study, all isolates were fully susceptible to NVP and ADV at baseline (data not shown). All isolates were exposed to identical experimental conditions, allowing comparisons across the different drugs present in the growth media. In this context it is not surprising that the two isolates (#2 and #3) of common genetic lineage behaved similarly. As we expected, patterns of resistance evolved differently, but always in concordance with one basic hypothesis. That is, no matter the genetic background, 3TC precluded M184V-reversal and impaired the selection of mutations in the NNRTI binding pocket. Thus, continuing 3TC and adding at least two more active agents to the regimen should delay the initial selection of NNRTI resistance. </p>
        <p>The observation that <italic>ADV+NVP</italic> select for greater numbers of RT mutations than <italic>NVP_only</italic> can be explained by the selective pressure of both drugs, <italic>ADV+NVP</italic>, being greater than that of NVP alone, but sufficiently low to allow viral replication and selection. The pressures imposed by ADV would be expected to select changes conferring advantages to replication in the presence of ADV, such as 184 reversion. M184V reversion was promoted by ADV pressure only in the absence of 3TC pressure, contrary to reports of TDV+3TC serial passage experiments in SIV [<xref ref-type="bibr" rid="B47-viruses-04-01212">47</xref>]. Interestingly, the mutations observed with ADV in our experiments were, with one exception (T69I), all positioned within the NNRTI binding pocket as opposed to the NRTI binding pocket. Thus, the majority of mutations selected with <italic>NVP+ADV</italic> and <italic>NVP+ADV+3TC</italic> were mutations known to confer NVP, not ADV, resistance. <italic>ADV+3TC</italic> alone selected for random changes at positions 208 and 122. Another NRTI, zidovudine (ZDV) has previously been reported to increase mutation rates [<xref ref-type="bibr" rid="B48-viruses-04-01212">48</xref>,<xref ref-type="bibr" rid="B49-viruses-04-01212">49</xref>]. </p>
        <p>The rapid outgrowth of 184Met virus in the absence of 3TC in our experiments indicates that fitness disadvantages are compensated for, as soon as drug pressure is released. We screened for replicative fitness in P10-12 supernatants and found that TCID50 values, when measured several times in the absence of drug, were extremely low. Surprisingly, the same isolates showed dramatically improved growth in the presence ADV, NVP and 3TC, independent of the dose range applied (data not shown). Dose-dependent enhancement of viral growth by NNRTI has been reported [<xref ref-type="bibr" rid="B44-viruses-04-01212">44</xref>]. The observed phenomenon of dose-independent, but drug-dependent growth enhancement in some of our isolates will be a subject for further investigation [<xref ref-type="bibr" rid="B50-viruses-04-01212">50</xref>]. </p>
        <p>It has been suggested that the observed benefits of 3TC in combination therapy, even after 3TC-resistance arises, may be attributed to the net-effect of decreased adaptability and a deficit in viral fitness [<xref ref-type="bibr" rid="B5-viruses-04-01212">5</xref>,<xref ref-type="bibr" rid="B12-viruses-04-01212">12</xref>,<xref ref-type="bibr" rid="B51-viruses-04-01212">51</xref>]. The simulation of combination therapy <italic>in vitro</italic> is a new method that provides an important link between <italic>in vitro</italic> assays and <italic>in vivo</italic> studies in animal models and human subjects. Our data support a chain of evidence derived from biochemical assays and single-drug experiments in laboratory isolates, as we report. We approximate the actual clinical scenario further by using multiple drugs simultaneously in clinical isolates with diverse genetic backgrounds. </p>
        <p>The genetic background has been determined by consensus genotyping as the current method of choice when switching drug regimens. As indicated in the mathematical models used, this includes only the view of majority variants composing &gt;80% of the virus population [<xref ref-type="bibr" rid="B37-viruses-04-01212">37</xref>]. In this assay, each virus population was allotted the time required to outgrow drug pressures with each passage before the next passage was started. Future studies using different mathematical models will be addressing growth kinetics during single passages. Allele-specific assays may help determine the role of minority variants in the evolution of drug resistance against combinations of antiviral drugs.</p>
        <p>The next level of complexity would be reached in a clinical trial that ought to account for additional parameters, such as patient compliance, virus-host interactions, and the distribution of viral populations within body compartments [<xref ref-type="bibr" rid="B31-viruses-04-01212">31</xref>]. Several studies tested the decay of M184V during salvage therapy as well as treatment interruptions [<xref ref-type="bibr" rid="B51-viruses-04-01212">51</xref>,<xref ref-type="bibr" rid="B52-viruses-04-01212">52</xref>,<xref ref-type="bibr" rid="B53-viruses-04-01212">53</xref>,<xref ref-type="bibr" rid="B54-viruses-04-01212">54</xref>]. Resistant variants with impaired fitness disappeared within weeks after discontinuation of highly active antiretroviral therapy (HAART), accompanied by rapid viral load rebound. Only well-designed prospective clinical trials can assess the <italic>in vivo</italic> risk/benefit ratio and justify a prolonged, possibly once-daily use of 3TC in 3TC-resistant patients, not only in the context of strategic treatment interruptions, but also when a new regimen is started [<xref ref-type="bibr" rid="B31-viruses-04-01212">31</xref>,<xref ref-type="bibr" rid="B55-viruses-04-01212">55</xref>,<xref ref-type="bibr" rid="B56-viruses-04-01212">56</xref>,<xref ref-type="bibr" rid="B57-viruses-04-01212">57</xref>]. </p>
      </sec>
    </sec>
    <sec>
      <title>3. Experimental Section</title>
      <sec>
        <title>3.1. Test Compounds</title>
        <p>Lamivudine (3TC) was kindly provided by GlaxoSmithKline (Research Triangle Park, NC), ADV by Gilead (Foster City, CA). NVP was obtained from Boehringer Ingelheim (Ridgefield, CT).</p>
      </sec>
      <sec>
        <title>3.2. HIV Strains</title>
        <p>Six clinical isolates #1 through #5, were cell-free supernatants expanded by cocultivation with donor PBMC (NIAID Virology Manual for HIV Laboratories). They were stored at −70 °C. These frozen stocks were derived anonymously from individuals who had received long-term antiretroviral therapy but who had never been exposed to NNRTIs. The primary samples were sequenced up to RT amino acid position 300. A complete list of initial RT mutations (as compared to the Los Alamos consensus HIV-1B) can be found in the legends of <xref ref-type="fig" rid="viruses-04-01212-f001">Figure 1</xref> and <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref>. </p>
      </sec>
      <sec>
        <title>3.3. Cells and Cell Culture</title>
        <p>Pooled HIV-negative donor PBMC (Stanford Blood Bank) were isolated by centrifugation on Ficoll-Paque and were cultured in RPMI medium containing 15% heat-inactivated fetal calf serum, IL-2, PenStrep and L-Glu. Before use, these cells were stimulated for 2–3 days with phytohemagglutinin (Sigma, St. Luis, MO) and washed [<xref ref-type="bibr" rid="B40-viruses-04-01212">40</xref>,<xref ref-type="bibr" rid="B41-viruses-04-01212">41</xref>,<xref ref-type="bibr" rid="B42-viruses-04-01212">42</xref>].</p>
      </sec>
      <sec>
        <title>3.4. Passage Experiments</title>
        <p>Isolates # 1–5 were set up in five different drug combinations: <italic>NVP_only</italic>, <italic>NVP+3TC</italic>, <italic>NVP+ADV</italic>, <italic>NVP+3TC+ADV</italic>, <italic>3TC+ADV</italic> and <italic>No_drug</italic>, #3 and #2 were aliquots from the same baseline sample, but were run as independent experiments in <italic>NVP_only</italic>, <italic>NVP+3TC</italic>, and <italic>NVP+ADV</italic>. With each passage, the concentration of NVP was doubled. The NVP starting dose was 0.01 mM, around the IC 50 of the NNRTI-naïve baseline isolates. 3TC [1 mM] and ADV [2 mM] were added and maintained at levels around the IC50 of the respective baseline isolates. </p>
        <p>Newly passaged cultures were set up as follows: 100 μl supernatant, incubated with 5 Mio PBMCs in 1ml media without drug. After 2 hours of incubation at 37 °C/5% CO2, the culture was dissolved in 10ml media with the respective drug combinations. The cultures were transferred to 25-mL flasks and again incubated at 37 °C/5% CO2. </p>
        <p>Viral growth was monitored once weekly using a p24 antigen assay on supernatants (Abbott Laboratories, Chicago, IL). At p24 ELISA values &lt;3 × 10<sup>4 </sup>pg/mL, cultures were split: 2.5 Mio PBMCs were replaced by new donor PBMC in media containing the respective drugs in the same molar concentration. At ≥ 3 × 10<sup>4 </sup>pg/mL, the cultures were passaged after a 2-hour incubation time. With every passage [NVP] was doubled. The amount of supernatant to infect new cells was adapted according to p24 values obtained before passage. All experiments were carried to the 12th passage (P12), <italic>i.e.</italic>, 2048-fold [NVP], well below cytotoxic levels. Average time to P12 was 293 days (range 157–509 days). With every passage, supernatant was harvested and stored in aliquots at −70 °C. </p>
      </sec>
      <sec>
        <title>3.5. ABI Sequencing</title>
        <p>Population-based sequencing [<xref ref-type="bibr" rid="B37-viruses-04-01212">37</xref>] was done at baseline as well as from the supernatant obtained with every passage. As was described previously [<xref ref-type="bibr" rid="B58-viruses-04-01212">58</xref>], purified proviral RNA (Quiagen Viral RNA Extraction Kits, Chatsworth, CA) from cultured cell pellets was amplified by nested PCR. A Superscript-One-Step RT-PCR reagent (Life Technologies, Gaithersburg, MD) was used to obtain DNA segments for sequencing. First-round nested PCR primers were RT-21 [<xref ref-type="bibr" rid="B59-viruses-04-01212">59</xref>] and MAW-26 [<xref ref-type="bibr" rid="B58-viruses-04-01212">58</xref>] and second-round primers were PRO-1 [<xref ref-type="bibr" rid="B60-viruses-04-01212">60</xref>] and RT-20 [<xref ref-type="bibr" rid="B59-viruses-04-01212">59</xref>], respectively. Second-round products were sequenced using a dRhodamine labeled terminator kit (PE Applied Biosystems, Warrensburg, UK) and the previously described [<xref ref-type="bibr" rid="B61-viruses-04-01212">61</xref>] primers RT-a, RT-b (forward), RT-y and HXBR2-89 (reverse). Sequencing was performed using ABI Model 377 equipment and software. </p>
        <p>Sequences were aligned, proofread, and edited in a blinded fashion. Sequencing data were compared to the corresponding baseline isolates and to the consensus B sequence from the Los Alamos HIV Sequence Database, as well as to data obtained from earlier passages in the same experiment. Any mutation away from consensus B-sequence was defined as mutation. Any mutation back towards consensus HIV-1B was defined as a reversal, even if it was not “all the way back” to consensus. </p>
      </sec>
      <sec>
        <title>3.6. Statistical Methods</title>
        <p>For a given triple (drug combination, isolate, passage), the individual viral particle is the sampling unit for our first model. Its assumptions are that for each of (approximately) 3x10<sup>4</sup> viral particles and at each of the 300 RT key codons, the amino acid at that codon is either as it was at baseline or has a mutated value. Based on published estimates, the sensitivity of population based sequencing is at least 80% [<xref ref-type="bibr" rid="B37-viruses-04-01212">37</xref>]. We assume that for a fixed codon the probability of mutation is constant across particles [<xref ref-type="bibr" rid="B62-viruses-04-01212">62</xref>,<xref ref-type="bibr" rid="B63-viruses-04-01212">63</xref>]. For a fixed codon <italic>c</italic>, what might vary for two particles <italic>i</italic> and <italic>i’</italic> is the correlation between the indicator functions of the amino acid values at the codon for the two particles. Recall that the indicator function of an event is 1 if the event occurs and 0 if not. Therefore, the indicator for the <italic>c</italic><sup>th</sup> codon of the <italic>i</italic><sup>th</sup> particle is 1 if that codon has baseline value. Otherwise it is 0. Symbolically, this is ρ(<italic>i,i’</italic>) = <italic>Corr(I<sub>i</sub>(c),I<sub>i’</sub>(c))</italic>. </p>
        <p>We ask this question: “What would be the maximum value of this correlation, averaged over pairs of particles, so that two isolates differ at the 5% level of significance when one isolate has baseline values at all codons and the other a single mutation away from baseline?” </p>
        <p>The mathematical details and discussion of this novel statistical model are summarized in <italic>3.6.1. Viral Particle Model</italic> and <italic>3.6.2. Population Models</italic>, below:</p>
        <sec>
          <title>3.6.1. Viral Particle Model</title>
          <p>One approach to testing differences at two fixed passages between two isolates, neither descended from the other, was by what we have termed the <italic>viral particle model</italic>. The basis for comparison at a fixed codon is a two-sample t-like statistic that is the difference of two fractions divided by an estimate of the standard deviation of that difference. We denote the two isolates by <italic>a</italic> and <italic>b</italic>. </p>
          <p>For <italic>a</italic>, say, the indicator of particle <italic>i</italic> having its baseline value at codon <italic>c</italic> is <italic>I<sub>i</sub>(c)</italic>, which has value 1 if <italic>c</italic> is wild type, and otherwise is 0. There is an analogous indicator for <italic>b</italic>. We take the numbers of viral particles to be 30,000. We speak of the correlation <italic>ρ</italic> between two indicators. For two codons <italic>i</italic> and <italic>i′ </italic>we write this correlation <italic>ρ(i,i′).</italic> What matters is actually the value of <italic>ρ(i,i′)</italic> averaged over pairs <italic>(i,i′)</italic> of codons. From the constraint that the variance of a sum cannot be negative, it follows easily that the average <italic>ρ(i,i′)</italic> cannot be less than −3.33 × 10<sup>−5</sup>. In fact we expect that <italic>ρ</italic>, which we cannot know exactly, is positive and small. Because two particles within the same isolate and passage may have replicated inside the same cell, and also because of the physical proximity of any two particles within a flask can vary, we do not assume <italic>a priori</italic> that <italic>ρ</italic> = 0.</p>
          <p>For a comparison of differences, the numerator of the t-like statistic is</p>
          <p><disp-formula id="viruses-04-01212-i003">
          <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i003.tif"/>
          </disp-formula></p>
          <p>and <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i004.tif"/> is defined by analogy. </p>
          <p>From a well-known computation with sums of random variables that assume only values 0 and 1 it follows that the variance of <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i005.tif"/>, </p>
          <p><disp-formula id="viruses-04-01212-i006">
          <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i006.tif"/>
          </disp-formula></p>
          <p>where <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i007.tif"/></p>
          <p>Note that this probability is assumed here not to depend on <italic>i</italic>. (Of course, computations that follow in this appendix, and that are required elsewhere in the paper, show this assumption to be false, decisively. However, the net effect of our assumptions is to make the p-values of our test extremely conservative.) We estimate <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i008.tif"/> by replacing <italic>p<sub>a</sub></italic> on the right hand side of (A.1) by <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i009.tif"/>.</p>
          <p><inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i010.tif"/> is estimated analogously. Because <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i009.tif"/> and <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i011.tif"/> are clearly independent, our t-like statistic is now seen to be</p>
          <p><disp-formula id="viruses-04-01212-i012">
          <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i012.tif"/>
          </disp-formula></p>
          <p>The missing ingredient in <italic>t<sub>c</sub></italic> is <italic>ρ</italic>, which we admittedly have no way of knowing exactly. But for that, we could approximate p-value for testing the null hypothesis “no difference between given isolates and passages at codon <italic>c</italic>” by <italic>Prob (|Z| &gt; t),</italic> where <italic>Z</italic> is a standard Gaussian random variable; and <italic>t</italic> the observed value of <italic>t<sub>c</sub></italic>. We could then test the null hypothesis “no difference at any codon” by 300<italic>Prob (|Z| &gt; t</italic>). The latter computation uses the simple Bonferroni bound. In fact what we wish to do with <italic>t<sub>c</sub></italic> is to find and use the largest value of <italic>ρ</italic> for which the cited 80%–20% difference at some codon for fixed isolates and passages is significant at the 5% level for the null hypothesis as given. First, we solve <italic>Prob (|Z| &gt; t</italic>) = 0.05/300 for <italic>t</italic>, arriving at <italic>t</italic> = 3.7482. </p>
          <p>Then, set <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i013.tif"/> = 0.8, <inline-graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="viruses-04-01212-i014.tif"/> = 0.2, and <italic>t<sub>c</sub></italic> = 3.7482; and solve for <italic>ρ</italic>. The resulting <italic>ρ</italic> is 0.08.</p>
        </sec>
        <sec>
          <title>3.6.2. Population Models</title>
          <p>Two further models are based on the notion that for each (drug, passage) combination, isolates are sampling units. Thus, the sample size is five for <italic>NVP_only</italic>, <italic>NVP+3TC</italic>, and <italic>NVP+ADV</italic>, and for <italic>NVP+3TC+ADV</italic>, <italic>3TC+ADV</italic>, and <italic>No_drug</italic>, for a total sample size of 27 for each cited pair. </p>
          <p>Numbers of mutations across isolates within a particular passage for a “counting process” such as ours might be taken to be what is conventional in such applications, a Poisson process. The Poisson model arises when there are many chances for “success” but few “successes”, and in addition trials are independent. These assumptions might apply when we take mutations themselves as sampling units. The presence of mutation or mutations within an isolate and drug combination can be assumed independent across passages; they are certainly independent across isolates. A sum of independent Poisson random variables has a Poisson distribution no matter the respective parameters of the summands. Conversely, if a sum of independent random variables has a Poisson distribution, then according to D. Raikov [<xref ref-type="bibr" rid="B64-viruses-04-01212">64</xref>], each summand has a Poisson distribution. Therefore, we can test the null hypothesis that the Poisson model applies to numbers of mutations within a drug combination by looking at Passage 12 to see if the distribution of numbers of mutations across isolates is Poisson. We begin with the usual approach to assessing the Poisson model: via the “Poisson dispersion test” [<xref ref-type="bibr" rid="B63-viruses-04-01212">63</xref>]. (In a Poisson model the mean and variance are equal as numbers.) The test statistic is proportional to the ratio of sample variance to sample mean. If the Poisson model for mutations were correct for a fixed treatment (or drug combination), but there was a change by isolate in the Poisson parameter with 184 reversal, then there would be evidence for over-dispersed data and thus evidence against a strict Poisson model. Other aspects of the experiment could lead to over-dispersed or under-dispersed numbers of mutations. (Over[under]-dispersion in a model means that the variance is greater [less] than what the model would constrain it to be.) There are some 0s in the sample variances when isolates are pooled within treatments. The ratio of sample variance to sample mean disregards information in the sample mean when the sample variance is 0. This observation and a Taylor series argument not given here led us to use as a test statistic the difference of sample mean and sample variance rather than the usual ratio. On the null hypothesis that the data are Poisson, the difference should be 0 to within noise. Because there are at most five isolates per drug combination, we could not rely on asymptotic distributions computed under the null hypothesis. Instead, we used the parametric bootstrap distribution [<xref ref-type="bibr" rid="B62-viruses-04-01212">62</xref>] of the test statistic under the null hypothesis. This amounts to sampling independently from a Poisson distribution with parameter (mean and variance) the average number of mutations observed at the twelfth passage. The resulting distribution is the reference distribution for the cited difference when the null hypothesis is true. We took 1,000 bootstrap samples per drug combination. This approach enabled us to compute p-values for the null hypothesis separately for alternatives of over-dispersion and under-dispersion relative to the Poisson.</p>
          <p>When the number of mutations across isolates within a particular passage is hypothesized to have a Poisson distribution and tested as specified, then the p-value for “over-dispersion” is never less than 0.85. However, for the model with “under-dispersion”, the respective p-values are 0.137 for <italic>NVP only</italic>, 0.147 for <italic>NVP+3TC</italic>, 0.058 for <italic>NVP+ADV, 0</italic>.061 for <italic>NVP+3TC+ADV</italic>, and 0.370 for <italic>3TC+ADV</italic>. There were no mutations but V184M reversal (and two other reversals) for the No drug regimen. Clearly, none of the five p- values is less than 0.05. However, when we combine them by Fisher’s technique [<xref ref-type="bibr" rid="B65-viruses-04-01212">65</xref>] of summing minus twice the natural logarithms of the p-values and comparing the sum with a chi-square distribution with 10 degrees of freedom, the overall p-value for the null hypothesis of “under-dispersion” comes to 0.03. For this reason we did not use the Poisson model for numbers of mutations. Instead, our test statistic was nonparametric. Given two candidate drug regimes, it was simply the difference between cumulative numbers of mutations, pooled across isolates. The significance of this difference at each passage was assessed by a permutation test [<xref ref-type="bibr" rid="B62-viruses-04-01212">62</xref>].</p>
          <p>In summary, the first of the two involves a Poisson assumption that is standard for data like ours but that was discarded after careful study. </p>
          <p>The second of the two models involves a nonparametric statistic. That is, given two candidate drug regimens, it is simply the difference between cumulative numbers of mutations, pooled across isolates. The significance of this difference at each passage was assessed by a permutation test [<xref ref-type="bibr" rid="B62-viruses-04-01212">62</xref>]. That the passages of the isolates are independent conditional on their origin is all that matters for the validity of this second test. Sampling distributions of reversal by isolate ought to be closer for the second and third isolates than for any other pair when they are exposed to the same challenges. With the second of the cited two approaches here, we can assign separate p-values for the null hypothesis of “no difference in mutation rate” <italic>versus</italic> each of the two alternatives where one treatment produces a greater mutation rate than the other. </p>
          <p>The issue of whether 3TC precludes V184M reversal can be approached by means of a 2-by-2 table and Fisher’s exact test [<xref ref-type="bibr" rid="B63-viruses-04-01212">63</xref>]. One of rows or columns corresponds to “treatment with 3TC or not” and the other to “reversal” or not. There are 27 isolates (<xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref>).</p>
        </sec>
      </sec>
    </sec>
    <sec sec-type="conclusions">
      <title>4. Conclusions</title>
      <p>Using a novel <italic>in vitro</italic> assay and statistical model, we explored useful strategies of combining antiretroviral drugs with potentially divergent effects on the RT substitution M184V, exerting high-level resistance to 3TC.</p>
      <p>We noted a pronounced “antimutator effect” when continuing low-dose 3TC while introducing a first-time NNRTI (NVP) in NRTI resistant/NNRTI naïve clinical isolates. Even in the context of high-level resistance, maintaining 3TC pressure prevented reversal M184V in all instances while delaying the emergence of NNRTI resistance. The opposite effect was exerted by ADV; M184V mutant HIV-1 has previously been shown to be hypersusceptible to ADV (as well as its successor, tenofovir) [<xref ref-type="bibr" rid="B23-viruses-04-01212">23</xref>].</p>
      <p>For improved visualization of HIV evolution and dynamics during serial passage experiments, we summarized <italic>in vitro </italic>responses to different drug combinations in an innovative fashion using a Serial Passage Integrated Display (“Cube Model”, <xref ref-type="fig" rid="viruses-04-01212-f002">Figure 2</xref>) with 2-by-4 tables based on reversal/no reversal and the number of newly selected mutations per clinical isolate (“cube”).</p>
    </sec>
  </body>
  <back>
    <ack>
      <title>Acknowledgments</title>
      <p>The authors thank three companies for their generosity in supplying compounds for this study: GlaxoSmithKline Inc., USA (3TC, Epivir™), Gilead Sciences Inc. (ADV, Preveon™), and Boehringer Ingelheim Inc. (NVP, Nevirapine™). We especially thank David A. Katzenstein and Robert W. Shafer for their scientific advice and Mark Winters, Kristi Cooley, Aimee Geissler, and Yvette Girard for their excellent technical assistance. We also thank Karen Johnson and Murtaza Alimohamed for helping us with the data assembly and the graphical display of our results. The support of Grant CA59039 from the National Cancer Institute and 8R01 EB002784-28 from the National Institutes of Health are acknowledged with gratitude.</p>
    </ack>
    <notes>
      <title>Conflict of Interest</title>
      <p>The authors declare no conflict of interest. </p>
    </notes>
    <ref-list>
      <title>References</title>
      <ref id="B1-viruses-04-01212">
        <label>1.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Camacho</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Teofilo</surname>
              <given-names>E.</given-names>
            </name>
          </person-group>
          <article-title>Antiretroviral therapy in treatment-naive patients with HIV infection</article-title>
          <source>Current opinion in HIV and AIDS</source>
          <year>2011</year>
          <volume>6 Suppl 1</volume>
          <fpage>S3</fpage>
          <lpage>S11</lpage>
          <pub-id pub-id-type="doi">10.1097/01.COH.0000410239.88517.00</pub-id>
        </citation>
      </ref>
      <ref id="B2-viruses-04-01212">
        <label>2.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Akanbi</surname>
              <given-names>M.O.</given-names>
            </name>
            <name>
              <surname>Scarci</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Taiwo</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Murphy</surname>
              <given-names>R.L.</given-names>
            </name>
          </person-group>
          <article-title>Combination nucleoside/nucleotide reverse transcriptase inhibitors for treatment of HIV infection</article-title>
          <source>Expert Opin. Pharmacother.</source>
          <year>2012</year>
          <volume>13</volume>
          <fpage>65</fpage>
          <lpage>79</lpage>
          <pub-id pub-id-type="doi">10.1517/14656566.2012.642865</pub-id>
        </citation>
      </ref>
      <ref id="B3-viruses-04-01212">
        <label>3.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rouleau</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Fortin</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Trottier</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Lalonde</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Lapointe</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Cote</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Routy</surname>
              <given-names>J.P.</given-names>
            </name>
            <name>
              <surname>Matte</surname>
              <given-names>M.F.</given-names>
            </name>
            <name>
              <surname>Tsarevsky</surname>
              <given-names>I.</given-names>
            </name>
            <name>
              <surname>Baril</surname>
              <given-names>J.G.</given-names>
            </name>
          </person-group>
          <article-title>Antiretroviral therapy for adults infected with HIV: Guidelines for health care professionals from the Quebec HIV care committee</article-title>
          <source>Can. J. Infect. Dis. Med. Microbiol.</source>
          <year>2011</year>
          <volume>22</volume>
          <fpage>52</fpage>
          <lpage>60</lpage>
        <pub-id pub-id-type="pmid">22654926</pub-id></citation>
      </ref>
      <ref id="B4-viruses-04-01212">
        <label>4.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Sierra-Aragon</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Walter</surname>
              <given-names>H.</given-names>
            </name>
          </person-group>
          <article-title>Targets for inhibition of HIV replication: Entry, enzyme action, release and maturation</article-title>
          <source>Intervirology</source>
          <year>2012</year>
          <volume>55</volume>
          <fpage>84</fpage>
          <lpage>97</lpage>
          <pub-id pub-id-type="doi">10.1159/000331995</pub-id>
        </citation>
      </ref>
      <ref id="B5-viruses-04-01212">
        <label>5.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Van Rompay</surname>
              <given-names>K.K.</given-names>
            </name>
            <name>
              <surname>Matthews</surname>
              <given-names>T.B.</given-names>
            </name>
            <name>
              <surname>Higgins</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Canfield</surname>
              <given-names>D.R.</given-names>
            </name>
            <name>
              <surname>Tarara</surname>
              <given-names>R.P.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Schinazi</surname>
              <given-names>R.F.</given-names>
            </name>
            <name>
              <surname>Pedersen</surname>
              <given-names>N.C.</given-names>
            </name>
            <name>
              <surname>North</surname>
              <given-names>T.W.</given-names>
            </name>
          </person-group>
          <article-title>Virulence and reduced fitness of simian immunodeficiency virus with the M184V mutation in reverse transcriptase</article-title>
          <source>J. Virol.</source>
          <year>2002</year>
          <volume>76</volume>
          <fpage>6083</fpage>
          <lpage>6092</lpage>
        <pub-id pub-id-type="doi">10.1128/JVI.76.12.6083-6092.2002</pub-id><pub-id pub-id-type="pmid">12021341</pub-id></citation>
      </ref>
      <ref id="B6-viruses-04-01212">
        <label>6.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>McColl</surname>
              <given-names>D.J.</given-names>
            </name>
            <name>
              <surname>Margot</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Chen</surname>
              <given-names>S.S.</given-names>
            </name>
            <name>
              <surname>Harris</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Borroto-Esoda</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Miller</surname>
              <given-names>M.D.</given-names>
            </name>
          </person-group>
          <article-title>Reduced emergence of the M184V/I resistance mutation when antiretroviral-naive subjects use emtricitabine <italic>versus</italic> lamivudine in regimens composed of two NRTIs plus the NNRTI efavirenz</article-title>
          <source>HIV Clin. Trials</source>
          <year>2011</year>
          <volume>12</volume>
          <fpage>61</fpage>
          <lpage>70</lpage>
          <pub-id pub-id-type="doi">10.1310/hct1202-61</pub-id>
        </citation>
      </ref>
      <ref id="B7-viruses-04-01212">
        <label>7.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Svedhem</surname>
              <given-names>V.</given-names>
            </name>
            <name>
              <surname>Bergroth</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Lidman</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Sonnerborg</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Presence of M184I/V in minor HIV-1 populations of patients with lamivudine and/or didanosine treatment failure</article-title>
          <source>HIV Med.</source>
          <year>2007</year>
          <volume>8</volume>
          <fpage>504</fpage>
          <lpage>510</lpage>
          <pub-id pub-id-type="doi">10.1111/j.1468-1293.2007.00502.x</pub-id>
        </citation>
      </ref>
      <ref id="B8-viruses-04-01212">
        <label>8.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Sarafianos</surname>
              <given-names>S.G.</given-names>
            </name>
            <name>
              <surname>Das</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Clark</surname>
              <given-names>A.D.</given-names>
              <suffix>Jr.</suffix>
            </name>
            <name>
              <surname>Ding</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Boyer</surname>
              <given-names>P.L.</given-names>
            </name>
            <name>
              <surname>Hughes</surname>
              <given-names>S.H.</given-names>
            </name>
            <name>
              <surname>Arnold</surname>
              <given-names>E.</given-names>
            </name>
          </person-group>
          <article-title>Lamivudine (3TC) resistance in HIV-1 reverse transcriptase involves steric hindrance with beta-branched amino acids</article-title>
          <source>Proc. Natl. Acad. Sci. USA</source>
          <year>1999</year>
          <volume>96</volume>
          <fpage>10027</fpage>
          <lpage>10032</lpage>
        <pub-id pub-id-type="doi">10.1073/pnas.96.18.10027</pub-id><pub-id pub-id-type="pmid">10468556</pub-id></citation>
      </ref>
      <ref id="B9-viruses-04-01212">
        <label>9.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Wei</surname>
              <given-names>X.</given-names>
            </name>
            <name>
              <surname>Liang</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Negative effect of the M184V mutation in HIV-1 reverse transcriptase on initiation of viral DNA synthesis</article-title>
          <source>Virology</source>
          <year>2003</year>
          <volume>311</volume>
          <fpage>202</fpage>
          <lpage>212</lpage>
          <pub-id pub-id-type="doi">10.1016/S0042-6822(03)00173-9</pub-id>
        </citation>
      </ref>
      <ref id="B10-viruses-04-01212">
        <label>10.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Wei</surname>
              <given-names>X.</given-names>
            </name>
            <name>
              <surname>Liang</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>The M184V mutation in HIV-1 reverse transcriptase reduces the restoration of wild-type replication by attenuated viruses</article-title>
          <source>AIDS (London, England)</source>
          <year>2002</year>
          <volume>16</volume>
          <fpage>2391</fpage>
          <lpage>2398</lpage>
          <pub-id pub-id-type="doi">10.1097/00002030-200212060-00003</pub-id>
        </citation>
      </ref>
      <ref id="B11-viruses-04-01212">
        <label>11.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Diallo</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Molecular impact of the M184V mutation in human immunodeficiency virus type 1 reverse transcriptase</article-title>
          <source>Antimicrob. Agents Chemother.</source>
          <year>2003</year>
          <volume>47</volume>
          <fpage>3377</fpage>
          <lpage>3383</lpage>
          <pub-id pub-id-type="doi">10.1128/AAC.47.11.3377-3383.2003</pub-id>
        </citation>
      </ref>
      <ref id="B12-viruses-04-01212">
        <label>12.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Diallo</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Brenner</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Oliveira</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Moisi</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Detorio</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>The M184V substitution in human immunodeficiency virus type 1 reverse transcriptase delays the development of resistance to amprenavir and efavirenz in subtype B and C clinical isolates</article-title>
          <source>Antimicrob. Agents Chemother.</source>
          <year>2003</year>
          <volume>47</volume>
          <fpage>2376</fpage>
          <lpage>2379</lpage>
        <pub-id pub-id-type="doi">10.1128/AAC.47.7.2376-2379.2003</pub-id><pub-id pub-id-type="pmid">12821504</pub-id></citation>
      </ref>
      <ref id="B13-viruses-04-01212">
        <label>13.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Arion</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Parniak</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>The M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1 impairs rescue of chain-terminated DNA synthesis</article-title>
          <source>J. Virol.</source>
          <year>2000</year>
          <volume>74</volume>
          <fpage>3579</fpage>
          <lpage>3585</lpage>
          <pub-id pub-id-type="doi">10.1128/JVI.74.8.3579-3585.2000</pub-id>
        </citation>
      </ref>
      <ref id="B14-viruses-04-01212">
        <label>14.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Sanjuan</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Nebot</surname>
              <given-names>M.R.</given-names>
            </name>
            <name>
              <surname>Chirico</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
            <name>
              <surname>Belshaw</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Viral mutation rates</article-title>
          <source>J. Virol.</source>
          <year>2010</year>
          <volume>84</volume>
          <fpage>9733</fpage>
          <lpage>9748</lpage>
          <pub-id pub-id-type="doi">10.1128/JVI.00694-10</pub-id>
        </citation>
      </ref>
      <ref id="B15-viruses-04-01212">
        <label>15.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Dapp</surname>
              <given-names>M.J.</given-names>
            </name>
            <name>
              <surname>Holtz</surname>
              <given-names>C.M.</given-names>
            </name>
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
          </person-group>
          <article-title>Concomitant lethal mutagenesis of human immunodeficiency virus type 1</article-title>
          <source>J. Mol. Biol.</source>
          <year>2012</year>
          <volume>419</volume>
          <fpage>158</fpage>
          <lpage>170</lpage>
          <pub-id pub-id-type="doi">10.1016/j.jmb.2012.03.003</pub-id>
        </citation>
      </ref>
      <ref id="B16-viruses-04-01212">
        <label>16.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Chen</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Quinones-Mateu</surname>
              <given-names>M.E.</given-names>
            </name>
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
          </person-group>
          <article-title>Drug resistance, virus fitness and HIV-1 mutagenesis</article-title>
          <source>Curr. Pharm. Des.</source>
          <year>2004</year>
          <volume>10</volume>
          <fpage>4065</fpage>
          <lpage>4070</lpage>
          <pub-id pub-id-type="doi">10.2174/1381612043382404</pub-id>
        </citation>
      </ref>
      <ref id="B17-viruses-04-01212">
        <label>17.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Stumpp</surname>
              <given-names>S.N.</given-names>
            </name>
            <name>
              <surname>Heyn</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Brakmann</surname>
              <given-names>S.</given-names>
            </name>
          </person-group>
          <article-title>Activity-based selection of HIV-1 reverse transcriptase variants with decreased polymerization fidelity</article-title>
          <source>Biol. Chem.</source>
          <year>2010</year>
          <volume>391</volume>
          <fpage>665</fpage>
          <lpage>674</lpage>
          <pub-id pub-id-type="doi">10.1515/bc.2010.067</pub-id>
        </citation>
      </ref>
      <ref id="B18-viruses-04-01212">
        <label>18.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>The impact of the M184V substitution on drug resistance and viral fitness</article-title>
          <source>Expert Rev. Anti Infect. Ther.</source>
          <year>2004</year>
          <volume>2</volume>
          <fpage>147</fpage>
          <lpage>151</lpage>
          <pub-id pub-id-type="doi">10.1586/14787210.2.1.147</pub-id>
        </citation>
      </ref>
      <ref id="B19-viruses-04-01212">
        <label>19.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Turner</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Brenner</surname>
              <given-names>B.G.</given-names>
            </name>
            <name>
              <surname>Routy</surname>
              <given-names>J.P.</given-names>
            </name>
            <name>
              <surname>Petrella</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Rationale for maintenance of the M184v resistance mutation in human immunodeficiency virus type 1 reverse transcriptase in treatment experienced patients</article-title>
          <source>New Microbiol.</source>
          <year>2004</year>
          <volume>27</volume>
          <fpage>31</fpage>
          <lpage>39</lpage>
        <pub-id pub-id-type="pmid">15646062</pub-id></citation>
      </ref>
      <ref id="B20-viruses-04-01212">
        <label>20.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hauser</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Mugenyi</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Kabasinguzi</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Kuecherer</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Harms</surname>
              <given-names>G.</given-names>
            </name>
            <name>
              <surname>Kunz</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Emergence and persistence of minor drug-resistant HIV-1 variants in Ugandan women after nevirapine single-dose prophylaxis</article-title>
          <source>PLoS One</source>
          <year>2011</year>
          <volume>6</volume>
          <pub-id pub-id-type="doi">10.1371/journal.pone.0020357</pub-id>
        </citation>
      </ref>
      <ref id="B21-viruses-04-01212">
        <label>21.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Petrella</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Might the M184V substitution in HIV-1 RT confer clinical benefit?</article-title>
          <source>AIDS Rev.</source>
          <year>2002</year>
          <volume>4</volume>
          <fpage>224</fpage>
          <lpage>232</lpage>
        <pub-id pub-id-type="pmid">12555696</pub-id></citation>
      </ref>
      <ref id="B22-viruses-04-01212">
        <label>22.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
            <name>
              <surname>Cunningham</surname>
              <given-names>K.S.</given-names>
            </name>
          </person-group>
          <article-title>Virus mutators and antimutators: Roles in evolution, pathogenesis and emergence</article-title>
          <source>Trends Genet.</source>
          <year>2000</year>
          <volume>16</volume>
          <fpage>512</fpage>
          <lpage>517</lpage>
          <pub-id pub-id-type="doi">10.1016/S0168-9525(00)02125-9</pub-id>
        </citation>
      </ref>
      <ref id="B23-viruses-04-01212">
        <label>23.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Palmer</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Margot</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Gilbert</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Shaw</surname>
              <given-names>N.</given-names>
            </name>
            <name>
              <surname>Buckheit</surname>
              <given-names>R.</given-names>
              <suffix>Jr.</suffix>
            </name>
            <name>
              <surname>Miller</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Tenofovir, adefovir, and zidovudine susceptibilities of primary human immunodeficiency virus type 1 isolates with non-B subtypes or nucleoside resistance</article-title>
          <source>AIDS Res. Hum. Retrovir.</source>
          <year>2001</year>
          <volume>17</volume>
          <fpage>1167</fpage>
          <lpage>1173</lpage>
          <pub-id pub-id-type="doi">10.1089/088922201316912772</pub-id>
        </citation>
      </ref>
      <ref id="B24-viruses-04-01212">
        <label>24.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Miller</surname>
              <given-names>M.D.</given-names>
            </name>
            <name>
              <surname>Anton</surname>
              <given-names>K.E.</given-names>
            </name>
            <name>
              <surname>Mulato</surname>
              <given-names>A.S.</given-names>
            </name>
            <name>
              <surname>Lamy</surname>
              <given-names>P.D.</given-names>
            </name>
            <name>
              <surname>Cherrington</surname>
              <given-names>J.M.</given-names>
            </name>
          </person-group>
          <article-title>Human immunodeficiency virus type 1 expressing the lamivudine-associated M184V mutation in reverse transcriptase shows increased susceptibility to adefovir and decreased replication capability <italic>in vitro</italic></article-title>
          <source>J. Infect. Dis.</source>
          <year>1999</year>
          <volume>179</volume>
          <fpage>92</fpage>
          <lpage>100</lpage>
          <pub-id pub-id-type="doi">10.1086/314560</pub-id>
        </citation>
      </ref>
      <ref id="B25-viruses-04-01212">
        <label>25.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Lehmann</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>D’Abrera</surname>
              <given-names>H.</given-names>
            </name>
          </person-group>
          <source>Nonparametrics: Statistical Methods based on Ranks</source>
          <publisher-name>Mcgraw-Hill</publisher-name>
          <publisher-loc>New York, NY, USA</publisher-loc>
          <year>1975</year>
          <fpage>240</fpage>
          <lpage>247</lpage>
        </citation>
      </ref>
      <ref id="B26-viruses-04-01212">
        <label>26.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Efron</surname>
              <given-names>B.</given-names>
            </name>
          </person-group>
          <source>Large-Scale Inference: Empirical Bayes Methods for Estimation, Testing, and Prediction</source>
          <publisher-name>Cambridge University Press</publisher-name>
          <publisher-loc>Cambridge, United Kingdom</publisher-loc>
          <year>2010</year>
          <volume>1</volume>
        </citation>
      </ref>
      <ref id="B27-viruses-04-01212">
        <label>27.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Kekitiinwa</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Asiimwe</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Kasirye</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Korutaro</surname>
              <given-names>V.</given-names>
            </name>
            <name>
              <surname>Kitaka</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Maganda</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Madalon</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Graziano</surname>
              <given-names>F.M.</given-names>
            </name>
          </person-group>
          <article-title>Prospective long-term outcomes of a cohort of ugandan children with laboratory monitoring during antiretroviral therapy</article-title>
          <source>Pediatr. Infect. Dis. J.</source>
          <year>2012</year>
          <volume>31</volume>
          <fpage>e117</fpage>
          <lpage>e125</lpage>
          <pub-id pub-id-type="doi">10.1097/INF.0b013e31825cb9d6</pub-id>
        </citation>
      </ref>
      <ref id="B28-viruses-04-01212">
        <label>28.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Prosperi</surname>
              <given-names>M.C.</given-names>
            </name>
            <name>
              <surname>De Luca</surname>
              <given-names>A.</given-names>
            </name>
          </person-group>
          <article-title>Computational models for prediction of response to antiretroviral therapies</article-title>
          <source>AIDS Rev.</source>
          <year>2012</year>
          <volume>14</volume>
          <fpage>145</fpage>
          <lpage>153</lpage>
        <pub-id pub-id-type="pmid">22627610</pub-id></citation>
      </ref>
      <ref id="B29-viruses-04-01212">
        <label>29.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Baxter</surname>
              <given-names>J.D.</given-names>
            </name>
            <name>
              <surname>Mayers</surname>
              <given-names>D.L.</given-names>
            </name>
            <name>
              <surname>Wentworth</surname>
              <given-names>D.N.</given-names>
            </name>
            <name>
              <surname>Neaton</surname>
              <given-names>J.D.</given-names>
            </name>
            <name>
              <surname>Hoover</surname>
              <given-names>M.L.</given-names>
            </name>
            <name>
              <surname>Winters</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Mannheimer</surname>
              <given-names>S.B.</given-names>
            </name>
            <name>
              <surname>Thompson</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Abrams</surname>
              <given-names>D.I.</given-names>
            </name>
            <name>
              <surname>Brizz</surname>
              <given-names>B.J.</given-names>
            </name>
            <etal/>
          </person-group>
          <article-title>A randomized study of antiretroviral management based on plasma genotypic antiretroviral resistance testing in patients failing therapy. CPCRA 046 Study Team for the Terry Beirn Community Programs for Clinical Research on AIDS</article-title>
          <source>AIDS (London, England)</source>
          <year>2000</year>
          <volume>14</volume>
          <fpage>F83</fpage>
          <lpage>F93</lpage>
          <pub-id pub-id-type="doi">10.1097/00002030-200006160-00001</pub-id>
        </citation>
      </ref>
      <ref id="B30-viruses-04-01212">
        <label>30.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Hill</surname>
              <given-names>A.L.</given-names>
            </name>
            <name>
              <surname>Rosenbloom</surname>
              <given-names>D.I.</given-names>
            </name>
            <name>
              <surname>Nowak</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Evolutionary dynamics of HIV at multiple spatial and temporal scales</article-title>
          <source>J. Mol. Med. (Berl. Ger.)</source>
          <year>2012</year>
          <volume>90</volume>
          <fpage>543</fpage>
          <lpage>561</lpage>
          <pub-id pub-id-type="doi">10.1007/s00109-012-0892-1</pub-id>
        </citation>
      </ref>
      <ref id="B31-viruses-04-01212">
        <label>31.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Fox</surname>
              <given-names>Z.</given-names>
            </name>
            <name>
              <surname>Dragsted</surname>
              <given-names>U.B.</given-names>
            </name>
            <name>
              <surname>Gerstoft</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Phillips</surname>
              <given-names>A.N.</given-names>
            </name>
            <name>
              <surname>Kjaer</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Mathiesen</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Youle</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Katlama</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Hill</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Bruun</surname>
              <given-names>J.N.</given-names>
            </name>
            <etal/>
          </person-group>
          <article-title>A randomized trial to evaluate continuation <italic>versus</italic> discontinuation of lamivudine in individuals failing a lamivudine-containing regimen: The COLATE trial</article-title>
          <source>Antivir. Ther.</source>
          <year>2006</year>
          <volume>11</volume>
          <fpage>761</fpage>
          <lpage>770</lpage>
        <pub-id pub-id-type="pmid">17310820</pub-id></citation>
      </ref>
      <ref id="B32-viruses-04-01212">
        <label>32.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Quan</surname>
              <given-names>Y.</given-names>
            </name>
            <name>
              <surname>Brenner</surname>
              <given-names>B.G.</given-names>
            </name>
            <name>
              <surname>Oliveira</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
          </person-group>
          <article-title>Lamivudine can exert a modest antiviral effect against human immunodeficiency virus type 1 containing the M184V mutation</article-title>
          <source>Antimicrob. Agents Chemother.</source>
          <year>2003</year>
          <volume>47</volume>
          <fpage>747</fpage>
          <lpage>754</lpage>
        <pub-id pub-id-type="doi">10.1128/AAC.47.2.747-754.2003</pub-id><pub-id pub-id-type="pmid">12543687</pub-id></citation>
      </ref>
      <ref id="B33-viruses-04-01212">
        <label>33.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rezende</surname>
              <given-names>L.F.</given-names>
            </name>
            <name>
              <surname>Prasad</surname>
              <given-names>V.R.</given-names>
            </name>
          </person-group>
          <article-title>Nucleoside-analog resistance mutations in HIV-1 reverse transcriptase and their influence on polymerase fidelity and viral mutation rates</article-title>
          <source>Int. J. Biochem. Cell Biol.</source>
          <year>2004</year>
          <volume>36</volume>
          <fpage>1716</fpage>
          <lpage>1734</lpage>
        <pub-id pub-id-type="doi">10.1016/j.biocel.2004.02.025</pub-id><pub-id pub-id-type="pmid">15183340</pub-id></citation>
      </ref>
      <ref id="B34-viruses-04-01212">
        <label>34.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Keulen</surname>
              <given-names>W.</given-names>
            </name>
            <name>
              <surname>van Wijk</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Schuurman</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Berkhout</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Boucher</surname>
              <given-names>C.A.</given-names>
            </name>
          </person-group>
          <article-title>Increased polymerase fidelity of lamivudine-resistant HIV-1 variants does not limit their evolutionary potential</article-title>
          <source>AIDS (London, England)</source>
          <year>1999</year>
          <volume>13</volume>
          <fpage>1343</fpage>
          <lpage>1349</lpage>
          <pub-id pub-id-type="doi">10.1097/00002030-199907300-00011</pub-id>
        </citation>
      </ref>
      <ref id="B35-viruses-04-01212">
        <label>35.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Jonckheere</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Witvrouw</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>de Clercq</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Anne</surname>
              <given-names>J.</given-names>
            </name>
          </person-group>
          <article-title>Lamivudine resistance of HIV type 1 does not delay development of resistance to nonnucleoside HIV type 1-specific reverse transcriptase inhibitors as compared with wild-type HIV type 1</article-title>
          <source>AIDS Res. Hum. Retrovir.</source>
          <year>1998</year>
          <volume>14</volume>
          <fpage>249</fpage>
          <lpage>253</lpage>
          <pub-id pub-id-type="doi">10.1089/aid.1998.14.249</pub-id>
        </citation>
      </ref>
      <ref id="B36-viruses-04-01212">
        <label>36.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Balzarini</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Pelemans</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Karlsson</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>de Clerc</surname>
              <given-names>Q.E.</given-names>
            </name>
            <name>
              <surname>Kleim</surname>
              <given-names>J.P.</given-names>
            </name>
          </person-group>
          <article-title>Concomitant combination therapy for HIV infection preferable over sequential therapy with 3TC and non-nucleoside reverse transcriptase inhibitors</article-title>
          <source>Proc. Natl. Acad. Sci. USA</source>
          <year>1996</year>
          <volume>93</volume>
          <fpage>13152</fpage>
          <lpage>13157</lpage>
          <pub-id pub-id-type="doi">10.1073/pnas.93.23.13152</pub-id>
        </citation>
      </ref>
      <ref id="B37-viruses-04-01212">
        <label>37.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>Hertogs</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Zolopa</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Warford</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Bloor</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Betts</surname>
              <given-names>B.J.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
            <name>
              <surname>Harrigan</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Larder</surname>
              <given-names>B.A.</given-names>
            </name>
          </person-group>
          <article-title>High degree of interlaboratory reproducibility of human immunodeficiency virus type 1 protease and reverse transcriptase sequencing of plasma samples from heavily treated patients</article-title>
          <source>J. Clin. Microbiol.</source>
          <year>2001</year>
          <volume>39</volume>
          <fpage>1522</fpage>
          <lpage>1529</lpage>
          <pub-id pub-id-type="doi">10.1128/JCM.39.4.1522-1529.2001</pub-id>
        </citation>
      </ref>
      <ref id="B38-viruses-04-01212">
        <label>38.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Winters</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Holodniy</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Katzenstein</surname>
              <given-names>D.A.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>Quantitative RNA and DNA gene amplification can rapidly monitor HIV infection and antiviral activity in cell cultures</article-title>
          <source>PCR Methods Appl.</source>
          <year>1992</year>
          <volume>1</volume>
          <fpage>257</fpage>
          <lpage>262</lpage>
        <pub-id pub-id-type="doi">10.1101/gr.1.4.257</pub-id><pub-id pub-id-type="pmid">1477661</pub-id></citation>
      </ref>
      <ref id="B39-viruses-04-01212">
        <label>39.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Holodniy</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Katzenstein</surname>
              <given-names>D.A.</given-names>
            </name>
            <name>
              <surname>Sengupta</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Wang</surname>
              <given-names>A.M.</given-names>
            </name>
            <name>
              <surname>Casipit</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Schwartz</surname>
              <given-names>D.H.</given-names>
            </name>
            <name>
              <surname>Konrad</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Groves</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>Detection and quantification of human immunodeficiency virus RNA in patient serum by use of the polymerase chain reaction</article-title>
          <source>J. Infect. Dis.</source>
          <year>1991</year>
          <volume>163</volume>
          <fpage>862</fpage>
          <lpage>866</lpage>
        <pub-id pub-id-type="doi">10.1093/infdis/163.4.862</pub-id><pub-id pub-id-type="pmid">2010639</pub-id></citation>
      </ref>
      <ref id="B40-viruses-04-01212">
        <label>40.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Tang</surname>
              <given-names>M.W.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
          </person-group>
          <article-title>HIV-1 Antiretroviral resistance: Scientific principles and clinical applications</article-title>
          <source>Drugs</source>
          <year>2012</year>
          <volume>72</volume>
          <fpage>e1</fpage>
          <lpage>e25</lpage>
        <pub-id pub-id-type="pmid">22686620</pub-id></citation>
      </ref>
      <ref id="B41-viruses-04-01212">
        <label>41.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Melikian</surname>
              <given-names>G.L.</given-names>
            </name>
            <name>
              <surname>Rhee</surname>
              <given-names>S.Y.</given-names>
            </name>
            <name>
              <surname>Taylor</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Fessel</surname>
              <given-names>W.J.</given-names>
            </name>
            <name>
              <surname>Kaufman</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Towner</surname>
              <given-names>W.</given-names>
            </name>
            <name>
              <surname>Troia-Cancio</surname>
              <given-names>P.V.</given-names>
            </name>
            <name>
              <surname>Zolopa</surname>
              <given-names>A.</given-names>
            </name>
            <name>
              <surname>Robbins</surname>
              <given-names>G.K.</given-names>
            </name>
            <name>
              <surname>Kagan</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Israelski</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
          </person-group>
          <article-title>Standardized comparison of the relative impacts of HIV-1 reverse transcriptase (RT) mutations on nucleoside RT inhibitor susceptibility</article-title>
          <source>Antimicrob. Agents Chemother.</source>
          <year>2012</year>
          <volume>56</volume>
          <fpage>2305</fpage>
          <lpage>2313</lpage>
          <pub-id pub-id-type="doi">10.1128/AAC.05487-11</pub-id>
        </citation>
      </ref>
      <ref id="B42-viruses-04-01212">
        <label>42.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Palmer</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>Highly drug-resistant HIV-1 clinical isolates are cross-resistant to many antiretroviral compounds in current clinical development</article-title>
          <source>AIDS</source>
          <year>1999</year>
          <volume>13</volume>
          <fpage>661</fpage>
          <lpage>667</lpage>
        <pub-id pub-id-type="pmid">10397560</pub-id></citation>
      </ref>
      <ref id="B43-viruses-04-01212">
        <label>43.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Paxton</surname>
              <given-names>W.B.</given-names>
            </name>
            <name>
              <surname>Coombs</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>McElrath</surname>
              <given-names>M.J.</given-names>
            </name>
            <name>
              <surname>Keefer</surname>
              <given-names>M.C.</given-names>
            </name>
            <name>
              <surname>Hughes</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Sinangil</surname>
              <given-names>F.</given-names>
            </name>
            <name>
              <surname>Chernoff</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Demeter</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Williams</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Corey</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>Longitudinal analysis of quantitative virologic measures in human immunodeficiency virus-infected subjects with &gt; or = 400 CD4 lymphocytes: Implications for applying measurements to individual patients. National Institute of Allergy and Infectious Diseases AIDS Vaccine Evaluation Group</article-title>
          <source>J. Infect. Dis.</source>
          <year>1997</year>
          <volume>175</volume>
          <fpage>247</fpage>
          <lpage>254</lpage>
          <pub-id pub-id-type="doi">10.1093/infdis/175.2.247</pub-id>
        </citation>
      </ref>
      <ref id="B44-viruses-04-01212">
        <label>44.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Rizzo</surname>
              <given-names>R.C.</given-names>
            </name>
            <name>
              <surname>Tirado-Rives</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Jorgensen</surname>
              <given-names>W.L.</given-names>
            </name>
          </person-group>
          <article-title>Estimation of binding affinities for HEPT and nevirapine analogues with HIV-1 reverse transcriptase via Monte Carlo simulations</article-title>
          <source>J. Med. Chem.</source>
          <year>2001</year>
          <volume>44</volume>
          <fpage>145</fpage>
          <lpage>154</lpage>
          <pub-id pub-id-type="doi">10.1021/jm000255n</pub-id>
        </citation>
      </ref>
      <ref id="B45-viruses-04-01212">
        <label>45.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Delaugerre</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Gallien</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Flandre</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Mathez</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Amarsy</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Ferret</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Timsit</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Molina</surname>
              <given-names>J.M.</given-names>
            </name>
            <name>
              <surname>de Truchis</surname>
              <given-names>P.</given-names>
            </name>
          </person-group>
          <article-title>Impact of low-level-viremia on HIV-1 drug-resistance evolution among antiretroviral treated-patients</article-title>
          <source>PLoS One</source>
          <year>2012</year>
          <volume>7</volume>
          <pub-id pub-id-type="doi">10.1371/journal.pone.0036673</pub-id>
        </citation>
      </ref>
      <ref id="B46-viruses-04-01212">
        <label>46.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Messiaen</surname>
              <given-names>P.</given-names>
            </name>
            <name>
              <surname>Verhofstede</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Vandenbroucke</surname>
              <given-names>I.</given-names>
            </name>
            <name>
              <surname>Dinakis</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Van Eygen</surname>
              <given-names>V.</given-names>
            </name>
            <name>
              <surname>Thys</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Winters</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Aerssens</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Vogelaers</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Stuyver</surname>
              <given-names>L.J.</given-names>
            </name>
            <name>
              <surname>Vandekerckhove</surname>
              <given-names>L.</given-names>
            </name>
          </person-group>
          <article-title>Ultra-deep sequencing of HIV-1 reverse transcriptase before start of an NNRTI-based regimen in treatment-naive patients</article-title>
          <source>Virology</source>
          <year>2012</year>
          <volume>426</volume>
          <fpage>7</fpage>
          <lpage>11</lpage>
          <pub-id pub-id-type="doi">10.1016/j.virol.2012.01.002</pub-id>
        </citation>
      </ref>
      <ref id="B47-viruses-04-01212">
        <label>47.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Murry</surname>
              <given-names>J.P.</given-names>
            </name>
            <name>
              <surname>Higgins</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Matthews</surname>
              <given-names>T.B.</given-names>
            </name>
            <name>
              <surname>Huang</surname>
              <given-names>V.Y.</given-names>
            </name>
            <name>
              <surname>van Rompay</surname>
              <given-names>K.K.</given-names>
            </name>
            <name>
              <surname>Pedersen</surname>
              <given-names>N.C.</given-names>
            </name>
            <name>
              <surname>North</surname>
              <given-names>T.W.</given-names>
            </name>
          </person-group>
          <article-title>Reversion of the M184V mutation in simian immunodeficiency virus reverse transcriptase is selected by tenofovir, even in the presence of lamivudine</article-title>
          <source>J. Virol.</source>
          <year>2003</year>
          <volume>77</volume>
          <fpage>1120</fpage>
          <lpage>1130</lpage>
        <pub-id pub-id-type="doi">10.1128/JVI.77.2.1120-1130.2003</pub-id><pub-id pub-id-type="pmid">12502828</pub-id></citation>
      </ref>
      <ref id="B48-viruses-04-01212">
        <label>48.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Diallo</surname>
              <given-names>K.</given-names>
            </name>
            <name>
              <surname>Oliveira</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Moisi</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Brenner</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Wainberg</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Gotte</surname>
              <given-names>M.</given-names>
            </name>
          </person-group>
          <article-title>Pressure of zidovudine accelerates the reversion of lamivudine resistance-conferring M184V mutation in the reverse transcriptase of human immunodeficiency virus type 1</article-title>
          <source>Antimicrob. Agents Chemother.</source>
          <year>2002</year>
          <volume>46</volume>
          <fpage>2254</fpage>
          <lpage>2256</lpage>
          <pub-id pub-id-type="doi">10.1128/AAC.46.7.2254-2256.2002</pub-id>
        </citation>
      </ref>
      <ref id="B49-viruses-04-01212">
        <label>49.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
            <name>
              <surname>Bernard</surname>
              <given-names>L.C.</given-names>
            </name>
          </person-group>
          <article-title>3'-Azido-3'-deoxythymidine (AZT) and AZT-resistant reverse transcriptase can increase the <italic>in vivo</italic> mutation rate of human immunodeficiency virus type 1</article-title>
          <source>J. Virol.</source>
          <year>2000</year>
          <volume>74</volume>
          <fpage>9532</fpage>
          <lpage>9539</lpage>
          <pub-id pub-id-type="doi">10.1128/JVI.74.20.9532-9539.2000</pub-id>
        </citation>
      </ref>
      <ref id="B50-viruses-04-01212">
        <label>50.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Chen</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Yokoyama</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Sato</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Reilly</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Mansky</surname>
              <given-names>L.M.</given-names>
            </name>
          </person-group>
          <article-title>Human immunodeficiency virus mutagenesis during antiviral therapy: Impact of drug-resistant reverse transcriptase and nucleoside and nonnucleoside reverse transcriptase inhibitors on human immunodeficiency virus type 1 mutation frequencies</article-title>
          <source>J. Virol.</source>
          <year>2005</year>
          <volume>79</volume>
          <fpage>12045</fpage>
          <lpage>12057</lpage>
          <pub-id pub-id-type="doi">10.1128/JVI.79.18.12045-12057.2005</pub-id>
        </citation>
      </ref>
      <ref id="B51-viruses-04-01212">
        <label>51.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Opravil</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Klimkait</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Louvel</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Wolf</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Battegay</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Fux</surname>
              <given-names>C.A.</given-names>
            </name>
            <name>
              <surname>Bernasconi</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Vogel</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Speck</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Weber</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Prior therapy influences the efficacy of lamivudine monotherapy in patients with lamivudine-resistant HIV-1 infection</article-title>
          <source>J. Acquir. Immune Defic. Syndr. (1999)</source>
          <year>2010</year>
          <volume>54</volume>
          <fpage>51</fpage>
          <lpage>58</lpage>
        </citation>
      </ref>
      <ref id="B52-viruses-04-01212">
        <label>52.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Deeks</surname>
              <given-names>S.G.</given-names>
            </name>
            <name>
              <surname>Wrin</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Liegler</surname>
              <given-names>T.</given-names>
            </name>
            <name>
              <surname>Hoh</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Hayden</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Barbour</surname>
              <given-names>J.D.</given-names>
            </name>
            <name>
              <surname>Hellmann</surname>
              <given-names>N.S.</given-names>
            </name>
            <name>
              <surname>Petropoulos</surname>
              <given-names>C.J.</given-names>
            </name>
            <name>
              <surname>McCune</surname>
              <given-names>J.M.</given-names>
            </name>
            <name>
              <surname>Hellerstein</surname>
              <given-names>M.K.</given-names>
            </name>
            <name>
              <surname>Grant</surname>
              <given-names>R.M.</given-names>
            </name>
          </person-group>
          <article-title>Virologic and immunologic consequences of discontinuing combination antiretroviral-drug therapy in HIV-infected patients with detectable viremia</article-title>
          <source>N. Engl. J. Med.</source>
          <year>2001</year>
          <volume>344</volume>
          <fpage>472</fpage>
          <lpage>480</lpage>
        <pub-id pub-id-type="doi">10.1056/NEJM200102153440702</pub-id><pub-id pub-id-type="pmid">11172188</pub-id></citation>
      </ref>
      <ref id="B53-viruses-04-01212">
        <label>53.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Metzner</surname>
              <given-names>K.J.</given-names>
            </name>
            <name>
              <surname>Leemann</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>di Giallonardo</surname>
              <given-names>F.</given-names>
            </name>
            <name>
              <surname>Grube</surname>
              <given-names>C.</given-names>
            </name>
            <name>
              <surname>Scherrer</surname>
              <given-names>A.U.</given-names>
            </name>
            <name>
              <surname>Braun</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Kuster</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Weber</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Guenthard</surname>
              <given-names>H.F.</given-names>
            </name>
          </person-group>
          <article-title>Reappearance of minority K103N HIV-1 variants after interruption of ART initiated during primary HIV-1 infection</article-title>
          <source>PLoS One</source>
          <year>2011</year>
          <volume>6</volume>
          <pub-id pub-id-type="doi">10.1371/journal.pone.0021734</pub-id>
        </citation>
      </ref>
      <ref id="B54-viruses-04-01212">
        <label>54.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Paquet</surname>
              <given-names>A.C.</given-names>
            </name>
            <name>
              <surname>Baxter</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Weidler</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Lie</surname>
              <given-names>Y.</given-names>
            </name>
            <name>
              <surname>Lawrence</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Kim</surname>
              <given-names>R.</given-names>
            </name>
            <name>
              <surname>Bates</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Coakley</surname>
              <given-names>E.</given-names>
            </name>
            <name>
              <surname>Chappey</surname>
              <given-names>C.</given-names>
            </name>
          </person-group>
          <article-title>Differences in reversion of resistance mutations to wild-type under structured treatment interruption and related increase in replication capacity</article-title>
          <source>PLoS One</source>
          <year>2011</year>
          <volume>6</volume>
          <pub-id pub-id-type="doi">10.1371/journal.pone.0014638</pub-id>
        </citation>
      </ref>
      <ref id="B55-viruses-04-01212">
        <label>55.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Campbell</surname>
              <given-names>T.B.</given-names>
            </name>
            <name>
              <surname>Shulman</surname>
              <given-names>N.S.</given-names>
            </name>
            <name>
              <surname>Johnson</surname>
              <given-names>S.C.</given-names>
            </name>
            <name>
              <surname>Zolopa</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Young</surname>
              <given-names>R.K.</given-names>
            </name>
            <name>
              <surname>Bushman</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Fletcher</surname>
              <given-names>C.V.</given-names>
            </name>
            <name>
              <surname>Lanier</surname>
              <given-names>E.R.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
            <name>
              <surname>Kuritzkes</surname>
              <given-names>D.R.</given-names>
            </name>
          </person-group>
          <article-title>Antiviral activity of lamivudine in salvage therapy for multidrug-resistant HIV-1 infection</article-title>
          <source>Clin. Infect. Dis.</source>
          <year>2005</year>
          <volume>41</volume>
          <fpage>236</fpage>
          <lpage>242</lpage>
        <pub-id pub-id-type="doi">10.1086/430709</pub-id><pub-id pub-id-type="pmid">15983922</pub-id></citation>
      </ref>
      <ref id="B56-viruses-04-01212">
        <label>56.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Lecossier</surname>
              <given-names>D.</given-names>
            </name>
            <name>
              <surname>Shulman</surname>
              <given-names>N.S.</given-names>
            </name>
            <name>
              <surname>Morand-Joubert</surname>
              <given-names>L.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>Joly</surname>
              <given-names>V.</given-names>
            </name>
            <name>
              <surname>Zolopa</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Clavel</surname>
              <given-names>F.</given-names>
            </name>
            <name>
              <surname>Hance</surname>
              <given-names>A.J.</given-names>
            </name>
          </person-group>
          <article-title>Detection of minority populations of HIV-1 expressing the K103N resistance mutation in patients failing nevirapine</article-title>
          <source>J. Acquir. Immune Defic. Syndr. (1999)</source>
          <year>2005</year>
          <volume>38</volume>
          <fpage>37</fpage>
          <lpage>42</lpage>
          <pub-id pub-id-type="doi">10.1097/00126334-200501010-00007</pub-id>
        </citation>
      </ref>
      <ref id="B57-viruses-04-01212">
        <label>57.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Shulman</surname>
              <given-names>N.S.</given-names>
            </name>
            <name>
              <surname>Zolopa</surname>
              <given-names>A.R.</given-names>
            </name>
            <name>
              <surname>Passaro</surname>
              <given-names>D.J.</given-names>
            </name>
            <name>
              <surname>Murlidharan</surname>
              <given-names>U.</given-names>
            </name>
            <name>
              <surname>Israelski</surname>
              <given-names>D.M.</given-names>
            </name>
            <name>
              <surname>Brosgart</surname>
              <given-names>C.L.</given-names>
            </name>
            <name>
              <surname>Miller</surname>
              <given-names>M.D.</given-names>
            </name>
            <name>
              <surname>Van Doren</surname>
              <given-names>S.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>Katzenstein</surname>
              <given-names>D.A.</given-names>
            </name>
          </person-group>
          <article-title>Efavirenz- and adefovir dipivoxil-based salvage therapy in highly treatment-experienced patients: Clinical and genotypic predictors of virologic response</article-title>
          <source>J. Acquir. Immune Defic. Syndr. (1999)</source>
          <year>2000</year>
          <volume>23</volume>
          <fpage>221</fpage>
          <lpage>226</lpage>
        </citation>
      </ref>
      <ref id="B58-viruses-04-01212">
        <label>58.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Winters</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Schapiro</surname>
              <given-names>J.M.</given-names>
            </name>
            <name>
              <surname>Lawrence</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>Human immunodeficiency virus type 1 protease genotypes and <italic>in vitro</italic> protease inhibitor susceptibilities of isolates from individuals who were switched to other protease inhibitors after long-term saquinavir treatment</article-title>
          <source>J. Virol.</source>
          <year>1998</year>
          <volume>72</volume>
          <fpage>5303</fpage>
          <lpage>5306</lpage>
        <pub-id pub-id-type="pmid">9573309</pub-id></citation>
      </ref>
      <ref id="B59-viruses-04-01212">
        <label>59.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Nijhuis</surname>
              <given-names>M.</given-names>
            </name>
            <name>
              <surname>Boucher</surname>
              <given-names>C.A.</given-names>
            </name>
            <name>
              <surname>Schuurman</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <article-title>Sensitive procedure for the amplification of HIV-1 RNA using a combined reverse-transcription and amplification reaction</article-title>
          <source>Biotechniques</source>
          <year>1995</year>
          <volume>19</volume>
          <fpage>178</fpage>
          <lpage>182</lpage>
          <page-range>178–180, 182</page-range>
        <pub-id pub-id-type="pmid">8527130</pub-id></citation>
      </ref>
      <ref id="B60-viruses-04-01212">
        <label>60.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Schapiro</surname>
              <given-names>J.M.</given-names>
            </name>
            <name>
              <surname>Winters</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Stewart</surname>
              <given-names>F.</given-names>
            </name>
            <name>
              <surname>Efron</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Norris</surname>
              <given-names>J.</given-names>
            </name>
            <name>
              <surname>Kozal</surname>
              <given-names>M.J.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>The effect of high-dose saquinavir on viral load and CD4+ T-cell counts in HIV-infected patients</article-title>
          <source>Ann. Internal Med.</source>
          <year>1996</year>
          <volume>124</volume>
          <fpage>1039</fpage>
          <lpage>1050</lpage>
        </citation>
      </ref>
      <ref id="B61-viruses-04-01212">
        <label>61.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Winters</surname>
              <given-names>M.A.</given-names>
            </name>
            <name>
              <surname>Coolley</surname>
              <given-names>K.L.</given-names>
            </name>
            <name>
              <surname>Girard</surname>
              <given-names>Y.A.</given-names>
            </name>
            <name>
              <surname>Levee</surname>
              <given-names>D.J.</given-names>
            </name>
            <name>
              <surname>Hamdan</surname>
              <given-names>H.</given-names>
            </name>
            <name>
              <surname>Shafer</surname>
              <given-names>R.W.</given-names>
            </name>
            <name>
              <surname>Katzenstein</surname>
              <given-names>D.A.</given-names>
            </name>
            <name>
              <surname>Merigan</surname>
              <given-names>T.C.</given-names>
            </name>
          </person-group>
          <article-title>A 6-basepair insert in the reverse transcriptase gene of human immunodeficiency virus type 1 confers resistance to multiple nucleoside inhibitors</article-title>
          <source>J. Clin. Invest.</source>
          <year>1998</year>
          <volume>102</volume>
          <fpage>1769</fpage>
          <lpage>1775</lpage>
          <pub-id pub-id-type="doi">10.1172/JCI4948</pub-id>
        </citation>
      </ref>
      <ref id="B62-viruses-04-01212">
        <label>62.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Efron</surname>
              <given-names>B.</given-names>
            </name>
            <name>
              <surname>Tibshirani</surname>
              <given-names>R.J.</given-names>
            </name>
          </person-group>
          <source>An Introduction to the Bootstrap</source>
          <publisher-name>Chapman &amp; Hall/CRC</publisher-name>
          <publisher-loc>New York, NY, USA</publisher-loc>
          <year>1993</year>
          <volume>57</volume>
        </citation>
      </ref>
      <ref id="B63-viruses-04-01212">
        <label>63.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Rice</surname>
              <given-names>J.A.</given-names>
            </name>
          </person-group>
          <source>Mathematical Statistics and Data Analysis</source>
          <edition>3rd</edition>
          <publisher-name>Thompson Higher Education</publisher-name>
          <publisher-loc>Belmont, CA, USA</publisher-loc>
          <year>2006</year>
        </citation>
      </ref>
      <ref id="B64-viruses-04-01212">
        <label>64.</label>
        <citation citation-type="journal">
          <person-group person-group-type="author">
            <name>
              <surname>Raikov</surname>
              <given-names>D.</given-names>
            </name>
          </person-group>
          <article-title>On the decomposition of Gauss and Poisson laws (in Russian)</article-title>
          <source>Izv. Ross. Akad. Nauk. Ser. Mat.</source>
          <year>1938</year>
          <volume>2</volume>
          <fpage>91</fpage>
          <lpage>124</lpage>
        </citation>
      </ref>
      <ref id="B65-viruses-04-01212">
        <label>65.</label>
        <citation citation-type="book">
          <person-group person-group-type="author">
            <name>
              <surname>Fisher</surname>
              <given-names>R.</given-names>
            </name>
          </person-group>
          <source>Statistical Methods for Research Workers</source>
          <edition>19th</edition>
          <publisher-name>Oliver and Boyd</publisher-name>
          <publisher-loc>Edinburgh, Scotland, UK</publisher-loc>
          <year>1963</year>
        </citation>
      </ref>
    </ref-list>
  </back>
</article>
