- freely available
Int. J. Mol. Sci. 2013, 14(7), 12970-12977; doi:10.3390/ijms140712970
Published: 24 June 2013
Abstract: Galactomannan (GM) is widely used for detection of invasive aspergillosis in high-risk haemato-oncology patients. Recent publications have reported a lack of repeatability of GM detection. The objective of this retrospective study was to assess the repeatability of GM levels during storage of clinical samples. In a GM screening strategy, positive sera were repeat tested as per manufacturer’s recommendations. Short-term (ST) storage of samples was at +4 °C while long-term (LT) storage was at −80 °C. Bronchoalveolar (BAL) fluid was also repeating tested after ST storage and LT storage. Wilcoxon Signed Ranks Test was employed to assess the repeatability of GM levels. In a subset of 14 GM positive sera, repeat testing was performed on both the original serum and ethylenediaminetetraacetic acid (EDTA) pre-treated sample. There was a significant reduction in GM signals on repeat testing following ST storage (median GM index: 0.65 vs. 0.19; p < 0.001) and LT storage (median GM index: 0.56 vs. 0.10; p < 0.001) of serum samples. Of samples that were initially GM positive, an average GM index reduction of 50% was seen, with approximately two-thirds becoming GM negative on repeat testing of the same sample. In contrast, GM signal loss was not seen on repeat testing of BAL fluid following ST or LT storage. When GM positive serum samples were repeat tested using EDTA pre-treated serum from the first step of the testing protocol, all samples remained GM positive. In contrast, when the same samples were repeat tested from the original collected serum, 9 samples (64%) became GM negative. The significant reduction in GM signals during ST and LT storage of serum samples has implications for clinical management. Although the reasons for GM decline are unknown, they occur prior to the EDTA pre-treatment stage, indicating that the time from phlebotomy to testing should be minimized. BAL fluid GM index values remain stable.
Invasive pulmonary aspergillosis (IA) remains a life-threatening opportunistic invasive mycosis in immunocompromised patients . The Platelia Aspergillus enzyme immunoassay (PA-EIA, Bio Rad, Marnes-la-Coquette, France) provides non-invasive, quantitative Aspergillus-specific detection and is widely used to detect serum galactomannan (GM) . There is little information on the repeatability of GM Index results on repeat testing of the same sample after a period of sample storage. One study retrospectively evaluated GM concentrations in stored serum after a period of four years, reporting a lower reactivity in 20% of samples on retesting . However, analysis of “real-time” results has also demonstrated significant between-run variability when testing is repeated on the same sample , underlying the importance of corroborating a positive result by retesting of the same sample. Two recently published articles have reported a lack of intra-laboratory repeatability with the PA-EIA test for GM detection. Oren et al. report a lack of repeatability when GM positive samples are retested within six days , with lower values in 29/34 (85%) repeats. Bizzini et al.  report a similar reduction in reactivity of samples on retesting of positive samples within three days, with lower values in 23/29 (79%) repeats. These observations raise doubts about the interpretation of data from frozen/thawed samples, as well as samples tested in “real-time” for patient management. The aim of this retrospective study was to clarify the effects of sample storage on the repeatability of GM levels using the PA-EIA.
2. Results and Discussion
2.1. Sample Results (Scatter Plot)
Figure 1 shows that there was a clear loss of GM signal in both the short-term (ST) and long-term (LT) serum, with the signal loss more apparent in the plot including only the first sample taken from each patient (Figure 1A) than in the plot including all serum data (Figure 1B). Repeated samples from the same patient may mask the loss of signal in both ST and LT stored sera. Loss of GM signal was higher in LT than ST stored samples. BAL fluid samples did not show GM signal loss following either in ST or LT storage (Figure 1C). Note that the removal of the two outlier values from Figure 1A,C does not change the shape of the relationships significantly.
2.1.1. Hypothesis Testing
Serum samples (without repetition): The Wilcoxon Signed Rank Sum Test applied to the first sample from each patient, showed statistically significant reductions in GM signals both in the ST storage (n = 65, median GM1 index: 0.65, median GM2 index: 0.19; p < 0.001) and in the LT storage (n = 35, median GM1 index: 0.56, median GM2 index: 0.10; p < 0.001), as shown in Table 1. In total, 44/65 (68%) ST and 31/35 (89%) LT serum samples showed a reduction in GM signal upon repeat testing.
In the ST serum group, 65.2% of samples that were initially GM positive became GM negative on repeat testing; with an average GM signal reduction of 50.2% in samples that were initially GM positive. In the LT serum storage group, 67.9% of GM positive samples became GM negative on repeat testing; with an average GM signal reduction of 49.3%.
To ascertain the stage at which GM signal loss occurred, repeat testing in a subset of GM positive samples (n = 14) was performed following ST storage from the original serum sample or using the EDTA pre-treated sample. All EDTA pre-treated samples remained positive. In contrast 9/14 (64%) of repeats from the original serum sample became negative.
2.1.2. Assay Repeatability
The repeatability of the OD of the threshold control run in duplicate over 40 randomly selected assays is shown in Figure 2. The duplicate values of the OD were repeatable as most of them are close to the line of equality and all measurements were within the recommended limits (OD 0.3–0.8). The mean OD of the 40 threshold control measurements was 0.49, with range 0.33–0.69. The coefficient of variation for duplicate measures was 7.09, which confirms repeatability.
The international EORTC/MSG (European Organization for Research and Treatment of Cancer/Invasive Fungal Infections Cooperation Group and the National Institute of Allergy and Infectious Diseases Mycoses Study Group) mycological criteria for diagnosing IA  include serum and BAL fluid GM results as key diagnostic criteria. These are routinely obtained using the PA-EIA, which provides non-invasive, quantitative Aspergillus-specific detection for serum GM. Recent reports have raised concerns with regard to the repeatability of GM levels. This report confirms these doubts and broadens these findings by establishing a lack of repeatability of serum GM testing of the same sample. A clinically significant reduction in GM reactivity was recorded, with two thirds of GM positive sera becoming negative following ST or LT storage. This phenomenon was not seen with repeat GM testing of BAL fluid following ST or LT storage. We have published our rate of invasive fungal disease (IFD) using the EORTC/MSG criteria of probable/proven IFD, which are usually regarded as representing true cases, as only 8/589 episodes (1.4%) by 2008 and 20/589 (3.5%) by 2002 criteria . It has been previously reported by Furfaro et al.  that the decrease in GM values after retesting was much more pronounced in those samples with initially false positive GM results. Clearly, in our practice, the phenomenon of GM signal loss cannot be correlated to the EORTC/MSG criteria of IFD given the much higher frequency GM signal loss in both ST and LT data sets.
The OD value of the threshold control is critical in the calculation of the GM index value of clinical samples. Repeatability of the OD of the threshold control was confirmed by the CV for duplicate measures. These data indicate that technical issues per se cannot explain the observed GM signal loss in clinical samples. Furthermore, extensive review of the technical performance of the assay by different operators was undertaken, in conjunction with Bio-Rad, including monitoring of heating block temperature and plate washer performance. No concerns were identified. Although environmental contamination is a risk during testing, our data are not consistent with contamination, which would lead to random increases or decreases with repeat testing. In contrast, the presented data show a consistent pattern of signal loss, with the first reading being higher than the repeat. In addition, sporadic repeat testing of GM negative serum samples never gave a positive result.
The repeatability of the OD of the threshold control suggests that the observed GM signal loss was specific to clinical serum samples. Interestingly, following ST storage of sera, the GM signal loss was not seen if the repeat was performed using EDTA pre-treated samples from the first step of the testing protocol, all of which remained positive. Although the mechanisms of GM decline in clinical serum samples are unclear, they appear to occur in the original serum sample prior to the EDTA pre-treatment stage. The data does not allow us to specify an acceptable storage time without major signal loss, but we can conclude that serum signal loss is associated with storage, and that it is therefore important to minimise the time from phlebotomy to the EDTA stage of processing. Further work needs to be done to determine whether short term storage without major signal loss is possible. The focus of our further investigations is on the stability of in vivo serum GM versus purified control GM, the impact of potential enzymatic epitope degradation/masking, as well as the correlation with any prescribed anti-microbial agents and other intravenous drugs.
3. Experimental Section
3.1. Clinical Samples
Serum and broncho-alveolar lavage (BAL) fluid samples were collected from patients in the Division of Haemato-Oncology at St Bartholomew’s Hospital undergoing serum GM monitoring in a screening strategy throughout their episode of intensive chemotherapy. Samples were sent, and GM detection was performed by PA-EIA, twice weekly. Techniques were carried out as recommended by the manufacturer. Results were expressed as a GM index value—The ratio of the sample optical density (OD) divided by the mean OD of the 2 threshold controls. Serum samples were scored as positive if the GM index was >0.5. In our institution, it is routine practice to confirm a positive result (GM1) by repeat testing (GM2) from the original sample, as recommended by the manufacturer. For GM negative serum samples, repeat testing was sporadically performed for performance analysis.
Short-term (ST) storage at +4 °C: Microbiology laboratory records from February 2009 to March 2010 were filtered to exclude GM data (i) for non-serum samples and (ii) samples repeat-tested after greater than 48hours. A total of 109 serum samples (from 65 different patients) and 8 BAL fluid samples were identified.
Long-term (LT) storage at −80 °C: A total of 54 serum samples (from 35 different patients) and 12 BAL fluid samples were collected from July 2005 to September 2007, GM tested and sample aliquots were stored at −80 °C. These samples were repeat tested after 2–4 years storage at −80 °C in 2009. In total, 183 clinical samples were included in this study.
3.2. Analysis of Clinical Data
Data from serum testing are presented on a scatter plot, with fractional polynomial regression lines for each storage type. As the relationship between the two test results was found not to be linear, fractional polynomial regression was the best choice to capture the exact relationship between them. Due to routine twice-weekly screening of high-risk patients, more than one sample was collected for most of the patients. As first and second test values are likely to be correlated, the Wilcoxon Signed Rank Sum Test was used to test the GM signal loss both in the ST as well as LT serum samples based on the first sample taken from each patient. Probability values <0.05 were defined as significant based on a 2-tailed test. All calculations were carried out using the statistical software package Intercooled STATA 10.1 (Stat Corp, College Station, TX, USA, 2008).
3.3. Assay Repeatability
In order to determine the intra- and inter-assay variability, the OD value of the threshold control, loaded in duplicate, was recorded for 40 randomly selected assay runs. The mean OD was calculated, together with range. Inter-assay repeatability of the threshold control was calculated by using the Jones and Payne  coefficient of variation (CV) for duplicate measures.
These observations suggest that: (i) caution should be exercised when testing serum samples after a period of storage, including samples stored at −80 °C; (ii) the interpretation of GM negative results obtained after delays in processing may be problematic; (iii) careful coordination is required between the laboratory and clinical teams to minimise the time from sampling to testing; (iv) a better understanding of GM kinetics is necessary to address the impact of sample processing and storage times on detectable GM concentrations. Furthermore, given a wide range of sensitivity and specificity data plus multiple causes of false-positive results for the PA-EIA reported in the literature, a prudent approach to clinical utilization of GM testing would be to combine the PA-EIA with other markers of Aspergillus in a diagnostic algorithm [11,12].
This work was supported by a Barts and the London Charity Grant (Grant Reference Number: 463/1317) and grants from Pfizer, Gilead, Schering-Plough and MSD. The salary of G Johnson was entirely funded from the Barts and the London Charity Grant. All other companies funded non-salary costs. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript. Shah-Jalal Sarker is a lecturer in Cancer Biostatistics and performed all statistical analyses.
The authors would like to thank Edel Brosnan and Kaveri Gupta for their assistance in data retrieval.
Conflict of Interest
S Agrawal has received honoraria for consultancy work and lectures and unrestricted educational grants from Pfizer, Gilead, Schering-Plough, MSD and Bio Rad. G Johnson has received funding from Pfizer for attendance at conferences. G Johnson has received funding for non-salary study costs from Pfizer, Gilead, Schering-Plough and MSD. All other authors: No conflict.
- Kuderer, N.M.; Dale, D.C.; Crawford, J.; Cosler, L.E.; Lyman, G.H. Mortality, morbidity, and cost associated with febrile neutropenia in adult cancer patients. Cancer 2006, 106, 2258–2266. [Google Scholar]
- Wheat, L.J.; Walsh, T.J. Diagnosis of invasive aspergillosis by galactomannan antigenemia detection using an enzyme immunoassay. Eur. J. Clin. Microbiol. Infect. Dis 2008, 27, 245–251. [Google Scholar]
- Pereira, C.N.; del Nero, G.; Lacaz, C.S.; Machado, C.M. The contribution of galactomannan detection in the diagnosis of invasive aspergillosis in bone marrow transplant recipients. Mycopathologia 2005, 159, 487–493. [Google Scholar]
- Upton, A.; Gugel, A.; Leisenring, W.; Limaye, A.; Alexander, Barbara; Hayden, R.; Marr, K.A. Reproducibility of low galactomannan enzyme immunoassay index values tested in multiple laboratories. J. Clin. Microbiol. 2005, 43, 4796–4800. [Google Scholar]
- Oren, I.; Avidor, I.; Sprecher, H. Lack of intra-laboratory reproducibility in using Platelia Aspergillus enzyme immunoassay test for detection of Aspergillus galactomannan antigen. Transplant Infect Dis 2012, 14, 107–109. [Google Scholar]
- Bizzini, A.; Marchetti, O.; Meylan, P. Response to: Lack of intra-laboratory reproducibility in using Platelia Aspergillus enzyme immunoassay test for detection of Aspergillus galactomannan antigen. Transplant Infect. Dis 2012, 14, 218–219. [Google Scholar]
- De Pauw, B.; Walsh, T.J.; Donnelly, J.P.; Stevens, D.A.; Edwards, J.E.; Calandra, T.; Pappas, P.G.; Maertens, J.; Lortholary, O.; Kauffman, C.A.; et al. Revised definitions of invasive fungal disease from the european organization for research and treatment of cancer/invasive fungal infections cooperative group and the national institute of allergy and infectious diseases mycoses study group (eortc/msg) consensus group. Clin. Infect. Dis 2008, 46, 1813–1821. [Google Scholar]
- Tsitsikas, D.A.; Morin, A.; Araf, S.; Murtagh, B.; Johnson, G.; Vinnicombe, S.; Ellis, S.; Suaris, T.; Wilks, M.; Doffman, S.; et al. Impact of the revised. EORTC/MSG definitions for invasive fungal disease on the rates of diagnosis of invasive aspergillosis. Med. Mycol.. [CrossRef]
- Furfaro, E.; Mikulska, M.; Miletich, F.; Viscoli, C. Galactomannan: Testing the same sample twice? Transpl. Infect. Dis 2012, 14, E38–E39. [Google Scholar]
- Jones, R.; Payne, B. Clinical investigation and statistics in laboratory medicine. Am. Assoc. Clin. Chem 1997, 90, 41–42. [Google Scholar]
- Agrawal, S.; Hope, W.; Sinkó, J.; Kibbler, C. Optimizing management of invasive mould diseases. J. Antimicrob. Chemother 2011, 66, i45–i53. [Google Scholar]
- Johnson, G.L.; Bibby, D.F.; Wong, S.; Agrawal, S.G.; Bustin, S.A. A MIQE-compliant real-time PCR assay for Aspergillus detection. PLoS One 2012, 7, e40022. [Google Scholar]
|Table 1. Results of the Wilcoxon Signed Rank Sum Test.|
|Sample size||Samples with GM reduction||Median GM1 index||Median GM2 index||p-value|
© 2013 by the authors; licensee MDPI, Basel, Switzerland This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution license (http://creativecommons.org/licenses/by/3.0/).