1. Introduction
Chronic myeloid leukemia (CML) accounts for approximately 15% of all leukemia cases. It is characterized by the presence of the Philadelphia chromosome that arises from a reciprocal translocation between chromosomes 9 and 22 [t(9;22)] and generates the
BCR::ABL1 fusion gene [
1]. This gene fusion typically involves
BCR exon 13 or 14 and
ABL1 exon 2, giving rise to the e13a2 (38%) and e14a2 (62%) transcripts, respectively. These transcripts encode the p210 protein, which exhibits constitutively active tyrosine kinase activity. Less commonly, alternative fusion transcripts such as e1a2 and e19a2 are detected, leading to the production of p190 and p230 proteins, respectively. These variants are observed in approximately 2% of CML cases, including during blast phase progression [
2].
Quantification of
BCR::ABL1 transcript levels in peripheral blood is the gold standard for managing CML patients undergoing tyrosine kinase inhibitor (TKI) therapy. Reverse transcription quantitative polymerase chain reaction (RT-qPCR), calibrated to the World Health Organization (WHO) International Standard, is the preferred method for monitoring the response to TKIs. Molecular monitoring is recommended at least every three months until major molecular remission (MMR) is reached and confirmed. Once stable MMR or deeper molecular responses are achieved, testing can be performed at intervals of four to six months. More frequent assessments are warranted if transcript levels show variability or increase, or when evaluating eligibility for treatment discontinuation and during subsequent follow-up in selected patients [
3].
PCR assays with a sensitivity of at least a 4.5 log reduction from baseline are recommended for accurately measuring
BCR::ABL1 transcript levels. A standardized RT-qPCR protocol includes high-quality RNA extraction and optimization, followed by reverse transcription to cDNA and subsequent amplification, detection, and accurate quantification [
4,
5]. Although highly sensitive and reliable, this multi-step process is time consuming and technically demanding, with potential sources of error and variability at each stage, from RNA extraction to data interpretation. These challenges highlight the need for more streamlined approaches that maintain analytical accuracy while reducing complexity.
Xpert
® BCR-ABL Ultra (Cepheid, Sunnyvale, CA, USA) is an in vitro diagnostic test for the quantification of
BCR::ABL1 and
ABL1 mRNA transcripts in peripheral blood specimens of diagnosed t(9;22) positive CML patients. The Xpert
® BCR-ABL Ultra test is based on a single-use cartridge system that fully automates the quantitative process, integrating RNA extraction, reverse transcription, amplification, and detection within a closed system in under three hours. This innovative approach simplifies the workflow and minimizes the risk of contamination [
6], making Xpert
® BCR-ABL Ultra a robust, rapid, and efficient tool for molecular diagnostics.
Over the past 15 years, substantial efforts have been made worldwide to harmonize molecular methods for
BCR::ABL1 quantification, particularly through the development and implementation of the International Scale (IS), which enables consistent interpretation of molecular responses across laboratories. A fundamental component of this harmonization process was the introduction of laboratory-specific conversion factors (CFs), developed to align individual assay results with the IS and minimize inter-laboratory variability [
7]. In this context, Dominy et al. demonstrated that the Xpert
® BCR-ABL Ultra test is effective in confirming laboratory-specific CFs for molecular response (MR) monitoring, offering a rapid and reliable approach to assess assay performance and ensure result comparability [
8].
Building on this evidence, our study broadens the validation of Xpert® BCR-ABL Ultra by comparing it across four different methods in a multi-center Italian setting, using real-world patient samples, external quality controls, and stability testing to reflect routine clinical practice. By focusing on multiple centers and real-world applicability, this work advances beyond prior validations, providing robust evidence of assay performance under different conditions. The four laboratories participating in the study are part of the Italian national laboratory network for CML, which drafts and distributes the R.I.L. (Recommendations and Laboratory Indications) and ensures that participating centers report results according to the International Scale (IS) through yearly External Quality Assessment (EQA) rounds, thereby maintaining method standardization. Within this framework, introducing new tools capable of improving laboratory performance remains a key area of research and technical development.
The Xpert
® system thus represents a standardized and automated alternative that could reduce inter-laboratory variability and improve clinical decision-making through accurate molecular monitoring. To assess its performance, we compared Xpert
® BCR-ABL Ultra with established RT-qPCR reference methods using EUTOS criteria [
9], evaluated the stability of its results on blood samples that were analyzed immediately and 24 h after collection, and tested its accuracy and reliability using two external quality control materials. Offering a fast, automated, and standardized approach, the Xpert
® system has the potential to enhance the reliability and efficiency of molecular monitoring in routine clinical practice.
3. Discussion
The main objective of this study was to demonstrate that the Xpert® BCR-ABL Ultra assay produces results consistent with those obtained using methods routinely employed in highly specialized laboratories.
We compared different approaches using 129 leftover peripheral blood samples from CML patients with varying
BCR::ABL1/ABL1 transcript levels, ranging from undetectable to 10%. Measurements were performed simultaneously in four Italian laboratories using Xpert
® BCR-ABL Ultra on the GeneXpert
® System and analyzed with the GeneXpert
® software. These data were then compared with results obtained using the methods recommended in the R.I.L. (Recommendations and Laboratory Indications) published and disseminated by the Italian national laboratory network for CML. The results, derived from data stratified by method and molecular response (MR) class, showed good repeatability for both the local and Cepheid methods. Specifically, the coefficient of variation (CV) for nearly all measurements was below 1 (
Table 1), indicating low variability across replicates. Furthermore, the coefficient of repeatability was small relative to mean measurement values for nearly all sample groups. These findings suggest that variability between repeated measurements is minimal, allowing us to use the mean of replicates as a reliable representative value for subsequent method comparisons.
Acceptable concordance is defined by meeting at least two out of the three EUTOS criteria [
9]: at least 50% of samples within a 2-fold range, at least 75% within a 3-fold range, and at least 90% within a 5-fold range. In this study, the two methods can be considered concordant as all three EUTOS criteria were satisfied. Furthermore, a more detailed analysis showed that the three EUTOS criteria were also met within each individual laboratory, with the exception of the first criterion in lab #4 (
Table 2).
The Bland–Altman analysis, stratified by MR (
Table 3), showed that, as expected, the variability of differences was not uniform across the measurement ranges used to define MR. Greater bias and wider limits of agreement were observed in MR
1 and MR
2, which correspond to
BCR::ABL1%IS values above 0.1%. These classes are typically grouped and reported as <MR
3, reflecting a high disease burden. In this case, fine measurement precision is not clinically critical. In contrast, from MR
4 onwards—corresponding to
BCR::ABL1%IS values of ≤0.01%—the need for analytical precision becomes increasingly important [
11]. In these categories, particularly MR
4.5 and MR
5 (≤0.0032% and ≤0.001%, respectively), both bias and variability were minimal. The 95% limits of agreement did not exceed 0.01% for MR
4 and 0.0032% for MR
4.5 and MR
5. These findings demonstrate a strong agreement between the two methods at deep molecular response levels, where analytical sensitivity and precision are essential for reliable clinical decision-making [
12].
Given the clinical and prognostic importance of accurate MR assessment for patient management, we further analyzed the concordance between the Cepheid and local methods in assigning MR values to the analyzed samples. This comparison was conducted using two distinct calculation approaches.
The MR values obtained by applying the European LeukemiaNet (ELN) recommendations [
4] showed varying degrees of concordance when samples were stratified by MR class, with lower concordance observed for MR
3 and MR
4. Overall concordance was 71.3%. MR values assigned by the Xpert
® BCR-ABL Ultra assay tended to be higher than those obtained using local methods (
Table 4). In the 36 discordant cases, where local MR values were lower than those obtained with Xpert
® BCR-ABL Ultra, the discrepancy is most likely attributable to methodological differences rather than a genuine difference in analytical sensitivity. A key contributor may be differences in
ABL1 quantification, which tend to produce systematically higher MR values with the Cepheid method. In some cases, this resulted in samples being classified just above clinically relevant thresholds such as MR
3, potentially affecting treatment response categorization under ELN guidelines. This underscores the need for consistent methodology when MR values are near decision boundaries, and for further investigation into the clinical relevance of MR values obtained by applying ELN criteria to Cepheid results. Such an approach differs from the assay’s intended design, which generates MR values through an automated mathematical calculation within the instrument.
A second approach for evaluating MR concordance involved assigning molecular response values using the Cepheid-based calculation. The resulting MR values were grouped into four predefined categories: <MR
3, MR
3–3.99, MR
4–4.49, and >MR
4.5. Results were considered concordant when the difference between the MR values calculated using the local method and those obtained with Xpert
® BCR-ABL Ultra did not exceed 0.5 log. Compared with the analysis based on ELN guidelines, this approach yielded equal or higher concordance rates in most categories, with a particularly notable improvement in the MR
4–4.49 range (from 33.3% to 96.3%). Overall concordance rose from 71.3% to 89.9%, and most discordant MR values were higher when measured using the Cepheid method (
Table 5).
The Xpert® BCR-ABL Ultra assay does not report the ABL1 copy number in its output. Rather, it only provides a result if the ABL1 copy number exceeds 32,000. Consequently, if ELN recommendations are strictly applied, no sample analyzed with the Cepheid method can technically be classified as MR5, as the guidelines require more than 100,000 ABL1 copies to confirm this level. It should be noted, however, that the Cepheid method does quantify the ABL1 copy number, and this value directly influences the reported BCR::ABL1%IS and the calculated MR value. Therefore, when MR is calculated using the formula implemented by the Xpert® BCR-ABL Ultra assay, higher MR values can be achieved, and concordance with local methods is substantially improved.
The results of the measurements performed on external quality control materials using the Xpert
® BCR-ABL Ultra assay (Cepheid method) are consistent with the reference values provided by the manufacturer (
Supplementary Table S2). Although further statistical analyses were limited due to the small dataset, these findings support the suitability of the Xpert
® BCR-ABL Ultra assay for use in external quality control rounds.
To simulate real-world conditions, we assessed the stability of the test results 24 h after sample collection. The analysis of 51 samples that were tested immediately and again after 24 h demonstrated overall excellent stability. Concordance across different storage conditions—whole blood at room temperature (RT) or 4 °C, and lysate at −20 °C—indicates that these conditions did not meaningfully affect the results (
Supplementary Table S1). The largest deviation was observed in samples stored at RT, which is the condition most prone to RNA degradation. Despite the limited sample size and the need for further confirmation, these results support the robustness of the Xpert
® BCR-ABL Ultra assay, making it suitable for integration into typical clinical laboratory workflows where processing delays beyond 24 h from collection may occasionally occur. Furthermore, all healthy control samples tested negative across both local and Cepheid methods, confirming the specificity and reliability of the Xpert
® BCR-ABL Ultra assay.
Overall, this study demonstrates that the Xpert® BCR-ABL Ultra assay yields results comparable to those obtained with methods currently employed in routine clinical practice. Its robustness was confirmed through comparison with four different platforms used across four Italian laboratories that are highly specialized in onco-hematology diagnostics. We therefore conclude that the Xpert® BCR-ABL Ultra test is a rapid, robust, and efficient platform that significantly simplifies laboratory workflows and minimizes the risk of error. It should be considered a valid alternative among the systems validated and used by the laboratories belonging to the Italian national laboratory network for CML.
4. Material and Methods
4.1. Cohort of Patients and Samples Collection
We used leftover peripheral blood (PB) in EDTA tubes collected from CML patients for routine molecular
BCR::ABL1 measurements. Regarding healthy subjects, we harvested 5 mL of PB in EDTA tubes from scientists involved in this research, following the institution’s guidelines [
13]. Each participant gave his/her consent to sampling.
A total of 149 CML blood samples were acquired and tested in parallel at four Italian laboratories located in the hematology departments of Bologna (lab #1), Napoli (lab #2), Pisa (lab #3), and Orbassano (Turin) (lab #4).
The total collected samples had the following transcript levels:
66 samples detectable from MR3 (0.1% IS) to MR1 (10% IS);
27 samples detectable at MR4 (0.01% IS);
16 samples detectable at MR4.5 (0.0032% IS);
20 samples undetectable or detectable at MR5 (<0.001% IS);
20 samples from healthy subjects.
The number of samples at each molecular response level was inherently limited by the availability of the leftover diagnostic material. Notably, there were fewer samples at MR4.5 and MR5, reflecting the lower frequency of patients at these deep molecular response levels in routine laboratory practice.
All collected samples were analyzed immediately upon arrival (Time 0). In addition, 51 of these samples were re-tested with Xpert® BCR-ABL Ultra after 24 h (Time +24 h) following storage under different conditions. Specifically, whole blood was stored at room temperature (RT) or at 4 °C, and lysate was stored at −20 °C.
4.2. Xpert® BCR-ABL Ultra Analysis
Each sample was analyzed in triplicate, with 3–4 mL of the same PB loaded onto each of the three Xpert® BCR-ABL Ultra cartridges (Lot: 1000277705; Cepheid, Sunnyvale, CA, USA), resulting in three inter-run technical replicates. The manufacturer’s recommended PB volume is 4 mL.
Xpert® BCR-ABL Ultra is a single-use, disposable cartridge for use on the GeneXpert® platforms (Cepheid, Sunnyvale, CA, USA) that measures e13a2 and e14a2 BCR::ABL1 fusion transcripts. The GeneXpert® System (System GX–IV®; Cepheid, Sunnyvale, CA, USA) is an advanced instrument designed for molecular diagnostics, featuring single-use cartridges that contain the reverse transcription and PCR reagents and host the reactions. After the PCR reaction, the GeneXpert® software Dx (version 5.1; Cepheid, Sunnyvale, CA, USA) processes the data to report the amount of BCR::ABL1 transcripts as BCR::ABL1 to ABL1 percent ratios on the International Scale (IS) and as a molecular response (MR), defined as the logarithmic reduction from a baseline of 100% IS.
Each Xpert
® BCR-ABL Ultra cartridge has two internal quality control systems: the
ABL1 Endogenous Control and the Probe Check Control (PCC). The
ABL1 Endogenous Control normalizes the
BCR::ABL1 target and ensures that an adequate amount of sample is used in the test. The PCC verifies that the reagent has been rehydrated, the PCR tube has been filled, and that all reaction components in the cartridge, including probes and dyes, are present and functioning. Each Xpert
® BCR-ABL Ultra kit comes with a certificate of analysis that includes a lot-specific International Scale-Scaling Factor (IS-SF) and an Efficiency ΔCt Value (EΔCt). The IS-SF corrects the assay’s quantitative output to the IS, while the EΔCt represents the amplicon increase per cycle, derived from the slope of the
BCR::ABL1 ΔCt standard curve. This standard curve, which includes four points, is generated from cartridges tested with in-house secondary standards that are calibrated to the WHO International Genetic Reference Panel for
BCR::ABL1 quantification by RT-qPCR. All four laboratories used the same lot (ID 246), which had an EΔCt of 2.09 and an IS-SF of 2.11. The acceptable Ct ranges are between 8 and 18 for
ABL1 and between 8 and 32 for
BCR::ABL1. The Xpert
® BCR-ABL Ultra assay limit of detection (LoD), which is equivalent to the lower limit of quantitation (LLoQ), is 0.003% (MR
4.52). Any values below LoD/LLoQ are reported as either POSITIVE [below LoD] or NEGATIVE in the GeneXpert
® DX software, depending on the reported Ct values for
BCR::ABL1 and
ABL1. Users can manually calculate the results according to the following formula provided in the instructions:
where E
ΔCt and SF are lot-specific. PCR Efficiency and International Scale-Scaling Factor values are encoded in the cartridge barcode and ΔCt is calculated by subtracting
BCR::ABL1 Ct from
ABL1 Ct (
ABL1 Ct–
BCR::ABL1 Ct).
Factors that may negatively influence the reliability of the results include different anticoagulants, low sample volume, and prolonged sample conservation. For a full description of the system, please refer to the GeneXpert
® Dx System Operator Manual or the GeneXpert
® Infinity System Operator Manual [
14].
4.3. Standard Molecular Analysis
Samples collected in each laboratory were tested in duplicate using assays and methods that are routinely employed according to the R.I.L. (Recommendations and Laboratory Indications) published by the Italian national laboratory network for CML.
All laboratories performed RNA extraction using the Maxwell® CSC RNA Blood Kit (Promega Corporation, Madison, WI, USA). Each laboratory employed a different local method for reverse transcription and amplification of the BCR::ABL1 transcript, following the manufacturer’s recommendations and R.I.L. These local methods are described below:
- (1)
SensiQuant p210 Master Mix (Bioclarma, Turin, Italy) on the 7900HT Fast Real-Time PCR System (Applied Biosystems, Waltham, MA, USA);
- (2)
In- house method that referred to van Dongen et al. [
15], with SuperScript™ VILO™ Master Mix and TaqMan™ Fast Universal PCR Master Mix (2X) on QuantStudio 12K Flex Real-Time PCR System (Applied Biosystems, Waltham, MA, USA);
- (3)
ipsogen BCR-ABL1 Mbcr IS-MMR Kits on Rotor-Gene Q (QIAGEN, Hilden, Germany);
- (4)
BCR-ABL P210 ELITe MGB® Kit (ELITechGroup, Turin, Italy) on the 7500 Fast Dx Real-Time PCR Instrument (Applied Biosystems, Waltham, MA, USA).
4.4. External Quality Control Material Analysis
We tested two different types of external quality control materials: Thermo Scientific™ AcroMetrix™ BCR-ABL Panel (RUO) and UK NEQAS BCR::ABL1 Major Quantification program samples (EQA program).
The Thermo Scientific™ AcroMetrix™ BCR-ABL Panel (RUO) (REF 956980, AcroMetrix BCR-ABL Panel Kit; Thermo Fisher Scientific, Waltham, MA, USA) is traceable to the World Health Organization’s first International Genetic Reference Panel for the quantification of BCR::ABL1. It contains lyophilized cell line material (glass vials), with 1 × 106 cells per vial (~0.300 million cells in 4.5 mL of the final lysate). The panel includes five levels of fusion gene expression. All laboratories tested the same lot (043019). The lyophilized material was analyzed in triplicate using Xpert® BCR-ABL Ultra.
The UK NEQAS BCR::ABL1 Major Quantification program samples (EQA program) consist of two lyophilized samples with BCR::ABL1IS levels ranging from 10% to 0.0032%. All laboratories analyzed the same lot (28052021) in quadruplicate using Xpert® BCR-ABL Ultra.
4.5. Statistical Analysis
To assess the repeatability of the measurements obtained using both the local methods and the Xpert® system, the coefficient of repeatability, standard deviation (SD), and coefficient of variation (CV) were calculated.
The EUTOS criteria were used to evaluate concordance between the Xpert
® BCR-ABL Ultra test and the comparator assays, even though the clinical sample comparisons are likely to include less than the 50 samples recommended for these criteria to apply [
16]. Acceptable concordance is defined as the achievement of 2 out of 3 EUTOS criteria [
9]. The samples that tested negative were excluded from the concordance analysis.
Bland–-Altman analysis was carried out to determine the bias and the limit of agreement (LoA) between the Xpert® BCR-ABL Ultra test and the local comparators.
The concordance of MR values was assessed using two different approaches. First, we applied the European LeukemiaNet (ELN) recommendations [
4] that are routinely adopted by the LabNet network laboratories and defined MR classes through specific upper and lower thresholds [
17,
18]. For each
BCR::ABL1%IS value obtained from both the local methods and the Xpert
® BCR-ABL Ultra assay, we assigned an MR category. Values were considered concordant when they fell within the same MR class. The MR categories are specified below:
BCR::ABL1%IS > 0.1% corresponds to <MR3;
BCR::ABL1%IS ≤ 0.1% corresponds to MR3;
BCR::ABL1%IS ≤ 0.01% or an undetectable transcript with >10,000 ABL1 copies (in the same cDNA volume used for BCR::ABL1 testing) corresponds to MR4;
BCR::ABL1%IS ≤ 0.0032% or an undetectable transcript with >32,000 ABL1 copies corresponds to MR4.5;
BCR::ABL1%IS ≤ 0.001% corresponds to MR5.
The second concordance analysis was based on a mathematical comparison. For each result obtained with local methods, the MR value was calculated using the formula 2-log10(BCR::ABL1%IS), which corresponds to the approach typically used by the Xpert® BCR-ABL Ultra system. This MR value was compared with the MR value reported by Xpert® BCR-ABL Ultra for the same sample. In this analysis, results were defined as concordant when the absolute difference between the two MR values was less than 0.5 log.