Next Article in Journal
Terahertz Metamaterials for Biosensing Applications: A Review
Previous Article in Journal
Aptasensors Based on Non-Enzymatic Peroxidase Mimics: Current Progress and Challenges
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Integrated ddPCR Lab-on-a-Disc Device for Rapid Screening of Infectious Diseases

1
Department of Biomedical Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong SAR 999077, China
2
School of Public Health, Guangdong Medical University, Dongguan 523808, China
3
Laboratory Medicine, Shenzhen Key Laboratory of Medical Laboratory and Molecular Diagnostics, Shenzhen Institute of Translational Medicine, The First Affiliated Hospital of Shenzhen University, Shenzhen Second People’s Hospital, Shenzhen 518035, China
4
Key Laboratory of Optoelectronic Devices and Systems of Ministry of Education and Guangdong Province, College of Physics and Optoelectronic Engineering, Shenzhen University, Shenzhen 518060, China
5
Light, Nanomaterials & Nanotechnologies (L2n), CNRS-EMR 7004, Université de Technologie de Troyes, 10000 Troyes, France
*
Authors to whom correspondence should be addressed.
Biosensors 2024, 14(1), 2; https://doi.org/10.3390/bios14010002
Submission received: 14 November 2023 / Revised: 14 December 2023 / Accepted: 16 December 2023 / Published: 21 December 2023
(This article belongs to the Section Biosensors and Healthcare)

Abstract

:
Digital droplet PCR (ddPCR) is a powerful amplification technique for absolute quantification of viral nucleic acids. Although commercial ddPCR devices are effective in the lab bench tests, they cannot meet current urgent requirements for on-site and rapid screening for patients. Here, we have developed a portable and fully integrated lab-on-a-disc (LOAD) device for quantitively screening infectious disease agents. Our designed LOAD device has integrated (i) microfluidics chips, (ii) a transparent circulating oil-based heat exchanger, and (iii) an on-disc transmitted-light fluorescent imaging system into one compact and portable box. Thus, droplet generation, PCR thermocycling, and analysis can be achieved in a single LOAD device. This feature is a significant attribute for the current clinical application of disease screening. For this custom-built ddPCR setup, we have first demonstrated the loading and ddPCR amplification ability by using influenza A virus-specific DNA fragments with different concentrations (diluted from the original concentration to 107 times), followed by analyzing the droplets with an external fluorescence microscope as a standard calibration test. The measured DNA concentration is linearly related to the gradient–dilution factor, which validated the precise quantification for the samples. In addition to the calibration tests using DNA fragments, we also employed this ddPCR-LOAD device for clinical samples with different viruses. Infectious samples containing five different viruses, including influenza A virus (IAV), respiratory syncytial virus (RSV), varicella zoster virus (VZV), Zika virus (ZIKV), and adenovirus (ADV), were injected into the device, followed by analyzing the droplets with an external fluorescence microscope with the lowest detected concentration of 20.24 copies/µL. Finally, we demonstrated the proof-of-concept detection of clinical samples of IAV using the on-disc fluorescence imaging system in our fully integrated device, which proves the capability of this device in clinical sample detection. We anticipate that this integrated ddPCR-LOAD device will become a flexible tool for on-site disease detection.

1. Introduction

In recent years, the increase in emerging infectious diseases has presented a significant challenge to global public health [1,2]. The polymerase chain reaction (PCR) method has been the gold standard for detecting genes since 1983 [3,4]. Quantitative real-time PCR (qPCR) is currently the mainstream technology for nucleic acid molecular detection of pathogens. However, qPCR relies on standard curves or reference genes to determine the nucleic acid quantity, and it is only capable of qualitative detection. Moreover, its sensitivity and precision are limited when detecting low-abundance targets or identifying minor differences in template concentrations.
Digital droplet PCR (ddPCR) has emerged as a third-generation nucleic acid detection technology, following end-point PCR and quantitative real-time PCR (qPCR). It is a quantitative analysis tool in precision medicine to conduct precise nucleic acid detection [5,6]. By diluting the concentration of target molecules to a sufficiently low level, ddPCR facilitates the enumeration of positive reaction chambers. This is accomplished by distributing the attenuated target molecules across independent reaction chambers to enable single-molecule amplification. ddPCR offers several advantages over qPCR, including high-throughput, sensitivity, specificity, and precision. It has a unique advantage in enabling the exact counting of nucleic acid copies without relying on standard curves [7]. This feature allows for direct and independent DNA quantification, providing more precise and reproducible data with a strong anti-interference ability [8]. Furthermore, ddPCR has proven to be an effective method for detecting low-abundance targets [9], which holds great potential in pathogen detection applications [5,10,11,12,13]. The emergence of ddPCR has greatly improved the accuracy and sensitivity of nucleic acid detection.
Despite the advantages of droplet digital PCR (ddPCR) in quantitatively detecting nucleic acids, the adoption of this technology remains limited due to the high costs and complex operating procedures involved. Taking the commercial droplet digital PCR platform QX200 ddPCR system from Bio-Rad as an example, it has been introduced to the market for applications such as early cancer diagnosis, prenatal diagnosis, and single-cell analysis [14]. The platform utilizes microfluidics technology to isolate liquids into independent reaction chambers or produce uniform water-in-oil microemulsions for parallel reactions. However, the system requires separate containers and machines for droplet generation, PCR amplification, and signal collection [15]. This separate apparatus working scheme leads to sample loss and detection signal variations. Additionally, the inflexibility of the protocol and reaction system also limits researchers’ ability to customize the assays to their own needs.
Centrifugal microfluidics turns out to be a promising solution for highly integrated and efficient sample manipulation of a point-of-care (POC) device. Centrifugal microfluidics has the capability of integrating multiple unit operations, including valve control, liquid transfer, quantification, mixing, measurement, separation, etc., into one compact disc [16,17,18]. In centrifugal platforms, only a motor is needed to provide the centrifugal force for sample manipulation on a disc. No external pumps or valves are needed. Moreover, multiplexed detection can be easily achieved, since all points on the disc are in the centrifugal force field. This centrifugal-driven approach offers the advantages of compactness, highly parallel batch processing, and the inherent availability of density-based sample separation [16]. These merits of centrifugal microfluidics provide great opportunities for integrating a variety of complicated functions into one device for POC diagnosis. Additionally, the convenient integration with optoelectronic detection technology has given microfluidic platforms broad prospects in many complex applications, such as fluorescence detection, electrochemical detection, protein calibration measurement, polymerase chain reaction, etc. [19,20]. Overall, the undemanding droplet generation operations and compatibility with various functions integrated on the disc simplify the detection process and allow even nonprofessionals to use the system directly [21]. These advantages have made the LOAD platform an excellent choice for rapid on-site disease detection.
Although some different POC nucleic acid testing devices have been reported [22,23,24], there are still some challenges to be addressed for the existing devices and platforms: (i) low integration and reliance on specialized equipment. (ii) bulky size, and (iii) high requirements for professionals. Scientists are thus continuing to explore the development of integrated, portable, and user-friendly ddPCR platforms [21,25,26]. For example, Schuler et al. have already made progress with their ddPCR on-disc system [20], which significantly reduces the need for manual operations. To further integrate the digital nucleic acid detection platform, various research groups have introduced portable POC devices based on the ddPCR method. Recently, Men’s group introduced a low-cost microfluidic adaptive printing (MAP-ddPCR) system [27], and Li’s group created a novel ddPCR microfluidic chip that integrates all main functions of ddPCR assays, including droplet creation, PCR amplification, and fluorescence detection [28]. However, these innovative systems still rely on a commercial thermal cycler or an external fluorescence imager. Moreover, the current devices in this field are based on isothermal nucleic acid amplification methods such as RPA and LAMP [29,30,31,32]. Despite their advantages in rapid detection, affordability, and ease of use, these isothermal methods are relatively new compared to PCR. They have not yet matured enough to replace PCR as the gold standard for disease detection. Therefore, it is crucial to develop a fully integrated, portable, and user-friendly ddPCR-LOAD device to achieve simultaneously built-in droplet generation, PCR thermocycling, and on-disc fluorescence detection, which can be used for effective nucleic acid screening.
In this paper, we proposed an integrated ddPCR device based on a centrifugal lab-on-a-disc system that enables “sample-to-answer” operations. The device is designed to enable automated on-disc droplet generation. These droplets align in the PCR thermocycling and readout zone by capillary action. The target gene in the microdroplet is amplified on the disc through thermocycling based on a circulating oil-based heat exchange system. On-disc image recording and analysis are available by integrating an on-disc fluorescent imaging system. This all-in-one ddPCR-LOAD device is capable of measuring the absolute amount of molecular genetic products. Thus, this portable device will provide an on-site screening test solution for disease diagnosis. We anticipate that it will become a valuable tool for various molecular biology applications, including detecting pathogens, analyzing gene expression, and measuring disease-causing mutations.

2. Materials and Methods

2.1. Samples Collection and Preparation

Four infectious viral plasmids and five human infectious samples were used as amplification templates in this work (SI, Table S1). The four types of viral plasmids were influenza A virus (IAV), respiratory syncytial virus (RSV), scarlet fever (SF), and dengue virus type I (DENV-I). The five clinical samples were from patients infected by different viruses. They were influenza A virus (IAV), respiratory syncytial virus (RSV), varicella zoster virus (VZV), Zika virus (ZIKV), and adenovirus (ADV). All clinical samples were collected according to the standard clinical sample collection protocols, with ethical declaration. For the viral plasmid DNA, it was prepared in a serial dilution of the stock concentration (diluted from the original concentration up to 107 times). For the human clinical samples, nucleic acid extraction was carried out using the Viral RNA Kit (Catalog No. 11858882001, Roche, Boston, MA, USA) for the above five positive clinical samples, and then, the extracted RNA was reverse-transcribed into cDNA using PrimeScript™ RT Master Mix (Catalog No. RR036A, Takara, Japan).
The PCR reagent used in this study was ddPCR™ EvaGreen Supermix (Catalog No. 1864033, Bio-Rad Laboratories Inc., Hercules, CA 94547, USA), and the EvaGreen based-PCR experiment was conducted according to the standard protocol. The EvaGreen-based PCR reaction mixture was assembled from a 2 × ddPCR™ EvaGreen Supermix (Bio-Rad Laboratories Inc., Hercules, CA 94547, USA), primers, and template (variable volumes, DNA reserved-transcribed from clinical samples or series-diluted viral plasmid DNA) in a final volume of 20 μL. The detailed sequences of the primer pairs used in this study can be found in the Supporting Information (SI, Table S1).

2.2. Workflow of ddPCR

The workflow of ddPCR is illustrated in Figure 1. First, samples were collected, followed by the extraction of RNA and the synthesis of cDNA. Next, as shown in step 4, the synthesized cDNA sample was loaded onto the ddPCR-LOAD device and divided into multiple independent partitions by droplet generation. These droplets contained either a limited number of target DNA molecules or none [33]. The droplets were then amplified by the on-disc thermocycling system (transparent circulating oil-based heat exchanger). After PCR thermocycling to the end point, fluorescent signals were detected in droplets that contained amplified target sequences, followed by some calibration tests using a Leica fluorescence microscope. Moreover, we demonstrated the capability of the on-disc fluorescence imaging system in our fully integrated device. Finally, fluorescence images were used for the subsequent analyses. The results of the PCR amplification were represented in binary form as either “1” or “0”, visualized by the presence or absence of fluorescent signals. By counting the number of fluorescent droplets, we could quantitatively measure the concentration of target DNA.

2.3. Design of the Integrated ddPCR-on-a-Disc Device

2.3.1. On-Disc Fluorescence Imaging System

Figure 2 illustrates the schematic layout of the ddPCR-LOAD device. The size of this portable device is 290 mm × 250 mm × 480 mm (see Figure 2a). The integrated device consists primarily of two components, as shown in Figure 2b: a fluorescence imaging subsystem (vertical part) and a spinning lab on-a-disc (LOAD) subsystem (horizontal part). The images of the device are shown in the Supplementary Information for demonstrating the operation of the system (Figure S1). The on-disc fluorescence imaging system contains four main parts: a light source (blue LED), a 488 nm excitation filter (FBH488-10, Thorlabs Inc., Newton, NJ 07860, USA), a 525 nm emission filter (MF525-39, Thorlabs Inc., Newton, NJ 07860, USA), and a camera (MU500B, AmScope, Irvine, CA 92606, USA). The built-in light source is positioned beneath the LOAD subsystem, and it illuminates the ddPCR sample through an excitation filter. The fluorescent sample was imaged by the camera placed at the opposite side of LOAD subsystem after an emission filter. This approach has the advantage of eliminating the need for sophisticated optical structures, thus simplifying the integration process, which results in cost reduction. Moreover, to enable the light source to reach the sample area of the microfluidic chip directly through the heating elements, a novel microfluidic chip with a PDMS–quartz composite structure is developed for the LOAD subsystem. Additionally, a transparent optical window is incorporated into the circulating oil-based heat exchange system under the microfluidic chip layer (purple area located in the horizontal part in Figure 2b), which allows for on-disc fluorescence imaging. This makes the system more portable and easier to be integrated into a compact device for on-site ddPCR analysis.

2.3.2. Transparent Circulating Oil-Based Heat Exchanger

The detailed design of the microfluidics chip (layer 1) and the transparent circulating oil-based heat-exchanging disc (layers 2–4) is shown in Figure 2c and Figure S1B. The circulating oil-based heat-exchanging disc is composed of three layers: (i) the upper layer (layer 2), which is in direct contact with the microfluidics chip (layer 1) and also serving as the disc holder; (ii) the middle layer, which provides a channel for silicone oil circulation (layer 3); and (iii) the bottom layer, which holds two thermoelectric coolers (TECs) for providing PCR thermocycling (layer 4). The circulation pump provides the power source for the oil circulation, which is placed in layer 2. It consists of a three-phase DC brushless motor and a customized fan blade fabricated by 3D printing techniques with high-temperature resistant nylon material. Layer 3 is filled with heat-conducting oil (low-viscosity dimethyl silicone) for improved heat conductivity and liquid fluidity. The combination of the three-phase DC brushless motor and fan blade with the heat-conducting oil results in an efficient and reliable heat transfer system that ensures rapid heating and cooling.
During the PCR thermocycling process, the oil-based heat exchanger serves to circulate the heat-conductive oil in a clockwise direction inside the flow channel. The two TECs mounted in layer 4 can heat up and cool down the silicone oil, which is then transferred to the transparent sample holder by circulating, allowing for precise temperature control in the sample zone (layers 2–4, Figure 2c). The closed-loop workflow of the on-disc thermal controlling is illustrated in Figure S2A. The temperature sensor collects real-time data, and based on these data, the temperature control system cooperates with the PID algorithm to accurately control the TECs for bidirectional temperature control. The three layers of the heat exchanger work together to create a programmable thermocycling system that ensures accurate temperature control and prevents temperature instability. The temperature curve for PCR (4 cycles out of 42 cycles) is illustrated in Supporting Information Figures S2B and S3. To measure the actual temperature of the reagent, a thermocouple is inserted from the left inlet of the microfluidic chip. This thermocouple serves as an external sensor for temperature calibration. The temperature curve demonstrates that the device achieves the following performance: an average heating rate of 0.25 °C/s and an average cooling rate of 0.28 °C/s, resulting in a PCR temperature cycling duration of 6 min and 40 s for each cycle. These performance characteristics meet the requirements for conventional or ddPCR experiments. As a consequence, the design of this circulating oil-based heat exchanger provides an effective way to regulate the temperature for ddPCR experiments and enables the following transmission-based fluorescence detection.

2.3.3. Microfluidic Chip for Droplet Generation

The microfluidic chip consists of two main parts: a PDMS-based polymer holder and a three-layer quartz chip (highlighted with red, dotted box in Figure 3a). The PDMS-based polymer holder was designed using SolidWorks and fabricated with computer numerical control milling. The mold was designed using SolidWorks and fabricated with a digital controlled engraver. Then, a 10:1 (w/w) mixture of the polydimethylsiloxane (PDMS) prepolymer and curing agent (Dow Corning SYLGARD184, USA) was poured into the milled mold, incubated at 65 °C for 2 h until solid, and formed a structured microfluidic holder. Within the disc layout, a round shape well was left open for embedding the three-layer quartz chip. Moreover, the centrifugal microfluidic chip was designed based on “step emulsification” geometry, which can generate droplets with defined sizes without any external pumps or valves, as reported in the literature [16]. The V-shaped channel remains open for PDMS refilling in order to mount the capillary elements tightly within the chip. The final chip is sealed with a layer of optical transparent adhesive film (Life Technologies, Waltham, MA, USA).

2.4. ddPCR Screening Test for Clinical Samples

After sample preparation (i.e., (i) sample collection, (ii) RNA extraction, and (iii) cDNA generation, illustrated in Section 2.1), the PCR mixture proceeded with droplet generation in the microfluidic chip, 20 µL of PCR reaction mixture (illustrated in Section 2.1) was loaded into inlet 2 of the microfluidic chip (highlighted in the yellow area in Figure 3a), and 70 µL droplet generation oil for EvaGreen (Catalog No. 1864005, Bio-Rad Laboratories Inc., Hercules, CA 94547, USA) was loaded into inlet 1 of the chip (highlighted in the purple area, Figure 3a). The designed microfluidic chip could generate droplets of defined diameters by controlling the rotational speed. In this work, all droplets were generated under a rotating speed of 2000 rpm. The droplets then went through a customized capillary to the sample region. Next, the target gene was amplified to the end point and detected directly on the integrated ddPCR system. The thermal cycling conditions for the PCR consisted of an initial incubation at 95 °C for 5 min, followed by 42 cycles of denaturation at 95 °C for 15 s, annealing at 55 °C for 15 s, and extension at 72 °C for 30 s. The reaction was then subjected to a final step at 72 °C for 5 min. Finally, a Leica fluorescence microscope or on-disc fluorescent imaging subsystem was utilized to capture the fluorescence images, revealing the amplified gene contained in the droplet. The fluorescence images were then analyzed with MATLAB R2019b software. The absolute quantification of the sample was calculated based on the image analysis by Poisson distribution [34] (shown in the Supporting Information).

3. Results and Discussion

3.1. Droplet Generation

The compact disposable microfluidic chip consisted of two main layers: a PDMS-based holder and a three-layer glass chip embedded in the round sample area, as shown in Figure 3a. The centrifugal microfluidics chip is designed based on “step emulsification” geometry, which can generate droplets with defined sizes by pump-free fluidic actuation. The size of the droplets depends on the diameter of the capillaries and the spinning speed. This design integrates a commercially available capillary into microfluidic chips without using lithography techniques [24,35], which greatly simplifies the fabrication process and reduces the cost [16]. Droplet generation oil from EvaGreen (Bio-Rad Laboratories Inc., Hercules, CA 94547, USA) was used as the oil phase in the water-in-oil emulsion. As the LOAD system spins, the aqueous phase will be “cut off” by centrifugal forces, which generates droplets in the sample region.
As shown in Figure 3b, a three-layer glass chip was embedded into a PDMS-based polymer holder to serve as a container for droplet generation and the subsequent PCR thermocycling process, which prevented evaporation issues caused by the porous structure of PDMS during thermocycling [20]. Figure 3c shows a uniform droplet size distribution with a diameter of 106.14 ± 4.87 μm under the spinning speed of 2000 rpm.

3.2. System Calibration

In order to evaluate the performance of the proposed ddPCR-LOAD device, we conducted on-disc ddPCR experiments and used a fluorescence microscope (Leica CTR6500, Leica Microsystems, Wetzlar, Germany) for the system calibration. The resulting images were analyzed using MATLAB software, as illustrated in Figure 4. As an example, Figure 4a depicts one of the original images extracted from the experiment results of the IAV clinical specimens. The original images were used as input for the algorithm for droplet classification and segmentation. To this end, an image histogram, shown in Figure 4b, was generated to illustrate the threshold determination. The threshold was established based on the native function “gray thresh” in MATLAB software, which employs Otsu’s algorithm [36] to evaluate all potential values for the threshold between background and foreground. When the histogram exhibits no clear valleys or when the contrast between objects and the background is low, this method can successfully achieve the desired segmentation. The optimal threshold value was selected by minimizing the weighted sum of the variances within two clusters (“level = graythresh (image)”). In our study, the threshold for positive droplet segmentation was determined using the equation “Threshold = (1 + 1/6) * level”. This formula scales the calculated threshold level (obtained from the “graythresh” function) by a factor of (1 + 1/6) to set a slightly higher threshold value. This adjustment helps to ensure the segmentation of positive droplets.
For each image, the average intensity in each individual droplet was calculated. For example, in the sample image shown in Figure 4a, the calculated threshold value is x = (1 + 1/6) * level = 0.1350, as illustrated in Figure 4b. Finally, the resulting positive droplet segmentation and the corresponding number counting outcomes can be observed in Figure 4c. These results demonstrate the successful application of the thresholding technique for segmenting and counting positive droplets in the analyzed image.
The integrated system was calibrated using a serial dilution of the stock IAV viral plasmid DNA, spanning from 1:100 to 1:107. Next, fluorescence images of the droplets were taken with a Leica CTR6500 fluorescence microscope (Leica Microsystems, Germany) to capture the amplified gene contained in the droplet. Figure 5a shows the concentration–gradient results from the following experiments: (a) the initial concentration, (b) 104 times diluted, (c) 105 times diluted, and (d) without the DNA template. As the concentration of the template decreased, fewer positive droplets were observed in the images, which confirms the reliability of the LOAD disc for droplet generation and conducting thermocycling ddPCR experiments of varied concentrations. Figure 5b indicates the correlation between the measured concentration and the dilution factor Xdi (= −log (dilution times), Figure 5a,b). In this figure, the measured concentrations were calculated based on the image analysis results obtained by MATLAB (2019b) (see Figure 4). Given the measured fraction of positive reactors, we calculated the initial concentration (measured concentration result) of the tested samples. The equations can be found in the Supporting Information. The results show that the measured concentration in the experiment has a good correlation with the gradient–dilution ratio (R2 = 0.9959), which verifies the capability of the droplet generation and PCR thermocycling functions of the proposed ddPCR LOAD device in the quantitation of gene targets. The concentration–gradient results of viral plasmid DNA have also proven the feasibility of quantitative measurements of this device for disease detection.

3.3. Detection of Human Infectious Samples

Moving forward, three viral plasmid DNA samples were tested in Figure 6. These samples were injected into the reported ddPCR-LOAD device for droplet generation and PCR thermocycling and subsequently imaged using a Leica fluorescence microscope. Viral plasmids DNA are purified plasmids containing different specific viral gene sequences, including RSV, SF, and DENV-I. All three positive samples were successfully detected, and the concentration of each sample was measured to be 617.30, 277.74, and 36.76 copies/µL, respectively. Furthermore, to push our work towards clinical applications, five real human infectious samples were detected, including IAV, RSV, ADV, ZIKV, and VZV. We extracted RNA directly from clinical samples with unknown virulence gene abundance and reverse-transcribed them into cDNA for the following ddPCR experiments on the on-disc ddPCR LOAD system for droplet generation and PCR thermocycling. The detected concentrations analyzed with an external fluorescence microscope from the five samples were 1357.61, 518.44, 500.10, 88.15, and 20.24 copies/µL, respectively (shown in Figure 6b). The minimum detected concentration in this work was 20.24 copies/µL.

3.4. On-Site Infectious Disease Detection

To further validate the integrated ddPCR-LOAD device, a proof-of-concept clinical sample detection experiment was demonstrated. After the on-disc ddPCR assays, fluorescent images were captured directly using the integrated fluorescent imaging system of the device. Two different concentration levels of the IAV clinical sample were injected into the device: 1 pg/µL and 100 pg/µL. The captured fluorescence images in Figure 7a,b clearly demonstrated an increase in the number of positive droplets with the increasing target DNA concentration. Subsequently, the quantitative concentrations of the two samples were calculated based on the image analysis results, as shown in Figure 7c. The results revealed that the two IAV clinical samples were detected as positive, and the measured concentration indicated the proposed device is capable of distinguishing clinical specimens with different concentration levels and quantifying target genes in on-site clinical samples.

4. Conclusions

In conclusion, we have developed an integrated ddPCR-LOAD device. This centrifugal force-driven device provides a portable, highly integrated, and user-friendly scheme for on-site pathogen detection. The centrifugal microfluidic chip is designed based on “step emulsification” geometry, which can generate droplets with defined sizes without any external pumps or valves. Moreover, a transmitted-light fluorescence system and transparent circulating oil-based heat exchanger were developed for better system integration. Based on this integrated device, we have successfully demonstrated ddPCR experiments for on-site infectious disease detection. The feasibility of this device was first validated by detecting IAV viral plasmid DNA templates at various concentration levels. The ddPCR experiments were conducted on the device and followed by analyzing the droplets using an external fluorescence microscope. Moving forward, five clinical infectious samples were quantitatively detected in this study. The minimum detected concentration in this work was found to be 20.24 copies/µL in the respiratory adenovirus samples (measured with an external fluorescence microscope). Finally, the proof-of-concept detection of clinical samples of IAV was demonstrated on the fully integrated device. Overall, this integrated ddPCR-LOAD device is capable of quantitative clinical sample detection. It has great potential in the early diagnosis of cancer, noninvasive prenatal diagnosis, single-cell analysis, high-throughput drug screening, and other biomedical applications.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/bios14010002/s1: Table S1: Information of the 4 types of viral plasmid DNA and 5 human infectious samples used in this work. Figure S1: Equipment images. Figure S2: (A) The closed-loop workflow of the on-disc thermal controlling; (B) Illustration of the temperature curve for PCR inside the chamber, and the equations of the measured concentrations [34,37,38]. Figure S3: PCR thermocycling curve: (A) initial 4 cycles: cycle 1–cycle 4, (B) middle 4 cycles: cycle 21–cycle 24, and (C) final 4 cycles: cycle 39–cycle 42.

Author Contributions

W.Z.: Conceptualization, Methodology, Software, Formal analysis, Investigation, Data curation, Writing—original draft, Writing—review and editing, and Visualization; L.C.: Methodology, Investigation, Formal analysis, Data curation, and Writing—review and editing; Y.W. (Yuye Wang): Conceptualization, Methodology, Investigation, Formal analysis, and Writing—review and editing; Z.X.: Conceptualization, Methodology, Investigation, Formal analysis, and Data curation; Y.W. (Yuanyuan Wei): Conceptualization, Methodology, Investigation, and Formal analysis; S.Z. (Shaodi Zhu): Investigation, Formal analysis, Writing—review and editing, and Visualization; M.N.: Software, Formal analysis, and Writing—review and editing; W.-C.M.: Formal analysis and Writing—review and editing; H.-P.H.: Conceptualization, Methodology, Writing—review and editing, Supervision, and Funding acquisition; D.G.: Conceptualization, Resources, Writing—review and editing, Supervision, and Funding acquisition; and S.Z. (Shuwen Zeng): Conceptualization, Methodology, Formal analysis, and Writing—review and editing, Supervision. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Hong Kong Research Grants Council (project references: GRF14204621, GRF14207920, GRF14207419, GRF14207121, and N_CUHK407/16) and the Innovation and Technology Commission (project references: GHX-004-18SZ and ITS/137/20). The authors also would like to acknowledge the National Key Research and Development Program of China, No. 2022YFC2302700; Guangdong Science and Technology Foundation (No. 2021A1515220084 and No. 2022B1111020001); and the Shenzhen Science and Technology Foundation (ZDSYS20210623092001003, GJHZ20200731095604013, JSGG20220301090003004, No. 201906133000069, No. SGLH20180625171602058, and JCYJ20200109120205924) for their generous financial support to carry out this research.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Ethics Committee of Shenzhen Second People’s Hospital with the approval number 20211116008-FS01, dated 20 December 2021.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

All data needed to evaluate the conclusions in the paper are present in the paper and/or the Supplementary Materials.

Acknowledgments

The authors would like to acknowledge Shiyue Liu for her support in providing GAPDH cDNA regarding the preliminary validation of our work.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Daszak, P.; Keusch, G.T.; Phelan, A.L.; Johnson, C.K.; Osterholm, M.T. Infectious Disease Threats: A Rebound To Resilience. Health Aff. 2021, 40, 204–211. [Google Scholar] [CrossRef] [PubMed]
  2. Artika, I.M.; Wiyatno, A.; Ma’roef, C.N. Pathogenic viruses: Molecular detection and characterization. Infect. Genet. Evol. 2020, 81, 104215. [Google Scholar] [CrossRef] [PubMed]
  3. Mullis, K.; Faloona, F.; Scharf, S.; Saiki, R.; Horn, G.; Erlich, H. Specific Enzymatic Amplification of DNA Invitro—The Polymerase Chain-Reaction. Cold Spring Harb. Symp. Quant. Biol. 1986, 51, 263–273. [Google Scholar] [CrossRef] [PubMed]
  4. Mullis, K.B. The Unusual Origin of the Polymerase Chain-Reaction. Sci. Am. 1990, 262, 56–65. [Google Scholar] [CrossRef] [PubMed]
  5. Chen, B.; Jiang, Y.F.; Cao, X.H.; Liu, C.; Zhang, N.; Shi, D.M. Droplet digital PCR as an emerging tool in detecting pathogens nucleic acids in infectious diseases. Clin. Chim. Acta 2021, 517, 156–161. [Google Scholar] [CrossRef]
  6. Huggett, J.F.; Foy, C.A.; Benes, V.; Emslie, K.; Garson, J.A.; Haynes, R.; Hellemans, J.; Kubista, M.; Nolan, R.; Pfaffl, M.W.; et al. The Digital MIQE Guidelines: Minimum Information for Publication of Quantitative Digital PCR Experiments. Clin. Chem. 2013, 59, 892–902. [Google Scholar] [CrossRef]
  7. Badbaran, A.; Berger, C.; Riecken, K.; Kruchen, A.; Geffken, M.; Muller, I.; Kroger, N.; Ayuk, F.A.; Fehse, B. Accurate In-Vivo Quantification of CD19 CAR-T Cells after Treatment with Axicabtagene Ciloleucel (Axi-Cel) and Tisagenlecleucel (Tisa-Cel) Using Digital PCR. Cancers 2020, 12, 1970. [Google Scholar] [CrossRef]
  8. Lin, B.B.; Guo, Z.J.; Geng, Z.; Jakaratanopas, S.; Han, B.Q.; Liu, P. A scalable microfluidic chamber array for sample-loss-free and bubble-proof sample compartmentalization by simple pipetting. Lab Chip 2020, 20, 2981–2989. [Google Scholar] [CrossRef]
  9. Mathekga, B.S.P.; Nxumalo, Z.; Raj, D. Micro and nanofluidics for high throughput drug screening. Prog. Mol. Biol. Transl. Sci. 2022, 187, 93–120. [Google Scholar] [CrossRef]
  10. Beinhauerova, M.; Babak, V.; Bertasi, B.; Boniotti, M.B.; Kralik, P. Utilization of Digital PCR in Quantity Verification of Plasmid Standards Used in Quantitative PCR. Front. Mol. Biosci. 2020, 7, 155. [Google Scholar] [CrossRef]
  11. Zhang, T.T.; Niu, Z.Q.; Wu, F.; Chen, Z.K.; Xu, J.; Jiang, K.W.; Lai, Z.Y. Qualitative and quantitative detection of surgical pathogenic microorganisms Escherichia coli and Staphylococcus aureus based on ddPCR system. Sci. Rep. 2021, 11, 8771. [Google Scholar] [CrossRef] [PubMed]
  12. Lee, Y.S.; Choi, J.W.; Kang, T.; Chung, B.G. Deep Learning-Assisted Droplet Digital PCR for Quantitative Detection of Human Coronavirus. BioChip J. 2023, 17, 112–119. [Google Scholar] [CrossRef]
  13. Nyaruaba, R.; Mwaliko, C.; Dobnik, D.; Neuzil, P.; Amoth, P.; Mwau, M.; Yu, J.P.; Yang, H.; Wei, H.P. Digital PCR Applications in the SARS-CoV-2/COVID-19 Era: A Roadmap for Future Outbreaks. Clin. Microbiol. Rev. 2022, 35, e0016821. [Google Scholar] [CrossRef] [PubMed]
  14. Tan, L.L.; Loganathan, N.; Agarwalla, S.; Yang, C.; Yuan, W.; Zeng, J.; Wu, R.; Wang, W.; Duraiswamy, S. Current commercial dPCR platforms: Technology and market review. Crit. Rev. Biotechnol. 2022, 43, 433–464. [Google Scholar] [CrossRef] [PubMed]
  15. Suo, T.; Liu, X.J.; Feng, J.P.; Guo, M.; Hu, W.J.; Guo, D.; Ullah, H.; Yang, Y.; Zhang, Q.H.; Wang, X.; et al. ddPCR: A more accurate tool for SARS-CoV-2 detection in low viral load specimens. Emerg. Microbes Infect. 2020, 9, 1259–1268. [Google Scholar] [CrossRef] [PubMed]
  16. Wang, Y.Y.; Liu, S.Y.; Zhang, T.K.; Cong, H.J.; Wei, Y.Y.; Xu, J.B.; Ho, Y.P.; Kong, S.K.; Ho, H.P. A centrifugal microfluidic pressure regulator scheme for continuous concentration control in droplet-based microreactors. Lab Chip 2019, 19, 3870–3879. [Google Scholar] [CrossRef]
  17. Loo, J.F.C.; But, G.W.C.; Kwok, H.C.; Lau, P.M.; Kong, S.K.; Ho, H.P.; Shaw, P.C. A rapid sample-to-answer analytical detection of genetically modified papaya using loop-mediated isothermal amplification assay on lab-on-a-disc for field use. Food Chem. 2019, 274, 822–830. [Google Scholar] [CrossRef]
  18. Tang, M.H.; Huang, X.Y.; Chu, Q.; Ning, X.H.; Wang, Y.Y.; Kong, S.K.; Zhang, X.P.; Wang, G.H.; Ho, H.P. A linear concentration gradient generator based on multi-layered centrifugal microfluidics and its application in antimicrobial susceptibility testing. Lab Chip 2018, 18, 1452–1460. [Google Scholar] [CrossRef]
  19. Zhuang, J.J.; Yin, J.X.; Lv, S.W.; Wang, B.; Mu, Y. Advanced “lab-on-a-chip” to detect viruses—Current challenges and future perspectives. Biosens. Bioelectron. 2020, 163, 13. [Google Scholar] [CrossRef]
  20. Schuler, F.; Trotter, M.; Geltman, M.; Schwemmer, F.; Wadle, S.; Dominguez-Garrido, E.; Lopez, M.; Cervera-Acedo, C.; Santibanez, P.; von Stetten, F.; et al. Digital droplet PCR on disk. Lab Chip 2016, 16, 208–216. [Google Scholar] [CrossRef]
  21. Gou, T.; Hu, J.M.; Wu, W.S.; Ding, X.; Zhou, S.F.; Fang, W.B.; Mu, Y. Smartphone-based mobile digital PCR device for DNA quantitative analysis with high accuracy. Biosens. Bioelectron. 2018, 120, 144–152. [Google Scholar] [CrossRef] [PubMed]
  22. Yeh, E.C.; Fu, C.C.; Hu, L.; Thakur, R.; Feng, J.; Lee, L.P. Self-powered integrated microfluidic point-of-care low-cost enabling (SIMPLE) chip. Sci. Adv. 2017, 3, e1501645. [Google Scholar] [CrossRef] [PubMed]
  23. Hu, Y.; Xu, P.; Luo, J.; He, H.X.; Du, W.B. Absolute Quantification of H5-Subtype Avian Influenza Viruses Using Droplet Digital Loop-Mediated Isothermal Amplification. Anal. Chem. 2017, 89, 745–750. [Google Scholar] [CrossRef] [PubMed]
  24. Chen, Z.T.; Liao, P.Y.; Zhang, F.L.; Jiang, M.C.; Zhu, Y.S.; Huang, Y.Y. Centrifugal micro-channel array droplet generation for highly parallel digital PCR. Lab Chip 2017, 17, 235–240. [Google Scholar] [CrossRef] [PubMed]
  25. Zhou, S.F.; Gou, T.; Hu, J.M.; Wu, W.S.; Ding, X.; Fang, W.B.; Hu, Z.M.; Mu, Y. A highly integrated real-time digital PCR device for accurate DNA quantitative analysis. Biosens. Bioelectron. 2019, 128, 151–158. [Google Scholar] [CrossRef] [PubMed]
  26. Meng, X.K.; Yu, Y.H.; Gong, P.; Jin, G.Y. An integrated droplet digital PCR gene chip for absolute quantification of nucleic acid. Microfluid. Nanofluid. 2021, 25, 9. [Google Scholar] [CrossRef]
  27. Bu, W.T.; Li, W.; Li, J.N.; Ao, T.T.; Li, Z.H.; Wu, B.Z.; Wu, S.T.; Kong, W.J.; Pan, T.R.; Ding, Y.; et al. A low-cost, programmable, and multi-functional droplet printing system for low copy number SARS-CoV-2 digital PCR determination. Sens. Actuator B-Chem. 2021, 348, 130678. [Google Scholar] [CrossRef]
  28. Wei, C.Y.; Yu, C.Z.; Li, S.S.; Meng, J.Y.; Li, T.J.; Cheng, J.M.; Pan, F.; Li, J.W. Easy-to-Operate Co-flow Step Emulsification Device for Droplet Digital Polymerase Chain Reaction. Anal. Chem. 2022, 94, 3939–3947. [Google Scholar] [CrossRef]
  29. Yin, J.X.; Zou, Z.Y.; Hu, Z.M.; Zhang, S.; Zhang, F.P.; Wang, B.; Lv, S.W.; Mu, Y. A “sample-in-multiplex-digital-answer-out” chip for fast detection of pathogens. Lab Chip 2020, 20, 979–986. [Google Scholar] [CrossRef]
  30. Hsieh, S.A.; Shamsaei, D.; Eitzmann, D.R.; Anderson, J.L. Digital Droplet Loop-Mediated Isothermal Amplification Featuring a Molecular Beacon Assay, 3D Printed Droplet Generation, and Smartphone Imaging for Sequence-Specific DNA Detection. Anal. Chem. 2022, 94, 11949–11956. [Google Scholar] [CrossRef]
  31. Park, B.H.; Oh, S.J.; Jung, J.H.; Choi, G.; Seo, J.H.; Kim, D.H.; Lee, E.Y.; Seo, T.S. An integrated rotary microfluidic system with DNA extraction, loop-mediated isothermal amplification, and lateral flow strip based detection for point-of-care pathogen diagnostics. Biosens. Bioelectron. 2017, 91, 334–340. [Google Scholar] [CrossRef] [PubMed]
  32. Gowda, H.N.; Kido, H.; Wu, X.Y.; Shoval, O.; Lee, A.; Lorenzana, A.; Madou, M.; Hoffmann, M.; Jiang, S.C. Development of a proof-of-concept microfluidic portable pathogen analysis system for water quality monitoring. Sci. Total Environ. 2022, 813, 11. [Google Scholar] [CrossRef] [PubMed]
  33. Quan, P.L.; Sauzade, M.; Brouzes, E. dPCR: A Technology Review. Sensors 2018, 18, 1271. [Google Scholar] [CrossRef] [PubMed]
  34. Sreejith, K.R.; Ooi, C.H.; Jin, J.; Dao, D.V.; Nguyen, N.T. Digital polymerase chain reaction technology—Recent advances and future perspectives. Lab Chip 2018, 18, 3717–3732. [Google Scholar] [CrossRef]
  35. Li, X.R.; Zhang, D.F.; Ruan, W.D.; Liu, W.Z.; Yin, K.; Tian, T.; Bi, Y.P.; Ruan, Q.Y.; Zhao, Y.; Zhu, Z.; et al. Centrifugal-Driven Droplet Generation Method with Minimal Waste for Single-Cell Whole Genome Amplification. Anal. Chem. 2019, 91, 13611–13619. [Google Scholar] [CrossRef]
  36. Otsu, N. Threshold Selection Method from Gray-Level Histograms. IEEE Trans. Syst. Man Cybern. 1979, 9, 62–66. [Google Scholar] [CrossRef]
  37. Basu, A.S. Digital Assays Part I: Partitioning Statistics and Digital PCR. SLAS Technol. 2017, 22, 369–386. [Google Scholar] [CrossRef]
  38. Poisson, S.D.; Poisson, S.-D. Recherches sur la Probabilité des Jugements en Matière Criminelle et en Matière Civile: Précédées des Règles Générales du Calcul des Probabilités; Bachelier: Paris, France, 1837. [Google Scholar]
Figure 1. Sample processing and droplet digital PCR workflow. The ddPCR workflow includes sample collection, RNA extraction, and cDNA synthesis, followed by droplet generation and amplification on the ddPCR-LOAD device. Fluorescence images were captured for the results analysis.
Figure 1. Sample processing and droplet digital PCR workflow. The ddPCR workflow includes sample collection, RNA extraction, and cDNA synthesis, followed by droplet generation and amplification on the ddPCR-LOAD device. Fluorescence images were captured for the results analysis.
Biosensors 14 00002 g001
Figure 2. Physical and schematic diagram of the integrated ddPCR-LOAD device. (a) A photograph of the integrated ddPCR-on-disc device is shown with dimensions of 290 mm × 250 mm × 480 mm. (b) A schematic illustration of the device, which includes a centrifugal lab-on-a-disc (LOAD) subsystem and a fluorescent imaging subsystem. (c) Detailed diagram of the LOAD subsystem. The LOAD subsystem encompasses a microfluidics chip (layer 1) and a transparent circulating oil-based heat exchanger (layers 2–4).
Figure 2. Physical and schematic diagram of the integrated ddPCR-LOAD device. (a) A photograph of the integrated ddPCR-on-disc device is shown with dimensions of 290 mm × 250 mm × 480 mm. (b) A schematic illustration of the device, which includes a centrifugal lab-on-a-disc (LOAD) subsystem and a fluorescent imaging subsystem. (c) Detailed diagram of the LOAD subsystem. The LOAD subsystem encompasses a microfluidics chip (layer 1) and a transparent circulating oil-based heat exchanger (layers 2–4).
Biosensors 14 00002 g002
Figure 3. (a)The schematic diagram and the image of a PDMS–glass microfluidic chip. (b) Illustration of the design of the microfluidics chip for the ddPCR bioassay. (c) Bright field microscopy image of droplets generated with EvaGreen ddPCR mix in the sample region in Figure 3a (marked red-dotted rectangle). Data represent the mean ± SD, with n = 100.
Figure 3. (a)The schematic diagram and the image of a PDMS–glass microfluidic chip. (b) Illustration of the design of the microfluidics chip for the ddPCR bioassay. (c) Bright field microscopy image of droplets generated with EvaGreen ddPCR mix in the sample region in Figure 3a (marked red-dotted rectangle). Data represent the mean ± SD, with n = 100.
Biosensors 14 00002 g003
Figure 4. Image analysis using the MATLAB algorithm. (a) An original image extracted from the experimental results of the IAV human infectious sample detection (1 out of 35 images), serving as the input to the algorithm. The scale bar represents 200 µm. (b) An image histogram displaying the adaptive threshold utilized for droplet classification and segmentation. (c) The counted number of positive (bright) droplets in Figure 4a is 133, indicating the result of droplet counting. The scale bar represents 200 µm.
Figure 4. Image analysis using the MATLAB algorithm. (a) An original image extracted from the experimental results of the IAV human infectious sample detection (1 out of 35 images), serving as the input to the algorithm. The scale bar represents 200 µm. (b) An image histogram displaying the adaptive threshold utilized for droplet classification and segmentation. (c) The counted number of positive (bright) droplets in Figure 4a is 133, indicating the result of droplet counting. The scale bar represents 200 µm.
Biosensors 14 00002 g004
Figure 5. System calibration results from a series of dilution concentrations of IAV viral plasmid DNA. (a) Fluorescence distribution of droplets after ddPCR reactions at different cDNA concentrations. The target DNA used in this experiment is IAV viral plasmid DNA: (i) initial concentration (1 out of 30 images), (ii) diluted 104 times (1 out of 19 images), (iii) diluted 105 times (1 out of 14 images), and (iv) without a DNA template (1 out of 17 images). The scale bar represents 200 µm. (b) The measured concentration results were calculated based on the fluorescent droplet counting results, and the number of fluorescence droplets was detected using MATLAB software (see Figure 4). The linear fitting result R2 = 0.9959 shows the detected concentration results from the reported device were consistent with the gradient–dilution factor. The images were captured by a fluorescence microscope (Leica CTR6500) for system calibration.
Figure 5. System calibration results from a series of dilution concentrations of IAV viral plasmid DNA. (a) Fluorescence distribution of droplets after ddPCR reactions at different cDNA concentrations. The target DNA used in this experiment is IAV viral plasmid DNA: (i) initial concentration (1 out of 30 images), (ii) diluted 104 times (1 out of 19 images), (iii) diluted 105 times (1 out of 14 images), and (iv) without a DNA template (1 out of 17 images). The scale bar represents 200 µm. (b) The measured concentration results were calculated based on the fluorescent droplet counting results, and the number of fluorescence droplets was detected using MATLAB software (see Figure 4). The linear fitting result R2 = 0.9959 shows the detected concentration results from the reported device were consistent with the gradient–dilution factor. The images were captured by a fluorescence microscope (Leica CTR6500) for system calibration.
Biosensors 14 00002 g005
Figure 6. (a) Concentration measurements of three viral plasmid DNA on the ddPCR LOAD device (template: infectious virus plasmid). (b) Detection results of five human infectious samples on the ddPCR LOAD device. Abbreviations: RSV, respiratory syncytial virus; SF, scarlet fever; DENV-I, dengue virus type I; IAV, influenza A virus; ADV, adenovirus; ZIKV, Zika virus; VZV, varicella zoster virus, and NC, negative control.
Figure 6. (a) Concentration measurements of three viral plasmid DNA on the ddPCR LOAD device (template: infectious virus plasmid). (b) Detection results of five human infectious samples on the ddPCR LOAD device. Abbreviations: RSV, respiratory syncytial virus; SF, scarlet fever; DENV-I, dengue virus type I; IAV, influenza A virus; ADV, adenovirus; ZIKV, Zika virus; VZV, varicella zoster virus, and NC, negative control.
Biosensors 14 00002 g006
Figure 7. Proof-of-concept on-site validation of the integrated ddPCR-LOAD device. (a,b) Clinical droplet digital PCR based on different concentrations of the influenza A virus (IAV). The scale bar represents 200 µm. The number of positive droplets increases when increasing the DNA concentration. (c) Detection results of the on-disc fluorescent imaging system. Abbreviation: NC, negative control.
Figure 7. Proof-of-concept on-site validation of the integrated ddPCR-LOAD device. (a,b) Clinical droplet digital PCR based on different concentrations of the influenza A virus (IAV). The scale bar represents 200 µm. The number of positive droplets increases when increasing the DNA concentration. (c) Detection results of the on-disc fluorescent imaging system. Abbreviation: NC, negative control.
Biosensors 14 00002 g007
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Zhang, W.; Cui, L.; Wang, Y.; Xie, Z.; Wei, Y.; Zhu, S.; Nawaz, M.; Mak, W.-C.; Ho, H.-P.; Gu, D.; et al. An Integrated ddPCR Lab-on-a-Disc Device for Rapid Screening of Infectious Diseases. Biosensors 2024, 14, 2. https://doi.org/10.3390/bios14010002

AMA Style

Zhang W, Cui L, Wang Y, Xie Z, Wei Y, Zhu S, Nawaz M, Mak W-C, Ho H-P, Gu D, et al. An Integrated ddPCR Lab-on-a-Disc Device for Rapid Screening of Infectious Diseases. Biosensors. 2024; 14(1):2. https://doi.org/10.3390/bios14010002

Chicago/Turabian Style

Zhang, Wanyi, Lili Cui, Yuye Wang, Zhenming Xie, Yuanyuan Wei, Shaodi Zhu, Mehmood Nawaz, Wing-Cheung Mak, Ho-Pui Ho, Dayong Gu, and et al. 2024. "An Integrated ddPCR Lab-on-a-Disc Device for Rapid Screening of Infectious Diseases" Biosensors 14, no. 1: 2. https://doi.org/10.3390/bios14010002

APA Style

Zhang, W., Cui, L., Wang, Y., Xie, Z., Wei, Y., Zhu, S., Nawaz, M., Mak, W. -C., Ho, H. -P., Gu, D., & Zeng, S. (2024). An Integrated ddPCR Lab-on-a-Disc Device for Rapid Screening of Infectious Diseases. Biosensors, 14(1), 2. https://doi.org/10.3390/bios14010002

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop