Next Article in Journal
Boosting the Energetic Performance of Trinitromethyl-1,2,4-oxadiazole Moiety by Increasing Nitrogen-Oxygen in the Bridge
Previous Article in Journal
Molecular Pathways in Pulmonary Arterial Hypertension
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Qualitative and Quantitative Real-Time PCR Methods for Assessing False-Positive Rates in Genetically Modified Organisms Based on the Microbial-Infection-Linked HPT Gene

1
Key Laboratory of Agricultural Genetically Modified Organisms Traceability, Ministry of Agriculture and Rural Affairs, Oil Crops Research Institute of Chinese Academy of Agricultural Science/Supervision and Test Center (Wuhan) for Plant Ecological Environment Safety, Ministry of Agriculture and Rural Affairs, Wuhan 430062, China
2
School of Life Sciences, Hubei University, Wuhan 430062, China
3
Nanjing Institute of Environmental Sciences, Ministry of Ecology and Environment of the People’s Republic of China, Nanjing 210042, China
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Int. J. Mol. Sci. 2022, 23(17), 10000; https://doi.org/10.3390/ijms231710000
Submission received: 22 July 2022 / Revised: 25 August 2022 / Accepted: 29 August 2022 / Published: 2 September 2022
(This article belongs to the Section Molecular Genetics and Genomics)

Abstract

:
The hygromycin phosphotransferase (HPT) gene as a selective marker is normally used in screening tests as a first step in detecting and quantifying genetically modified organisms (GMOs) in seeds, food, and feed materials. Nevertheless, if researchers only focus on the HPT gene, it is difficult to distinguish genetically modified (GM) crops from microbial infection, leading to miscalculation of the rate of GM materials in a given sample set. Here, we cloned the 7259 bp sequence carrying the HPT gene from soybean sprouts using the genome walking strategy. BLAST analysis revealed that this sequence was derived from plasmids naturally occurring in microorganisms, such as Escherichia coli, Klebsiella pneumoniae or Salmonella sp. Using the reconstructed plasmid pFP-hpt, qualitative PCR and quantitative real-time PCR (qPCR) methods were established, and 261 bp and 156 bp products were produced. The specificity of these assays was assessed against related pFP-hpt plasmids, plant species with important agronomic traits, and GM crops containing the HPT gene. No unexpected results were observed between samples using these qualitative PCR and qPCR methods. The sensitivity of this qualitative PCR assay was determined at 20 copies, while the limit of detection (LOD) and limit of quantification (LOQ) of qPCR were both 5 copies per reaction. Our in-house validation indicated that the amplification efficiency, linearity, and repeatability of this qPCR assay were in line with performance requirements. Furthermore, a qualitative and quantitative duplex PCR showed high reliability for the simultaneous detection of the HPT gene in a plant sample and environmental micro-organisms harboring the HPT gene in one PCR reaction. These qualitative PCR and qPCR assays were able to differentiate between plants infected with E. coli harboring the HPT gene from GM plants, indicating that these two methods are broadly applicable for routine GMO testing.

1. Introduction

Due to the annual increase in the variety and number of genetically modified (GM) plants, monitoring and management systems for seeds, food, and feed products for the presence of GMOs are enforced in many countries worldwide, which require reliable and cost-effective detection methods. DNA analysis based on polymerase chain reaction (PCR) is routinely performed to assess the presence or absence of GMOs. Several common genetic elements present in many GMOs, such as the CaMV35S promoter derived from the cauliflower mosaic virus and the NOS terminator derived from Agrobacterium tumefaciens, as well as selectable markers including the pat/bar gene, the HPT gene, and the neomycin phosphotransferase type II (NPTII) gene from Bacillus thuringiensis, are usually selected as detection targets in GMO screening [1,2,3]. These elements are commonly derived from naturally occurring viruses, bacteria, fungi, and plants. A positive detection result with an element screening assay is sometimes but not always a confirmation of the presence of transgenic DNA in a sample. In China, the state has adopted a zero-tolerance policy for the management of GMOs that have not yet been approved for commercial use. Once the false-positive results of element-screening tests are adopted, the producers or operators will be penalized according to the Agricultural GMO Safety Management Regulations. The laboratory that performed the testing will also be subject to penalties in cases of fraud or negligence in judging the results. Therefore, a specific test method is required to avoid false-positive results due to the presence of naturally occurring organisms that happen to be the donor organism for the genetic element being assessed.
PCR-based methods, such as conventional PCR, qPCR, and multiplex quantitative PCR, have been demonstrated to be able to detect cauliflower mosaic virus (CaMV) and figwort mosaic virus (FMV) DNA to differentiate between GMOs and the natural occurrence of transgenic elements of the CaMV35S and FMV35S promoters, respectively [4,5,6,7,8,9]. The selection of selectable marker genes is one of the most important factors for the success of plant genetic transformation and positive offspring screening [10]. As a commonly used selection marker, the HPT gene is widely used in the transformation of monocot plants, including rice [11], maize [12], wheat [13,14], and barley [15]. Several GM plants harboring the HPT gene are in the stage of productivity test or have been approved as imported processed raw materials in China, such as Kefeng 6, Kemingdao, or COT102. However, many more plants with the HPT gene are currently being experimentally investigated, which are considered unauthorized GMOs. The HPT gene is derived from E. coli, which is universally present in nature and can readily infect genetically modified seeds, food, and feed, especially for the rice samples. It is therefore probable that food, feed or seed materials are contaminated by the HPT gene from E. coli, which can cause false-positive results in PCR tests targeting the HPT element as a GM marker. The HPT gene was expressed by the CaMV35S promoter and NOS terminator in many transgenic plants. In daily multiple-element-screening tests, transgenic testing laboratories encountered situations where only the HPT gene was detected, and due to the lack of an HPT gene false-positive detecting method, it was difficult for them to make a correct judgment.
Since qualitative PCR and qPCR methods that can distinguish GMOs from the natural occurrence of transgenic elements for the HPT gene have not been published, there is an urgent requirement by GMO testing laboratories for establishing HPT gene false-positive test systems. In the present study, a 7259 bp sequence including the HPT gene, which was highly homologous to the plasmid sequences of Escherichia coli, Klebsiella pneumoniae, and Salmonella sp., was cloned from soybean sprouts. Qualitative PCR and qPCR methods are presented that allow the detection of plasmid-DNA-specific regions between the HPT gene and its 5′-flanking sequence. The qualitative PCR assay targets a 261 bp sequence of the plasmid-DNA-specific region, and qPCR assay detecting fragment is shortened to 156 bp within the 261 bp region. This newly developed assay can be used to verify that a positive HPT screening result is caused by the presence of E. coli carrying HPT and not due to a GM plant event in a given sample with good sensitivity and specificity.

2. Results

2.1. Routine Detection of GMO in Soybean Sprouts

Soybean sprouts purchased from a local market were first investigated by screening PCR in routine analysis. We chose them because they had tested positive for the HPT gene found in GM crops [16]. However, no other GMO elements could be detected using soybean event-specific PCR methods, as well as other screening elements (CaMV35S promoter, NOS terminator, Cp4-epsps, bar and pat). We speculated that the sample was infected by environmental microorganisms harboring the HPT gene often found on processed vegetables.

2.2. Isolation and Characterization of the HPT Gene Sequence

To obtain the complete HPT gene and flanking sequences, a genome walking PCR strategy was adopted to determine novel and unknown sequences adjacent to HPT. A 7259 bp fragment was obtained by overlapping two derived fragments with the HPT gene. BLAST analysis revealed that 7259 bp of the isolated sequence was highly homologous to plasmid DNA found in Escherichia coli, Klebsiella pneumoniae, and Salmonella sp., with sequence identity of about 98.1%. Ten plasmid DNA sequences were then collected from Genebank: six Klebsiella pneumoniae strains MH15-269 (Accession No. AP023338.1), AR0125 (Accession No. CP021858.1), AR0113 (Accession No. CP021755.1), AR0112 (Accession No. CP021547.1), AR0115 (Accession No. CP021547.1), and CAV1596 (Accession No. CP011644.1); three Escherichia coli strains TD-33 (Accession No. MN915013.1), GD-33 (Accession No. MN915011.1), TJ-33 (Accession No. MN915010.1); and one Salmonella sp. (Accession No. CP071694.1). Homologous sequence alignment indicated that these conserved regions exhibited some single nucleotide polymorphisms (SNP) (Supplementary Figure S1). Although HPT genes from the plasmid DNA of microorganisms and the isolated sequence had some SNPs (Supplementary Figure S2), they simultaneously all still probably encoded hygromycin B phosphotransferase (Supplementary Figure S3).

2.3. Design of Primers and Probes

Based on this sequence alignment, a conserved fragment was found to be present in all collected sequences from microorganisms in this study. Therefore, multiple candidate primer/probe sets were designed based on these conserved segments without any SNPs, targeting the junction site between the 5′-plasmid DNA sequence and the HPT gene. This segment was then constructed into a pFP-hpt plasmid. The forward primer bound to 5′-plasmid DNA, while the reverse primer binding site was in the HPT gene adjacent to the plasmid DNA. The probe bound to the junction between the 5′-plasmid DNA sequence and the HPT gene fragment. The locations of primers and probes for qualitative and qPCR methods are shown in Figure 1, and details of primers and probes can be found in Table S1. To select the best primer/probe set, all possible primer and probe combinations were tested for application size and specificity using 500 copies of pFP-hpt as a template. The most efficient, reliable, and stable qualitative/quantitative PCR primer/probe sets were Ghpt-F3/Ghpt-R3 and Ghpt-QF3/Ghpt-QR3/Ghpt-QP, yielding 261 bp and 156 bp size products, respectively (Table S3).

2.4. Specificity and Sensitivity Test of Singleplex Qualitative

The sequence of the primer set of Ghpt-F3/Ghpt-R3, generating a 261 bp amplicon product, was next analyzed using BLAST. The sequence was mainly homologous to the plasmid DNA found in E. coli, K. pneumoniae, Salmonella sp., and the genomic DNA of Proteus mirabilis, with 100% identity (Supplementary Figure S4). No sequence homology was observed with related non-target organisms, such as plant viruses or crop plants. The amplification specificity of the primer set Ghpt-F3/Ghpt-R3 was tested using genomic DNA from non-transgenic plants (Arabidopsis thaliana, soybean, maize, peanuts, rice, rapeseed, cotton, wheat, sugar beet, and tomato), GM rice harboring HPT gene (Kefeng 6, Kemingdao and SD rice), GM rice (TT51-1 and G6H1), GM soybean mixed sample, GM maize mixed sample, GM rapeseed mixed sample, GM cotton mixed sample, and plasmid DNA (pFP-hpt). The results are presented in Table 1. Plant endogenous genes from 18S rRNA [17] have been observed in specific amplification bands. However, the 261 bp target fragment and 472 bp of HPT gene from GM crops have not been observed from plant species, GM rice (TT51-1 and G6H1), GM soybean mixed sample, GM maize mixed sample, GM rapeseed mixed sample, and GM cotton mixed sample in similar assays. Electrophoresis showed that a unique 261 bp fragment was amplified from pFP-hpt plasmid, but there was no amplification observed from Kefeng 6, Kemingdao, and SD rice (Figure 2a). Specificity tests indicated qualitative PCR amplification using the primer set Ghpt-F3/Ghpt-R3 could reliably and specifically detect micro-organisms carrying the HPT gene.
In practice, DNA extracted from GM food or feed tends to be commonly infected or contaminated with trace levels of microorganisms. To evaluate the sensitivity of our new qualitative assay system, pFP-hpt plasmid DNA was serially diluted from 500, 100, 50, 20, and 10 copies per microliter and used as a template for PCR analysis. Specific products at 261 bp could be observed in reactions with as few as 20 copies of pFP-hpt as a template (Figure 2b). These results indicate that the detection sensitivity of the qualitative method established in this research was as low as 20 copies.

2.5. Determination of the Applicability of Qualitative PCR

To verify the applicability of this new qualitative PCR method, a routine testing sample was numbered 2519, set as a blind sample, and investigated in detail. pFP-hpt plasmid and SD rice were used as positive and negative controls, respectively. The material consisting of extracted rice seed was determined to be positive for the presence of the HPT gene, yielding a 472 bp product (Figure 3a). However, it could not be assigned to a GM plant event due to the absence of other screening elements or GM-specific events. Therefore, the material was analyzed with conventional PCR using the primer set Ghpt-F3/Ghpt-R3. Specific 261 bp products from rice sample 2519 and pFP-hpt were observed by electrophoresis (Figure 3b). To confirm the specificity of fragment, the obtained PCR product was sequenced using both forward and reverse primers from this qualitative assay. The sequence alignment of the 261 bp amplicon showed 100% homology with major microbes from E. coli, K. pneumoniae, Salmonella sp., and Proteus mirabilis, which carried the complete HPT gene in a plasmid or genomic DNA by further alignment analysis (Supplementary Figure S4). These results reveal that the qualitative PCR assay established in this research could be applied to exclude false positives for the HPT gene during routine GM analysis.

2.6. Verification of qPCR Specificity

The sequence of primer/probe set Ghpt-QF3/Ghpt-QR3/Ghpt-QP was next evaluated for use in qPCR. Based on the above analysis, this 156 bp fragment was specific. The experimental specificity of qPCR assay was tested in the same way as that of our qualitative PCR method. There were no positive signals observed in the plant species, GM rice (TT51-1 and G6H1), GM soybean mixed sample, GM maize mixed sample, GM rapeseed mixed sample, and GM cotton mixed sample using qPCR detection for Ghpt-QF3/Ghpt-QR3/Ghpt-QP and the HPT gene (Table 1). Only pFP-hpt plasmid DNA was amplified with the primer/probe set Ghpt-QF3/Ghpt-QR3/Ghpt-QP, and no positive signals were observed in GM rice harboring HPT gene (Kefeng 6, Kemingdao, and SD rice). These results indicate that qPCR could be used to specifically detect microorganisms carrying the HPT gene.

2.7. Standard Curve and Repeatability of qPCR

To evaluate the amplification efficiency and linearity of our qPCR assay, a 10-fold series of dilutions of plasmid-pFP-hpt was prepared, corresponding to 500,000, 50,000, 5000, 500, and 50 copies/µL. The serial dilutions were used to establish a standard curve, and each dilution was assayed in triplicate with three parallel reactions. Standard curves were created by plotting Ct values against the logarithm of pFP-hpt plasmid copy numbers. There was a good agreement observed between the quantity of the template and the Ct values, with R2 values between 0.999 and 1.000. The slope of the standard curve was calculated between −3.27 to −3.369, with corresponding amplification efficiencies of 98.10% to 99.70% (Figure 4, Table 2). These data met the minimum performance requirements for analytical methods defined by the European Network of GMO Laboratories [18].
The repeatability of the qPCR system was analyzed using these standard curves as described above. With the reduction in plasmid template from 500,000 to 50 copies, the average Ct values of the real-time assay increased from 21.41 to 34.77, with RSD values ranging from 0.24% to 0.99%, and the relative repeatability standard deviation (RSDr) ranging from 0.03% to 0.30% (Table 3). These results also comply with the minimum performance requirements for analytical methods defined by the European Network of GMO Laboratories [18] and reveal that the quantitative real-time PCR assay had good stability and reliability.

2.8. Limits of Detection and Quantification with qPCR

To determine the sensitivity of this qPCR method, the LOD and LOQ were next determined. The pFP-hpt plasmid was diluted to 50, 20, 10, 5, and 1 copies for analysis of 9 replicate real-time PCR reactions. The detection capacity of our quantitative assay decreased with decreasing template copy numbers (Table 4). All nine PCR replicates had typical amplification curves when the template copy number was 5, whereas only five reactions were positive when the template copy number was 1. Therefore, the LOD of this qPCR method was estimated to be five copies of plasmid. Relative repeatability standard deviation (RSDr) of Ct values from the nine replicates were all below 25% with the reduction in the template copy number. The LOQ of our method was approximately five copies of plasmid based on the implementation of the guidance document of the Joint Research Centre, Institute for Reference Materials and Measurements (JRC-IRMM). These results indicate that singleplex qPCR could be used to detect micro-organism infection carrying the HPT gene with high sensitivity but should not be used to accurately quantify the amount of infection.

2.9. Analysis of HPT-Positive Seed Material Using qPCR

The rice sample 2519 was also used to verify the applicability of our qPCR method. The pFP-hpt plasmid, non-transgenic rice, and sterile water were used as a positive control, negative control, and no template control, respectively. The results show that rice 2519 had a typical amplification curve with Ct values of less than 30, which correspond to approximately 500 copies of plasmid from an infected bacterium (Figure 5). The results of the 156 bp PCR product alignment are consistent with those of the 261 bp sequence produced using our qualitative method, as indicated by BLAST analysis. These results reveal that the qPCR assay developed in this paper could also be applied to exclude false positives for the HPT gene during routine GM analysis.

2.10. Development of a Qualitative and Quantitative Duplex PCR

The specificity of the designed primers/probes above were assessed using a singleplex PCR assay, as the conventional and real-time PCR methods that have been used in the field to detect the HPT gene were singleplex and tested for specificity [19]. Considering the time and cost of analysis, we developed a qualitative and quantitative duplex PCR test for simultaneous detection of the HPT gene from possible GM introduction and environmental micro-organisms harboring the HPT gene. Figure 6 shows the results of a qualitative duplex PCR with rice sample 2519 infected with environmental microorganisms. We have also developed a quantitative duplex test utilizing the two specific sets of primers and probes, one for the HPT gene and Ghpt-QF3/Ghpt-QR3/Ghpt-QP for the detection of environmental micro-organisms harboring the HPT gene (Table 5). Consequently, the combination of both targets, the HPT gene and environmental micro-organisms harboring the HPT gene, was viable in one PCR reaction system.

3. Discussion

Due to its extensive use as selectable marker gene in the first generation of GMOs, the HPT gene derived from E. coli has become the generally used PCR target for screening tests in routine GMO analysis [3]. In this study, only the HPT gene was detected from soybean sprouts in a routine test in our laboratory. For further analysis of whether this sample was a non-authorized GMO, the genome walking strategy was used to identify unknown sequences based on the HPT gene. Eventually, a 7259 bp sequence containing the HPT gene was retrieved after multiple rounds of PCR amplification. BLAST analysis revealed that this 7259 bp plasmid fragment might have derived from strains of E. coli, K. pneumoniae or Salmonella sp. The findings suggest that the presence of environmental micro-organisms in soybean sprouts resulted in the presence of the HPT gene in the samples. Determining whether the HPT gene is derived from genetically modified crops or nearby micro-organisms will require reliable and stable detection methods.
In recent years, transgenic testing laboratories have paid increasing attention to infection and cross-contamination during GMO detection from food, feed, and seeds. Formerly, conventional PCR methods based on ORF VI and ORF V were used to detect CaMV to distinguish P35S derived from CaMV or transgenic crops [4]. Real-time PCR and multiplex PCR methods targeting different conserved regions were designed to enhance the accuracy and coverage of CaMV detection [5,6,7,8]. Real-time PCR methods for the detection of figwort mosaic virus (FMV) were developed to complement the FMV 34S promoter-specific PCR assay used for the screening of GMOs in food and feed [9]. In addition, a QRT-PCR assay targeting the TMS1 region was successfully applied to distinguish elements such as T-nos, P-nos, and T-3′g7, which have been introduced by Agrobacterium sp. into GMOs plant events from natural Agrobacterium sp. [20].
Here, through integrating a 3207 bp sequence into a plasmid vector, we developed a novel plasmid as a positive sample, pFP-hpt, carrying 285 bp of the incomplete HPT gene and 2922 bp of the 5′ flanking sequence. A specific qualitative and qPCR assay targeting 261 bp and 156 bp between the HPT gene and its 5′flanking adjacent sequence, which were conserved sections without SNPs by limited alignment analysis, were established to complement HPT gene assays used for screening first generation GMOs. These qualitative and qPCR tests showed high specificity and sensitivity, even when a trace amount of the HPT gene from micro-organisms was present. Combining this with our previously validated HPT gene method [16], these assays can be applied to routine testing in the laboratory to avoid false positives of the HPT selectable marker. The LOD and LOQ of our qPCR assay were estimated to be five copies of plasmid DNA. In this paper, we demonstrated that the pFP-hpt plasmid prepared in this study can be used as an alternative standard for the quantification of the HPT gene from natural occurrences.
Generally, GMO detection is divided into two steps: element-screening PCR is often the initial step in GMO testing procedures. When results indicate the presence of specific genetic elements, identification or quantification of the GM plant is followed by event-specific assays [21]. This two-step detection procedure requires a large amount of time and reagents. The developed qualitative and quantitative duplex PCR could detect two targets in one PCR reaction at the same time, thereby reducing the reagent cost, shortening the detection time, improving the detection efficiency, and providing an effective method for the rapid detection of the HPT gene and micro-organisms harboring the HPT gene. This is the first study to attempt to avoid HPT gene false-positive tests derived from bacterial plasmids, and future work should be conducted on bacterial genomes carrying the HPT gene to improve false-positive exclusive detection systems. We will also expand the application of this method for daily detection in transgenic testing laboratories.

4. Materials and Methods

4.1. Materials

Soybean sprouts used for GMO screening and genome walking PCR were purchased from a local market in Wuhan. A. thaliana, sugar beet (Beta vulgaris), cotton (Gossypium hirsutum), soybean (Glycine max), rice (Oryza sativa), wheat (Triticum aestivum), maize (Zea mays), peanuts (Arachis hypogaea), rapeseed (Brassica napus), and tomato (Lycopersicon esculentum Mill) were used for specificity testing and were collected by our lab. The transgenic rice lines used in this study were TT51-1, G6H1, Kefeng 6, Kemingdao, and SD rice [22]. A GM soybean mixed sample (GTS40-3-2, MON89788, A5547-127, A2704-12, 356043, 305423, CV127, MON87701, MON87708, MON87769, MON87705, FG72, DAS81419-2; 1% (w/w) for each variety), GM maize mixed sample (Bt11, Bt176, MON810, MON863, GA21, NK603, T25, TC1507, MON89034, MON88017, 59122, MIR604, 3272, MON87460, DAS40278-9, 4114, MON87427, 5307; 1% (w/w) for each variety), GM cotton mixed sample (MON1445, MON531, MON15985, LLCOTTON25, MON88913, GHB614, COT102; 1% (w/w) for each variety), and GM rapeseed mixed sample (MS1, MS8, RF1, RF2, RF3, T45, Oxy-235, Topas19/2, MON88302, 73496; 1% (w/w) for each variety) were provided by Development Center of Science and Technology, MARA. The routine testing sample for rice seed (2519) used in this research is commonly available.

4.2. DNA Extraction and Purification

For GMO screening of all samples and genome walking, genomic DNA was isolated and purified using the DNeasy Plant Maxi Kit (QIAGEN, Hilden, Germany) according to the manufacturer’s protocol. For qualitative and quantitative method in-house validation, genomic DNA was extracted and purified from young leaves or seeds of species plants using a cetyltrimethylammonium bromide (CTAB)-based protocol [23]. Plasmid DNA was prepared using the TIANprep mini plasmid kit (TIANGEN, Beijing, China) following the manufacturer’s recommendations. DNA concentrations were analyzed using a NanoDrop ONEc (Thermo Scientific, Waltham, MA, USA) spectrophotometer.

4.3. Genome Walking PCR

The complete HPT gene and its flanking sequence were isolated utilizing the GenomeWalker Universal Kit (Clontech, Mountain View, CA, USA) according to the manufacturer’s instructions. Gene-specific primers (GSPs) were designed according to the sequence of the HPT gene (Accession No. AF234296) and these isolated sequences. The primers designed for this study are listed in Table S3.
For genome walking, the first round of Genome Walker PCR was performed with primer sets wHPT1-1/AP1 and wHPT1-2/AP2, generating a fragment containing an incomplete HPT gene and a 5′-upstream unknown sequence adjacent to the HPT gene. Four successive rounds of Genome Walker PCR were carried out to isolate upstream unknown sequences, using primer pairs wHRSUW1-1/AP1 and wHRSUW1-2/AP2, wHRSUW2-1/AP1 and wHRSUW2-2/AP2, wHRSUW3-1/AP1 and wHRSUW3-2/AP2, and wHRSUW4-1/AP1 and wHRSUW4-2/AP2. The single, major PCR products were directly sequenced with the nested primers after purification by Sangon Biotech (Shanghai, China). The isolated sequences were verified by PCR amplification and then spliced using Vector NTI software (VectorNTIadvance11.5.1, Invitrogen, Waltham, MA, USA). A 5295 bp 5′-upstream fragment containing 173 bp of incomplete HPT was obtained by sequence assembly. After one round of PCR amplification, a 1306 bp 3′-downstream fragment, including 195 bp of incomplete HPT, was isolated using primer sets wHPT1+1/AP1 and wHPT1+2/AP2. Subsequently, a 5295 bp-upstream segment, the HPT gene (Accession No. AF234296), and a 1306 bp 3′-downstream segment were spliced using Vector NTI software (VectorNTIadvance11.5.1, Invitrogen, Waltham, MA, USA) to attain a final sequence of 7259 bp (Supplementary Table S1). The sequence was then analyzed using the Basic Local Alignment Search Tool (BLAST, https://blast.ncbi.nlm.nih.gov/Blast.cgi; accessed on 7 February 2020) [24]. Nucleotide BLAST was carried out using the blastn program on the GeneBank database.

4.4. Construction of a Reference Plasmid

After characterizing the isolated sequence, a 3207 bp sequence (Supplementary Table S2) consisting of 285 bp of the HPT gene sequence and its 2922 bp 5′ flanking DNA sequence were synthesized by Sangon Biotech and sub-cloned into plasmid vector pUC57, giving rise to the reference plasmid pFP-hpt. pFP-hpt was used for detecting false-positive GM plants due to micro-organism infection or sample contamination.

4.5. Primer and Probe Design

Qualitative PCR oligonucleotide primers were designed using the software Primer Premier Version 5.00 (PREMIER Biosoft International, Palo Alto, CA, USA). qPCR primers and TaqMan fluorescent probes were designed using the software Beacon Designer 8.0 (PREMIER Biosoft, USA). All the primers and probes were synthesized by Sangon Biotech (Table S3).

4.6. Qualitative PCR Conditions

Qualitative PCR amplifications were performed using a Bio-rad C1000 thermal cycler using an optimized PCR mixture including: 10× Taq Buffer, 2.5 mM MgCl2, 200 µM of each dNTP, 0.4 µM of each primer, 0.7 unit Taq DNA Polymerase (TIANGEN, Beijing, China), and 50 ng of genomic DNA or plasmid DNA. Then, 500 copies, 100 copies, 50 copies, 20 copies, or 10 copies were used as templates in a final volume of 25 µL.
In the duplex qualitative PCR assay, the reaction mixture (25 µL) contained 10× Taq Buffer, 2.5 mM MgCl2, 200 µM of each dNTP, 0.4 µM of, 0.4 µM of Ghpt-F3/Ghpt-R3, 0.7 units Taq DNA Polymerase (TIANGEN, Beijing, China), and 50 ng of genomic DNA or plasmid DNA (500 copies) as a template.
The PCR used the following program: a 95 °C initial denaturation step for 5 min; followed by 35 cycles of 95 °C denaturation for 30 s, 58 °C annealing for 30 s, and 72 °C extension for 30 s; and a 72 °C final extension for 7 min. The PCR products were electrophoresed on 2% agarose gels in 1× TAE buffer and stained with Ultro GelRed (Vazyme, Nanjing, China) for visualization.

4.7. qPCR Conditions

qPCR amplification was performed on a CFX96 Real-Time System (Bio-Rad Laboratories, Hercules, CA, USA). Fluorescence signals were monitored using CFX Manager ver. 1.6 (Bio-Rad). Data were analyzed using the CFX Manager ver. 1.6 (1.6.541.1028) software (Bio-Rad).
qPCR assay was performed in an optimized reaction system of 20 µL containing: 10 µL of 2× Premix Ex Taq (probe qPCR) (Takara, Kusatsu, Shiga, Japan), 0.4 µM primers, 0.2 µM probe, and 100 ng of genomic DNA or 5.2 × 103 copies of plasmid DNA as a template. The TaqMan probes used in these qPCR experiments were labelled with the fluorescent reporter 6-carboxy-fluorescein (FAM) and the non-fluorescent Black Hole Quencher 1 (BHQ1).
In the duplex qPCR assay, the reaction mixture (20 µL) contained 2× Premix Ex Taq (probe qPCR) (Takara, Kusatsu, Shiga, Japan), 0.4 µM of qHptF286/qHptR395 and Ghpt-QF3/Ghpt-QR3, 0.2 µM of HptR697 and Ghpt-QP, and 50 ng of genomic DNA or plasmid DNA (500 copies) as a template. The probe for HptR697 was labelled with Hexachlorofluorescein (HEX) and BHQ1, and the probe for Ghpt-QP was labelled with FAM and BHQ1.
All reactions were tested in triplicate with the same program: an initial denaturation step for 3 min at 95 °C, followed by 40 cycles or 50 cycles of 5 s at 95 °C (denaturation) and 1 min at 60 °C (annealing and extension). The fluorescence signal was measured after each annealing and extension step.

4.8. Specificity Tests

To evaluate the specificity of our qualitative and qPCR assays, non-GM plants, such as A. thaliana, soybean, maize, peanuts, rice, rapeseed, cotton, wheat, sugar beet, tomato, GM soybean mixed sample, GM maize mixed sample, GM rapeseed mixed sample, GM cotton mixed sample, GM rice including TT51-1, G6H1, Kefeng 6, Kemingdao, and SD rice, as well as a reconstructed plasmid for pFP-hpt, were all tested. The assay was considered specific when the anticipated amplification was detected for each sample.

4.9. Sensitivity Tests

To determine sensitivity of our qualitative PCR assay, the serial dilutions of the pFP-hpt plasmid from 500 copies to 10 copies were tested for each target. Two parallel reactions were performed.
To evaluate the LOD and LOQ for our qPCR assay, a plasmid DNA series with copy numbers from 50, 20, 10, 5, and 1 was used. Three parallel reactions were performed on nine replicates of PCR runs. The LOD was analyzed using the cycle threshold (Ct) values of each reaction and all replicates could be reliably detected. The LOQ was estimated as the lowest copy number with the relative standard deviation (RSD) of all replicates below 25% for the measured copy number in this assay.

5. Conclusions

In summary, the quantitative PCR and qPCR system demonstrated here was more sensitive and specific for the HPT of a bacterial donor during routine GM testing of materials such as seeds. Even though the frequency of HPT false-positive test results is not currently known, the methods here allow GMO testing laboratories to distinguish between the HPT gene from GM plants and naturally occurring bacteria.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/ijms231710000/s1.

Author Contributions

Writing—original draft preparation, Y.L.; data curation, F.X.; resources, C.Z. and X.L.; supervision, Y.W. and H.G.; investigation, J.L. and S.Z.; writing—review and editing, G.W.; funding acquisition, B.L. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the National Major Special Project of Breeding for Genetically Modified Organisms in China (No. 2016ZX08012-005) and the Innovation Project of Chinese Academy of Agricultural Sciences (No. 2060302-049-091).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

We thank Xuezhen Ren at the National Agro-tech Extension and Service Center for validating the applicability of the methods.

Conflicts of Interest

The authors have no conflict of interest to declare.

References

  1. Matsuoka, T.; Kuribara, H.; Takubo, K.; Akiyama, H.; Miura, H.; Goda, Y.; Kusakabe, Y.; Isshiki, K.; Toyoda, M.; Hino, A. Detection of recombinant DNA segments introduced to genetically modified maize (Zea mays). J. Agric. Food Chem. 2002, 50, 2100–2109. [Google Scholar] [PubMed]
  2. Dörries, H.H.; Remus, I.; Grönewald, A.; Grönewald, C.; Berghöf-Jager, K. Development of a qualitative, multiplex real-time PCR kit for screening of genetically modified organisms (GMOs). Anal. Bioanal. Chem. 2010, 396, 2043–2054. [Google Scholar] [PubMed]
  3. Randhawa, G.J.; Chhabra, R.; Singh, M. Multiplex PCR-Based Simultaneous Amplification of Selectable Marker and Reporter Genes for the Screening of Genetically Modified Crops. J. Agric. Food Chem. 2009, 57, 5167–5172. [Google Scholar] [PubMed]
  4. Wolf, C.; Scherzinger, M.; Wurz, A.; Pauli, U.; Hübner, P.; Lüthy, J. Detection of cauliflower mosaic virus by the polymerase chain reaction: Testing of food components for false-positive 35S-promoter screening results. Eur. Food Res. Technol. 2000, 210, 367–372. [Google Scholar]
  5. Cankar, K.; Ravnikar, M.; Zel, J.; Gruden, K.; Toplak, N. Real time polymerase chain reaction detection of cauliflower mosaic virus to complement the 35S screening assay for genetically modified organisms. J. AOAC Int. 2005, 88, 814–822. [Google Scholar]
  6. Chaouachi, M.; Fortabat, M.N.; Kebdani, N.; Audeon, C.; Romaniuk, M.; Bertheau, Y. An accurate real-time PCR test for the detection and quantification of cauliflower mosaıc virus (CaMV): Applicable in GMO screening. Eur. Food Res. Technol. 2008, 227, 789–798. [Google Scholar]
  7. Becker, R.; Ulrich, A. Improved detection and quantification of cauliflower mosaic virus in food crops: Assessing false positives in GMO screening based on the 35S promoter. Eur. Food Res. Technol. 2018, 244, 1861–1871. [Google Scholar]
  8. Bak, A.; Emerson, J.B. Multiplex quantitative PCR for single reaction genetically modified (GM) plant detection and identification of false positive GM plants linked to Cauliflower mosaic virus (CaMV) infection. BMC Biotechnol. 2019, 19, 73. [Google Scholar]
  9. Moor, D.; Liniger, M.; Grohmann, L.; Felleisen, R. Real-time PCR method for the detection of figwort mosaic virus (FMV) to complement the FMV 34S promoter-specific PCR assay used for screening of genetically modified plants. Eur. Food Res. Technol. 2012, 235, 835–842. [Google Scholar]
  10. Sundar, I.K.; Sakthive, N. Advances in selectable marker genes for plant transformation. J. Plant Physiol. 2008, 165, 1698–1716. [Google Scholar]
  11. Wakasa, Y.; Ozawa, K.; Takaiwa, F. Higher-level accumulation of foreign gene products in transgenic rice seeds by the callus-specific selection system. J. Biosci. Bioeng. 2009, 107, 78–83. [Google Scholar] [PubMed]
  12. Van den Elzen, P.J.; Townsend, J.; Lee, K.Y.; Bedbrook, J.R. A chimaeric hygromycin resistance gene as a selectable marker in plant cells. Plant Mol. Biol. 1985, 5, 299–302. [Google Scholar] [CrossRef]
  13. Ortiz, J.P.A.; Reggiardo, M.I.; Ravizzini, R.A.; Altabe, S.G.; Cervigni, G.D.L.; Spitteler, M.A.; Morata, M.M.; Elias, F.E.; Vallejos, R.H. Hygromycin resistance as an efficient selectable marker for wheat stable transformation. Plant Cell Rep. 1996, 15, 877–881. [Google Scholar] [PubMed]
  14. Yadav, D.; Shavrukov, Y.; Bazanova, N.; Chirkova, L.; Borisjuk, N.; Kovalchuk, N.; Ismagul, A.; Parent, B.; Langridge, P.; Hrmova, M.; et al. Constitutive overexpression of the TaNF-YB4 gene in transgenic wheat significantly improves grain yield. J. Exp. Bot. 2015, 66, 6635–6650. [Google Scholar] [CrossRef] [PubMed]
  15. Bartlett, J.G.; Alves, S.C.; Smedley, M.; Snape, J.W.; Harwood, W.A. High-throughput Agrobacterium-mediated barley transformation. Plant Methods 2008, 4, 22. [Google Scholar] [CrossRef]
  16. Lu, C.; Song, G.; Wu, G.; Wu, Y.; Cao, Y.; Li, J.; Luo, J. Detection of Genetically Modified Plants and Derived Products—Qualitative PCR Method for the Marker Genes. NPTII HPT and PMI. Announcement by the Ministry of Agriculture. No.1782-2-2012. 2012, pp. 1–9. Available online: http://www.bjstandard.com/standard/271346.html (accessed on 5 February 2013).
  17. Huang, X.; Gao, H.; Li, X.; Ling, X.; Zhu, S.; Chen, H.; Pan, L.; Cao, J.; Zhang, G. Detection of Genetically Modified Organisms and Derived Products—Qualitative Real-Time Polymerase Chain Reaction (PCR) Methods. GB/T 19495.4-2018. 2018. Available online: https://www.sdtdata.com/fx/foodcodex?p=tsLibCard&s=fcv1&act=doDownload (accessed on 17 September 2018).
  18. European Network of GMO Laboratories (ENGL). Definition of Minimum Performance Requirements for Analytical Methods of GMO Testing. 2015. Available online: http://gmo-crl.jrc.ec.europa.eu/guidancedocs.htm (accessed on 20 October 2015).
  19. Yue, Y.; Wu, G.; Wu, Y.; Lu, C. Development of qualitative PCR method targeting marker genes in transgenic plants. Chin. J. Oil Crop. Sci. 2011, 33, 280–289. [Google Scholar]
  20. Nabi, N.; Chaouachi, M.; Zellama, M.S.; Ben Hafsa, A.; Mrabet, B.; Saïd, K.; Fathia, H.S. A new QRT-PCR assay designed for the differentiation between elements provided from Agrobacterium sp. in GMOs plant events and natural Agrobacterium sp. bacteria. Food Chem. 2016, 196, 58–65. [Google Scholar]
  21. Holst-Jensen, A.; Rønning, S.B.; Løvseth, A.; Berdal, K.G. PCR technology for screening and quantification of genetically modified organisms (GMOs). Anal. Bioanal. Chem. 2003, 375, 985–993. [Google Scholar]
  22. Li, J.; Wu, Y.; Li, X.; Wang, Y.; Zhang, L.; Li, Y.; Wu, G. Developing a matrix reference material for screening of transgenic rice. Anal. Bioanal. Chem. 2015, 407, 9153–9163. [Google Scholar]
  23. Porebski, S.; Bailey, L.G.; Baum, B.R. Modification of a CTAB DNA extraction protocol for plants containing high polysaccharide and polyphenol components. Plant Mol. Biol. Rep. 1997, 15, 8–15. [Google Scholar] [CrossRef]
  24. Stephen, F.A.; Warren, G.; Webb, M.; Eugene, W.M.; David, J.L. Basic local alignment search tool. J. Mol. Biol. 1990, 215, 403–410. [Google Scholar]
Figure 1. Location of primer/probes on the sequence for qualitative and quantitative PCR methods for false-positive detection.
Figure 1. Location of primer/probes on the sequence for qualitative and quantitative PCR methods for false-positive detection.
Ijms 23 10000 g001
Figure 2. Assessment of the specificity and sensitivity of HPT qualitative PCR detection. (a) Testing of the amplification specificity of qualitative PCR. Lane M: DL 2000 DNA Marker. Lane 1: pFP-hpt plasmid, Lane 2: Kefeng6, Lane 3: Kemingdao, Lane 4: SD rice, and Lane 5: no template control; each template was run with two parallel reactions. (b) Sensitivity of the qualitative PCR assay. Lane M: DL 2000 DNA Marker. Lanes 1–6 correspond to 500, 100, 50, 20, 10, and 0 copies of pFP-hpt, respectively; each template was run with two parallel reactions.
Figure 2. Assessment of the specificity and sensitivity of HPT qualitative PCR detection. (a) Testing of the amplification specificity of qualitative PCR. Lane M: DL 2000 DNA Marker. Lane 1: pFP-hpt plasmid, Lane 2: Kefeng6, Lane 3: Kemingdao, Lane 4: SD rice, and Lane 5: no template control; each template was run with two parallel reactions. (b) Sensitivity of the qualitative PCR assay. Lane M: DL 2000 DNA Marker. Lanes 1–6 correspond to 500, 100, 50, 20, 10, and 0 copies of pFP-hpt, respectively; each template was run with two parallel reactions.
Ijms 23 10000 g002
Figure 3. Assessment of applicability for qualitative PCR detection. (a) Screening of HPT gene in routine samples. Lane M: DL 2000 DNA Marker. Lane 1: routine testing rice material 2519, Lane 2: SD rice as a positive control, Lane 3: pFP-hpt plasmid, and Lane 4: no template control; each template was run with two parallel reactions. (b) False-positive detection using primer set Ghpt-F3/Ghpt-R3. Lane M: DL 2000 DNA Marker. Lane 1: blind rice 2519, Lane 2: pFP-hpt plasmid as a positive control, Lane 3: SD rice, and Lane 4: no template control; each template was run with two parallel reactions.
Figure 3. Assessment of applicability for qualitative PCR detection. (a) Screening of HPT gene in routine samples. Lane M: DL 2000 DNA Marker. Lane 1: routine testing rice material 2519, Lane 2: SD rice as a positive control, Lane 3: pFP-hpt plasmid, and Lane 4: no template control; each template was run with two parallel reactions. (b) False-positive detection using primer set Ghpt-F3/Ghpt-R3. Lane M: DL 2000 DNA Marker. Lane 1: blind rice 2519, Lane 2: pFP-hpt plasmid as a positive control, Lane 3: SD rice, and Lane 4: no template control; each template was run with two parallel reactions.
Ijms 23 10000 g003
Figure 4. Amplification and standard curves for the quantitative PCR method using gradient-diluted pFP-hpt plasmid DNA as a template. (a,c,e): Amplification graph for the quantitative PCR assay using primer/probe set Ghpt-QF3/Ghpt-QR3/Ghpt-QP with three repetitions. (b,d,f) Standard curves for the quantitative PCR assay corresponding to (a,c,e), respectively. The copy numbers of pFP-hpt were 500,000, 50,000, 5000, 500, and 50 copies in each reaction.
Figure 4. Amplification and standard curves for the quantitative PCR method using gradient-diluted pFP-hpt plasmid DNA as a template. (a,c,e): Amplification graph for the quantitative PCR assay using primer/probe set Ghpt-QF3/Ghpt-QR3/Ghpt-QP with three repetitions. (b,d,f) Standard curves for the quantitative PCR assay corresponding to (a,c,e), respectively. The copy numbers of pFP-hpt were 500,000, 50,000, 5000, 500, and 50 copies in each reaction.
Ijms 23 10000 g004
Figure 5. Assessment of applicability for qPCR detection using primer/probe set of Ghpt-QF3/Ghpt-QR3/Ghpt-QP. (a–d) Amplification curve for pFP-hpt, routine testing rice material 2519, non-transgenic rice, and no template control, respectively.
Figure 5. Assessment of applicability for qPCR detection using primer/probe set of Ghpt-QF3/Ghpt-QR3/Ghpt-QP. (a–d) Amplification curve for pFP-hpt, routine testing rice material 2519, non-transgenic rice, and no template control, respectively.
Ijms 23 10000 g005
Figure 6. Results of qualitative duplex PCR amplification. Lane M: DL 2000 DNA Marker. Lane 1: no template control, Lane 2: non-GM rice, Lane 3: pFP-hpt plasmid, Lane 4: Kemingdao, and Lane 5: routine testing rice material 2519; each template was run with two parallel reactions.
Figure 6. Results of qualitative duplex PCR amplification. Lane M: DL 2000 DNA Marker. Lane 1: no template control, Lane 2: non-GM rice, Lane 3: pFP-hpt plasmid, Lane 4: Kemingdao, and Lane 5: routine testing rice material 2519; each template was run with two parallel reactions.
Ijms 23 10000 g006
Table 1. Results of specificity tests for qualitative PCR and qPCR assays from different species of plants.
Table 1. Results of specificity tests for qualitative PCR and qPCR assays from different species of plants.
Target Species Plant18S rRNAQualitative PCRqPCR
Ghpt-F3/R3HPT GeneGhpt-QF3/QR3/QPHPT Gene
Arabidopsis thaliana+
Soybean (Glycine max)+
Maize (Zea mays)+
Peanuts (Arachis hypogaea)+
Rice (Oryza sativa)+
Rapeseed (Brassica napus) +
Cotton (Gossypium hirsutum)+
Wheat (Triticum aestivum)+
Sugar beet (Beta vulgaris)+
Tomato (Lycopersicon esculentum Mill)+
GM soybean mixed sample+
GM maize mixed sample+
GM rapeseed mixed sample+
GM cotton mixed sample+
TT51-1+
G6H1+
Kefeng6+++
Kemingdao+++
SD rice+++
“+,” positive amplification; “−,” no amplification.
Table 2. Repeatability of characteristic parameters of standard curves from qPCR.
Table 2. Repeatability of characteristic parameters of standard curves from qPCR.
RepeatSlopeMeanSDRSD (%)R2MeanSDRSD (%)EfficiencyMeanSDRSD (%)
1−3.327−3.3410.0240.7170.9990.9990.0010.05899.70%99.17%0.0090.932
2−3.328 0.999 99.70%
3−3.369 1.000 98.10%
SD, standard deviation; RSD, relative standard deviation; R2, coefficient of determination.
Table 3. Repeatability of Ct values of standard curves from qPCR.
Table 3. Repeatability of Ct values of standard curves from qPCR.
Copy NumberRepeatCt ValueMean of Ct ValuesSDRSD (%)Mean of All Ct ValuesSDrRSDr (%)
123
500,000121.2821.5921.4021.420.160.7321.410.030.15
221.3421.5221.4221.430.090.42
321.3021.4421.3721.370.070.33
50,000124.5824.8224.7724.720.130.5124.730.010.03
224.6824.8024.7324.740.060.24
324.6624.8124.7324.730.080.30
5000127.9528.2028.1428.100.130.4628.060.030.11
227.9428.1328.0428.040.100.34
327.9428.1728.0628.060.120.41
500131.2431.6431.5831.490.220.6931.420.060.18
231.3731.5231.3131.400.110.34
331.3531.5231.2631.380.130.42
50134.6434.3835.0634.690.340.9934.770.110.30
234.6235.0434.5434.730.270.77
335.0334.8234.8334.890.120.34
Ct, cycle threshold.
Table 4. Estimation of LOD and LOQ of qPCR using serially diluted plasmid DNA.
Table 4. Estimation of LOD and LOQ of qPCR using serially diluted plasmid DNA.
Plasmid Copy NumberRepeatCt ValueMean of Ct ValuesSDRSD (%)Mean of All Ct ValuesSDrRSDr (%)
123
50134.7934.4534.3234.520.240.7034.590.060.17
234.8734.6834.3234.620.280.81
334.4635.1434.2534.620.471.34
20135.7535.6235.3235.560.220.6236.180.551.51
236.8136.1136.9236.610.441.20
336.0536.2536.7636.350.371.01
10137.0937.0736.6536.940.250.6736.750.340.94
235.7636.9736.3436.360.611.66
338.7736.3435.7936.971.594.29
5137.3237.3240.5838.411.884.9038.360.230.60
238.138.5737.6838.120.451.17
337.8340.4137.4738.571.604.16
1138.3438.4640.3139.041.102.8339.06//
2NA38.71NA38.71//
3NA39.44NA39.44//
NA, no amplification; /, no data.
Table 5. Results from duplex qPCR amplification.
Table 5. Results from duplex qPCR amplification.
SamplesCt Values of the HPT GeneCt Values of Microorganisms Assay
123123
no template controlNANANANANANA
non-GM riceNANANANANANA
plasmid of pFP-hptNANANA26.8326.7727.03
Kemingdao23.8823.7423.86NANANA
Routine testing rice 251928.6228.5428.6126.9126.9127.03
NA, no amplification.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Li, Y.; Xiao, F.; Zhai, C.; Li, X.; Wu, Y.; Gao, H.; Li, J.; Zhai, S.; Liu, B.; Wu, G. Qualitative and Quantitative Real-Time PCR Methods for Assessing False-Positive Rates in Genetically Modified Organisms Based on the Microbial-Infection-Linked HPT Gene. Int. J. Mol. Sci. 2022, 23, 10000. https://doi.org/10.3390/ijms231710000

AMA Style

Li Y, Xiao F, Zhai C, Li X, Wu Y, Gao H, Li J, Zhai S, Liu B, Wu G. Qualitative and Quantitative Real-Time PCR Methods for Assessing False-Positive Rates in Genetically Modified Organisms Based on the Microbial-Infection-Linked HPT Gene. International Journal of Molecular Sciences. 2022; 23(17):10000. https://doi.org/10.3390/ijms231710000

Chicago/Turabian Style

Li, Yunjing, Fang Xiao, Chao Zhai, Xiaofei Li, Yuhua Wu, Hongfei Gao, Jun Li, Shanshan Zhai, Biao Liu, and Gang Wu. 2022. "Qualitative and Quantitative Real-Time PCR Methods for Assessing False-Positive Rates in Genetically Modified Organisms Based on the Microbial-Infection-Linked HPT Gene" International Journal of Molecular Sciences 23, no. 17: 10000. https://doi.org/10.3390/ijms231710000

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop