Next Article in Journal
MiR-144: A New Possible Therapeutic Target and Diagnostic/Prognostic Tool in Cancers
Previous Article in Journal
Lysosomal Exocytosis, Exosome Release and Secretory Autophagy: The Autophagic- and Endo-Lysosomal Systems Go Extracellular
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
IJMS
Volume 21
Issue 7
10.3390/ijms21072574
ijms-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Development of a Novel, Genome Subtraction-Derived, SARS-CoV-2-Specific COVID-19-nsp2 Real-Time RT-PCR Assay and Its Evaluation Using Clinical Specimens

by
Cyril Chik-Yan Yip
1,†,
Chi-Chun Ho
2,†,
Jasper Fuk-Woo Chan
3,4,5,6,
Kelvin Kai-Wang To
3,4,5,6,
Helen Shuk-Ying Chan
7,
Sally Cheuk-Ying Wong
8,
Kit-Hang Leung
4,
Agnes Yim-Fong Fung
4,
Anthony Chin-Ki Ng
4,
Zijiao Zou
4,
Anthony Raymond Tam
9,
Tom Wai-Hin Chung
1,
Kwok-Hung Chan
3,4,6,
Ivan Fan-Ngai Hung
10,
Vincent Chi-Chung Cheng
1,
Owen Tak-Yin Tsang
11,
Stephen Kwok Wing Tsui
12 and
Kwok-Yung Yuen
3,4,5,6,*
1
Department of Microbiology, Queen Mary Hospital, HKSAR, Hong Kong, China
2
Genomics and Bioinformatics Programme, The Chinese University of Hong Kong, HKSAR, Hong Kong, China
3
State Key Laboratory of Emerging Infectious Diseases, The University of Hong Kong, HKSAR, Hong Kong, China
4
Department of Microbiology, The University of Hong Kong, HKSAR, Hong Kong, China
5
Department of Clinical Microbiology and Infection, The University of Hong Kong-Shenzhen Hospital, Shenzhen 518053, China
6
Carol Yu Centre for Infection, Li Ka Shing Faculty of Medicine, The University of Hong Kong, HKSAR, Hong Kong, China
7
Department of Medicine, Queen Elizabeth Hospital, HKSAR, Hong Kong, China
8
Department of Pathology, Queen Elizabeth Hospital, HKSAR, Hong Kong, China
9
Department of Medicine, Queen Mary Hospital, HKSAR, Hong Kong, China
10
Department of Medicine, The University of Hong Kong, HKSAR, Hong Kong, China
11
Department of Medicine and Geriatrics, Princess Margaret Hospital, HKSAR, Hong Kong, China
12
School of Biomedical Sciences, The Chinese University of Hong Kong, HKSAR, Hong Kong, China
 
add Show full affiliation list
 
remove Hide full affiliation list
*
Author to whom correspondence should be addressed.
†
These authors contributed equally to this work.
Int. J. Mol. Sci. 2020, 21(7), 2574; https://doi.org/10.3390/ijms21072574
Submission received: 27 March 2020 / Revised: 4 April 2020 / Accepted: 6 April 2020 / Published: 8 April 2020
(This article belongs to the Section Molecular Pathology, Diagnostics, and Therapeutics)
Browse Figure
Versions Notes

Abstract

The pandemic novel coronavirus infection, Coronavirus Disease 2019 (COVID-19), has affected at least 190 countries or territories, with 465,915 confirmed cases and 21,031 deaths. In a containment-based strategy, rapid, sensitive and specific testing is important in epidemiological control and clinical management. Using 96 SARS-CoV-2 and 104 non-SARS-CoV-2 coronavirus genomes and our in-house program, GolayMetaMiner, four specific regions longer than 50 nucleotides in the SARS-CoV-2 genome were identified. Primers were designed to target the longest and previously untargeted nsp2 region and optimized as a probe-free real-time reverse transcription-polymerase chain reaction (RT-PCR) assay. The new COVID-19-nsp2 assay had a limit of detection (LOD) of 1.8 TCID50/mL and did not amplify other human-pathogenic coronaviruses and respiratory viruses. Assay reproducibility in terms of cycle threshold (Cp) values was satisfactory, with the total imprecision (% CV) values well below 5%. Evaluation of the new assay using 59 clinical specimens from 14 confirmed cases showed 100% concordance with our previously developed COVID-19-RdRp/Hel reference assay. A rapid, sensitive, SARS-CoV-2-specific real-time RT-PCR assay, COVID-19-nsp2, was developed.

1. Introduction

Coronaviruses are positive sense, single-stranded RNA viruses that cause important diseases in human and animals [1]. In the past two decades, at least three novel human-pathogenic coronaviruses have crossed species barriers to cause major epidemics. These included severe acute respiratory syndrome coronavirus (SARS-CoV), Middle East respiratory syndrome coronavirus (MERS-CoV), and the most recently emerged severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) [2,3,4]. Emerging in late 2019, the novel Coronavirus Disease 2019 (COVID-19) caused by SARS-CoV-2 has disseminated rapidly around the globe and has been declared a pandemic [5,6]. By 27 March 2020, 465,915 confirmed cases have been reported to the World Health Organization (WHO) from 200 countries or territories, with 21,031 deaths (https://www.who.int/emergencies/diseases/novel-coronavirus-2019). The case fatality rate estimate ranged from about 1% in resource-rich settings, to up to 12% in epicentres [6]. Multiple clinical trials evaluating known and novel pharmacological agents have been in progress [7,8,9,10], and innovative epidemiological modelling and mechanistic exploratory studies have also been made available [11,12,13,14]; at the time of writing, there is no effective antiviral therapy of proven clinical benefit.
While widespread global transmission seemed inevitable, most countries continued to implement a containment strategy as advised by the WHO [15,16]; to this end, early testing and diagnosing symptomatic and asymptomatic infectious individuals [4,17], as well as testing of apparently recovered patients who may continue to shed the virus via various routes [18,19,20] remains essential to outbreak control. Various groups have made publicly available broadly-specific assays that target pan-coronaviruses, various members of the Sarbecovirus subgenus, or modified assays with specific oligonucleotide probes to achieve SARS-CoV-2 discrimination (https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/laboratory-guidance). With the identification of SARS-CoV-2 as the culprit viral species, a highly-specific assay, without cross-reactivity to closely-related viruses infecting humans such as the severe acute respiratory syndrome coronavirus (SARS-CoV) [21] and Middle East respiratory syndrome coronavirus (MERS-CoV) [22], is needed.
In this study, using the in-house developed program GolayMetaMiner (https://github.com/hkhcc/GolayMetaMiner) and our previously obtained SARS-CoV-2 genome data [23], we attempted to deduce species-specific targets that are conserved among globally detected SARS-CoV-2 isolates. With the identified targets, primers were designed and optimized for a highly sensitive real-time reverse transcription-polymerase chain reaction (RT-PCR) assay, eventually without the additional use of fluorescent reporter probes. The optimized assay was then evaluated on a variety of patient specimens. Finally, the potential application and significance of the newly-developed assay, as well as the known limitations, were discussed.

2. Results

2.1. Species-Specific SARS-CoV-2 Genomic Regions Identified by GolayMetaMiner

With default settings on an Intel® Core™ i7-2600 desktop computer equipped with a solid-state hard disk drive (k-mer size = 12, number of threads = 8), the genome subtraction run completes in about 25 s, after initial genome download from NCBI. As default parameters for bacterial target identification (uniqueness percentile cutoff = 99.99th centile) failed to report any targets with length > 50 nt, the uniqueness percentile score cutoff was progressively relaxed to the 98th centile considering the genome length of HKU-SZ-005b (29,891 bp).
The genome uniqueness/conservedness plot is shown in Figure 1. A total of four SARS-CoV-2 unique targets >50 nt in length (Table 1) were reported while other potential targets were too short and excluded by the program. The minimum, median and maximum uniqueness scores (U-scores) were 0.106, 0.566 and 0.810 with a 98th percentile cutoff at 0.730. The minimum, median and maximum conservedness scores (C-scores) were 0.782, 0.999 and 1.031 (> 1 due to overshoot of the 3rd order polynomial in the smoothing function).

2.2. Primer Selection for the SARS-CoV-2-Specific Real-Time RT-PCR Assay

The four reported targets (Table 1) were subjected to analysis using the GenScript real-time PCR (TaqMan) Primer and Probes Design Tool (https://www.genscript.com/tools/real-time-pcr-taqman-primer-design-tool) with default settings. Only one of the targets fulfilled the primer and probe design criteria (Target 1, Table 1). After initially optimizing the hydrolysis probe-based version of the assay to show that it reached the sensitivity of our previously published COVID-19-RdRp/Hel assay (data not shown), we used only the primers (nsp2f: 5′-ATGCATTTGCATCAGAGGCT-3′, nsp2r: 5′-TTGTTATAGCGGCCTTCTGT-3′), to develop the subsequent probe-free, COVID-19-nsp2 real-time RT-PCR assay.

2.3. Analytical Sensitivity of the Novel COVID-19-nsp2 Real-Time RT-PCR Assay

To determine the analytical sensitivity of the COVID-19-nsp2 assay, the limit of detection (LOD) was evaluated by using viral genomic RNA extracted from a culture isolate of SARS-CoV-2. Serial 10-fold dilutions of SARS-CoV-2 RNA extracted from the viral isolate were prepared and tested in triplicate in two independent runs. The LOD of the COVID-19-nsp2 assay was 1.8 TCID50/mL (Table 2).

2.4. Analytical Specificity of the COVID-19-nsp2 Assay

To investigate whether the novel COVID-19-nsp2 assay would non-specifically amplify other human-pathogenic coronaviruses and respiratory viruses, we tested total nucleic acid (TNA) extracted from a clinical respiratory specimen with HCoV-HKU1, and TNAs extracted from 17 culture isolates of SARS-CoV, MERS-CoV, HCoV-OC43, HCoV-229E, HCoV-NL63, respiratory syncytial virus, human metapneumovirus, influenza A ((H1N1)pdm09 and H3N2) viruses, influenza B virus, influenza C virus, parainfluenza viruses types 1 to 4, rhinovirus and human adenovirus. This assay did not show cross reactivity with these viruses.

2.5. Imprecision of the COVID-19-nsp2 Assay

Using TNA extracted from SARS-CoV-2 isolate at different concentrations, the new COVID-19-nsp2 assay was performed in triplicate for each concentration to evaluate the intra- and inter-assay variations. The total imprecision (% CV) was 1.19% at the lowest concentration tested (Table 3).

2.6. Diagnostic Performance Evaluation of the COVID-19-nsp2 Assay for the Detection of SARS-CoV-2 RNA in Clinical Specimens

To evaluate the diagnostic performance of the assay, 59 clinical specimens (23 positive and 36 negative) from 14 confirmed cases (defined as at least one respiratory specimen positive for SARS-CoV-2 by our previously established COVID-19-RdRp/Hel assay) [24] were used. The negative specimens included extrapulmonary (e.g., urine, rectal swab) and respiratory tract specimens that were collected during the later phase of illness when the viral load gradually decreased/became negative. Twenty-three were positive (including 22 respiratory specimens and 1 stool specimen, with Cp values ranged from 18.69 to 36.21) and 36 were negative (including four respiratory and 32 non-respiratory specimens) by the COVID-19-nsp2 assay. The melting curve from COVID-19-nsp2-positive specimens showed a unique peak with the melting temperature of around 80 °C. The results from the two assays were 100% concordant, and no additional positive result was detected from the specimens previously tested negative by the COVID-19-RdRp/Hel assay.

3. Discussion

Early in the COVID-19 outbreak, when the virus was reported to be related to the SARS-CoV and the exact genomic variation of the virus was not adequately known [25], multiple groups developed and published assays based on conserved regions that could potentially detect additional coronaviruses [26,27] (see also https://www.who.int/emergencies/diseases/novel-coronavirus-2019/technical-guidance/laboratory-guidance). The advantage of the traditional approach was two-fold: first, it was a more certain method to detect a novel member of the clade and avoided missing cases clinically; second, as SARS-CoV-2 positive control specimens were not globally available at the beginning of the pandemic, laboratories that did not have a species-specific positive control could use other existing positive controls such as SARS-CoV to ensure the performance of their assays.
In the present study, we demonstrated that the diagnostic performance of the hydrolysis probe-free COVID-19-nsp2 assay was comparable to that of our previously developed COVID-19-RdRp/Hel assay [24]. A major novelty of the current approach was the application of genome subtraction to deduce a previously untargeted region of the viral genome encoding nsp2 and subsequent adoption in a diagnostic assay. To our knowledge, no SARS-CoV-2 assay targeting the nsp2 coding region has been published previously. The current nsp2 assay was highly specific (without cross-reaction with other common respiratory viruses) and comparable to the COVID-19-RdRp/Hel assay in terms of analytical sensitivity. The diagnostic sensitivity and specificity of the nsp2 assay was 100% in comparison with the COVID-19-RdRp/Hel assay in this study. The reproducibility, in terms of Cp values, was satisfactory with both intra- and inter-assay coefficient of variation values well below the 5% cutoff specified in literature [28,29]. Furthermore, the PCR reaction time of the nsp2 assay was within an hour, which is shorter than that of the previously developed COVID-19-RdRp/Hel assay [24]; this is a distinct advantage in clinical laboratories, as rapid results can facilitate the timely triage of suspected COVID-19 cases and guide infection control and patient management. In terms of functional significance, the nsp2 region highlighted by genome subtraction corroborated with a recent modeling study which suggested that positively selected regions within the nsp2 protein could contribute to the pathogenicity of the virus [30].
As COVID-19 unfolded into a pandemic, rapid, robust and sensitive diagnostic testing became a priority in containment-based control strategies. While antibody-based testing has been developed [31] and even made commercially available as point-of-care testing kits [32], they lack sensitivity in detecting early infection before the host has successfully mounted a humoral response [33], cannot be applied to certain specimen types (such as urine [19], as antibodies cannot be secreted into the glomerular filtrate unless the patient develops severe renal damage) and cannot be used to determine when the host ceases to become infectious [34]. As nucleic acid amplification-based testing allows exquisite sensitivity (1.8 TCID50/mL in our case) and can be readily adopted in laboratories with basic molecular facilities, it is an essential tool in the clinical management and triage of patients. The robust design of the optimized assay, requiring only one pair of SARS-CoV-2-specific primers to diagnose COVID-19 infection in humans, avoids the potential logistics, reagent and manpower constraints in performing multiple or cascade testing or the use of relatively costly reporter probes. In developed countries where medical resources have become critically limited [35,36], it is believed that this new assay may be adopted to allow for the testing of more patients in a shorter time.
While we have validated the primer set against all publicly available SARS-CoV-2 genomes (Supplementary Materials) and found the proposed nsp2 target to be 100% conserved, it is possible that with random genetic drift, certain sub-clones of the virus may eventually develop mutations and escape detection. As SARS-CoV-2 is an RNA virus, which typically has a relatively high mutation rate (10−4 nucleotide substitutions per site per year for coronaviruses [37]), this is a distinct possibility that must be considered. However, with the use of less-specific assays, such as pan-coronavirus primers [38], the diagnostic laboratory can adopt a two-tier approach by first attempting to confirm infection using the new nsp2 assay, and subsequently use the broadly-specific assays on clinically suspicious cases to rule out SARS-CoV-2 infection. Finally, GolayMetaMiner is available as a free and open-source software that can be applied efficiently to newly deduced mutant sequences. Using the software tool, degenerate bases may be strategically incorporated into the COVID-19-nsp2 assay primers to broaden the specificity, or additional targets may be iteratively identified from further coronavirus pan-genome analyses.

4. Materials and Methods

4.1. SARS-CoV-2 Genome Subtraction Using GolayMetaMiner

The GolayMetaMiner software was initially developed with the School of Biomedical Sciences, The Chinese University of Hong Kong as an in-house software for the design of species- and species-group specific molecular assays for Mycobacterium species for the Department of Microbiology, Queen Mary Hospital, and was improved upon the a previously published software, ssGeneFinder [39,40,41]. The GolayMetaMiner software first downloads the genomes of the target and non-target species from the NCBI nucleotide database and generates a pool of nucleotide k-mers (k = 12 by default) for both forward and reverse directions of the non-target genomes. Next, the program steps through the forward strand of the target genome (--primary_target) and assign a binary uniqueness value of either 1 (k-mer is unique to the target genome) or 0 (k-mer is found in the non-target pool). As a pathogen detection assay needs to account for potential genomic variability of the target pathogen, the GolayMetaMiner software then steps through the target genome to determine if the k-mer is also present in other intended targets (--secondary_targets or --secondary_target_list), adding a value of 1 (k-mer is present in a secondary target genome) or 0 (k-mer is absent in a secondary genome). The conservedness value is normalized to a maximum value of 1 by dividing this absent/present count by the total number of secondary target genomes. Before plotting the scores, the arrays of uniqueness and conservedness values are smoothed using an empirically optimized Savitzky–Golay filter (window size = 501, polynomial order = 3) and transformed to continuous scores (U-score, C-score), and a U-score cutoff is calculated according to a specified percentile cutoff (defaults to 99.99th).
In this study, GolayMetaMiner was executed under an Anaconda Python 3.7 environment (freely available from https://www.anaconda.com/distribution/) with the command line as follows: python gmm.py --primary_target MN975262.1 --secondary_target_list SARS-CoV-2_genomes.txt--non_target_ncbi_table coronaviridae_complete.csv --exclusion_string “Severe acute respiratory syndrome coronavirus 2” --reporting_centile 98. The longer of the two SARS-CoV-2 genomes sequenced by our group [23], HKU-SZ-005b, was used as the reference genome (--primary_target MN975262), and a list of accession numbers of publicly available SARS-CoV-2 genomes were used as secondary targets (--secondary_target_list SARS-CoV-2_genomes.txt); the accession number of the reference genome was manually commented out with a “#” to avoid double-counting the reference genome in estimating conservedness. Non-targets were specified by downloading a table of complete Coronaviridae genomes from the NCBI genome browser (https://www.ncbi.nlm.nih.gov/genome/browse#!/viruses/) and passed to the program as a CSV file (--non_target_ncbi_table coronaviridae_complete.csv). An exclusion string was added to exclude entries marked as SARS-CoV-2 from the genome table (--exclusion_string “Severe acute respiratory syndrome coronavirus 2”). The genome U-score cutoff was empirically determined: if the default setting of 99.99th percentile could not yield any potential target, it would be progressively relaxed to 99.9th, 99th, 98th etc. As genome data could be automatically downloaded when the GolayMetaMiner was executed, no genome data was included with the software distribution to respect the rights of certain sequence owners. The lists of accession numbers of the 96 SARS-CoV-2 and 104 non-SARS-CoV-2 coronavirus genomes are available in Supplementary Materials. The complete Python 3 source code of the GolayMetaMiner software is freely available from the GitHub repository https://github.com/hkhcc/GolayMetaMiner.

4.2. Viruses and Clinical Specimens

SARS-CoV-2 was isolated from the nasopharyngeal aspirate specimen of a laboratory-confirmed COVID-19 patient in Hong Kong as previously described [42]. The viral isolate stock (1.8 × 107 50% tissue culture infective doses [TCID50]/mL) was prepared using VeroE6 cells as previously described [20,24,43]. For analytical sensitivity evaluation, TNA extracted from SARS-CoV-2 isolate was used. For analytical specificity evaluation, a clinical respiratory specimen of HCoV-HKU1 and 17 culture isolates of other human-pathogenic coronaviruses and respiratory viruses were used [24]. For assay performance evaluation, 59 archived clinical specimens (26 respiratory specimens including nasopharyngeal aspirate/swab, throat swab, endotracheal aspirate, sputum and saliva, and 33 non-respiratory specimens including plasma, urine, rectal swab/stool) from 14 patients with laboratory-confirmed COVID-19 were used [24]. These specimens were evaluated previously using the established COVID-19-RdRp/Hel assay [24]. The study was approved by Institutional Review Board of The University of Hong Kong/Hospital Authority (UW 13-372).

4.3. Nucleic Acid Extraction and RT-PCR for SARS-CoV-2

TNA extraction from clinical specimens and viral culture isolates was performed using NucliSENS easyMAG extraction system (BioMerieux, Marcy-l’Étoile, France) [24,44]. The volume of the specimens used for extraction and the elution volume depended on the specimen type and the amount of the specimen available as previously described [28,45,46].
Real-time RT-PCR assay for SARS-CoV-2 RNA detection was performed using QuantiNova SYBR Green RT-PCR Kit (QIAGEN, Hilden, Germany) and a LightCycler 480 II real-time PCR System (Roche, Basel, Switzerland) [4,20]. Each 20 μL reaction mixture contained 10 μL of 2× QuantiNova SYBR Green RT-PCR Master Mix, 0.2 μL of QN SYBR Green RT-Mix, 1 μL of each 10 μM forward and reverse primer, 2.8 μL of RNase-free water and 5 μL of TNA as the template. The thermal cycling condition was 10 min at 50 °C and 2 min at 95 °C, followed by 45 cycles of 5 s at 95 °C and 10 s at 60 °C, and then subjected to melting curve analysis (95 °C for 5 s, 65 °C for 1 min, followed by a gradual increase in temperature to 97 °C with continuous recording of fluorescence).

5. Conclusions

Using GolayMetaMiner genome subtraction, SARS-CoV-2-specific regions were successfully identified using 96 SARS-CoV-2 and 104 non-SARS-CoV-2 coronavirus genomes. Identified regions included a 154-nt conserved sequence in the nsp2 gene, which was absent in other human-pathogenic coronaviruses and has not previously been targeted in real-time RT-PCR assays of COVID-19. The highly specific and sensitive nsp2-based assay was validated using multiple viral culture isolates and clinical specimens. The newly developed assay, COVID-19-nsp2, and the associated genomic findings in this study will contribute to the control and understanding of the current COVID-19 outbreak.

Supplementary Materials

Supplementary materials can be found at https://www.mdpi.com/1422-0067/21/7/2574/s1. Supplementary File 1. List of NCBI GenBank accession numbers for target and non-target genome used for analysis.

Author Contributions

C.C.-Y.Y., C.-C.H., S.K.W.T. and K.-Y.Y. conceived and designed the experiments; C.-C.H. wrote the GolayMetaMiner software under supervision of S.K.W.T.; C.C.-Y.Y., J.F.-W.C., K.K.-W.T., H.S.-Y.C., S.C.-Y.W., K.-H.L., A.Y.-F.F., A.C.-K.N., Z.Z., A.R.T., T.W.-H.C., K.-H.C., I.F.-N.H., V.C.-C.C., O.T.-Y.T. collected the clinical specimens, performed the experiments, and/or analyzed the data; C.C.-Y.Y. and C.-C.H. verified the data; C.C.-Y.Y., C.-C.H., J.F.-W.C. and K.-Y.Y. wrote the paper. All authors revised and approved the final version of the manuscript.

Funding

This study was partly supported by the donations of Richard Yu and Carol Yu, the Shaw Foundation of Hong Kong, Michael Seak-Kan Tong, May Tam Mak Mei Yin, Respiratory Viral Research Foundation Limited, Hui Ming, Hui Hoy and Chow Sin Lan Charity Fund Limited, Chan Yin Chuen Memorial Charitable Foundation, Marina Man-Wai Lee, the Hong Kong Hainan Commercial Association South China Microbiology Research Fund, the Jessie & George Ho Charitable Foundation, and Perfect Shape Medical Limited; and funding from the Consultancy Service for Enhancing Laboratory Surveillance of Emerging Infectious Diseases and Research Capability on Antimicrobial Resistance for Department of Health of the Hong Kong Special Administrative Region Government; the Theme-Based Research Scheme (T11/707/15) of the Research Grants Council; Hong Kong Special Administrative Region; Sanming Project of Medicine in Shenzhen, China (No. SZSM201911014); and the High Level-Hospital Program, Health Commission of Guangdong Province, China. The funding sources had no role in the study design, data collection, analysis, interpretation, or writing of the report.

Conflicts of Interest

J.F.-W.C. has received travel grants from Pfizer Corporation Hong Kong and Astellas Pharma Hong Kong Corporation Limited, and was an invited speaker for Gilead Sciences Hong Kong Limited and Luminex Corporation. The other authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

Abbreviations

COVID-19Novel coronavirus infection
SARS-CoV-2Severe acute respiratory syndrome coronavirus 2
WHOWorld Health Organization
HCoVHuman coronavirus
SARS-CoVSevere acute respiratory syndrome coronavirus
MERS-CoVMiddle East respiratory syndrome coronavirus
RT-PCRReverse transcription-polymerase chain reaction
NCBINational Center for Biotechnology Information, USA
U-score(s)Uniqueness score(s)
C-score(s)Conservedness score(s)
LODLimit of detection
TNAntTotal nucleic acidnucleotide

References

  1. Chan, J.F.-W.; To, K.K.-W.; Tse, H.; Jin, D.-Y.; Yuen, K.-Y. Interspecies transmission and emergence of novel viruses: Lessons from bats and birds. Trends Microbiol. 2013, 21, 544–555. [Google Scholar] [CrossRef] [PubMed]
  2. Cheng, V.C.C.; Lau, S.K.P.; Woo, P.C.Y.; Yuen, K.Y. Severe acute respiratory syndrome coronavirus as an agent of emerging and reemerging infection. Clin. Microbiol. Rev. 2007, 20, 660–694. [Google Scholar] [CrossRef] [PubMed]
  3. Chan, J.F.W.; Lau, S.K.P.; To, K.K.W.; Cheng, V.C.C.; Woo, P.C.Y.; Yuen, K.-Y. Middle East respiratory syndrome coronavirus: Another zoonotic betacoronavirus causing SARS-like disease. Clin. Microbiol. Rev. 2015, 28, 465–522. [Google Scholar] [CrossRef] [PubMed]
  4. Chan, J.F.-W.; Yuan, S.; Kok, K.-H.; To, K.K.-W.; Chu, H.; Yang, J.; Xing, F.; Liu, J.; Yip, C.C.-Y.; Poon, R.W.-S.; et al. A familial cluster of pneumonia associated with the 2019 novel coronavirus indicating person-to-person transmission: A study of a family cluster. Lancet 2020, 395, 514–523. [Google Scholar] [CrossRef]
  5. WHO Announces COVID-19 Outbreak a pandemic. Available online: http://www.euro.who.int/en/health-topics/health-emergencies/coronavirus-covid-19/news/news/2020/3/who-announces-covid-19-outbreak-a-pandemic (accessed on 21 March 2020).
  6. Mizumoto, K.; Chowell, G. Estimating Risk for Death from 2019 Novel Coronavirus Disease, China, January-February 2020. Emerging Infect. Dis. 2020, 26, 6. [Google Scholar] [CrossRef]
  7. Cao, B.; Wang, Y.; Wen, D.; Liu, W.; Wang, J.; Fan, G.; Ruan, L.; Song, B.; Cai, Y.; Wei, M.; et al. A Trial of Lopinavir-Ritonavir in Adults Hospitalized with Severe Covid-19. N. Engl. J. Med. 2020. [Google Scholar] [CrossRef]
  8. Li, H.; Wang, Y.M.; Xu, J.Y.; Cao, B. Potential antiviral therapeutics for 2019 Novel Coronavirus. Zhonghua Jie He He Hu Xi Za Zhi 2020, 43, 170–172. [Google Scholar]
  9. Martinez, M.A. Compounds with therapeutic potential against novel respiratory 2019 coronavirus. Antimicrob. Agents Chemother. 2020. [Google Scholar] [CrossRef]
  10. Wang, M.; Cao, R.; Zhang, L.; Yang, X.; Liu, J.; Xu, M.; Shi, Z.; Hu, Z.; Zhong, W.; Xiao, G. Remdesivir and chloroquine effectively inhibit the recently emerged novel coronavirus (2019-nCoV) in vitro. Cell Res. 2020, 30, 269–271. [Google Scholar] [CrossRef]
  11. Roosa, K.; Lee, Y.; Luo, R.; Kirpich, A.; Rothenberg, R.; Hyman, J.M.; Yan, P.; Chowell, G. Real-time forecasts of the COVID-19 epidemic in China from February 5th to February 24th, 2020. Infect. Dis. Model. 2020, 5, 256–263. [Google Scholar] [CrossRef]
  12. Al-qaness, M.A.A.; Ewees, A.A.; Fan, H.; Abd El Aziz, M. Optimization Method for Forecasting Confirmed Cases of COVID-19 in China. J. Clin. Med. 2020, 9, 674. [Google Scholar] [CrossRef] [PubMed]
  13. Goh, G.K.-M.; Dunker, A.K.; Foster, J.A.; Uversky, V.N. Rigidity of the Outer Shell Predicted by a Protein Intrinsic Disorder Model Sheds Light on the COVID-19 (Wuhan-2019-nCoV) Infectivity. Biomolecules 2020, 10, 331. [Google Scholar] [CrossRef] [PubMed]
  14. Pirouz, B.; Shaffiee Haghshenas, S.; Shaffiee Haghshenas, S.; Piro, P. Investigating a Serious Challenge in the Sustainable Development Process: Analysis of Confirmed cases of COVID-19 (New Type of Coronavirus) Through a Binary Classification Using Artificial Intelligence and Regression Analysis. Sustainability 2020, 12, 2427. [Google Scholar] [CrossRef]
  15. Salzberger, B.; Glück, T.; Ehrenstein, B. Successful containment of COVID-19: The WHO-Report on the COVID-19 outbreak in China. Infection 2020, 48, 151–153. [Google Scholar] [CrossRef]
  16. Cheng, V.C.C.; Wong, S.-C.; Chen, J.H.K.; Yip, C.C.Y.; Chuang, V.W.M.; Tsang, O.T.Y.; Sridhar, S.; Chan, J.F.W.; Ho, P.-L.; Yuen, K.-Y. Escalating infection control response to the rapidly evolving epidemiology of the Coronavirus disease 2019 (COVID-19) due to SARS-CoV-2 in Hong Kong. Infect. Control. Hosp. Epidemiol. 2020, 1–24. [Google Scholar] [CrossRef]
  17. Rothe, C.; Schunk, M.; Sothmann, P.; Bretzel, G.; Froeschl, G.; Wallrauch, C.; Zimmer, T.; Thiel, V.; Janke, C.; Guggemos, W.; et al. Transmission of 2019-nCoV Infection from an Asymptomatic Contact in Germany. N. Engl. J. Med. 2020, 382, 970–971. [Google Scholar] [CrossRef]
  18. Zhang, W.; Du, R.-H.; Li, B.; Zheng, X.-S.; Yang, X.-L.; Hu, B.; Wang, Y.-Y.; Xiao, G.-F.; Yan, B.; Shi, Z.-L.; et al. Molecular and serological investigation of 2019-nCoV infected patients: Implication of multiple shedding routes. Emerg. Microbes Infect. 2020, 9, 386–389. [Google Scholar] [CrossRef]
  19. Ling, Y.; Xu, S.-B.; Lin, Y.-X.; Tian, D.; Zhu, Z.-Q.; Dai, F.-H.; Wu, F.; Song, Z.-G.; Huang, W.; Chen, J.; et al. Persistence and clearance of viral RNA in 2019 novel coronavirus disease rehabilitation patients. Chin. Med. J. 2020. [Google Scholar] [CrossRef]
  20. To, K.K.-W.; Tsang, O.T.-Y.; Chik-Yan Yip, C.; Chan, K.-H.; Wu, T.-C.; Chan, J.M.C.; Leung, W.-S.; Chik, T.S.-H.; Choi, C.Y.-C.; Kandamby, D.H.; et al. Consistent detection of 2019 novel coronavirus in saliva. Clin. Infect. Dis. 2020. [Google Scholar] [CrossRef]
  21. Woo, P.C.Y.; Lau, S.K.P.; Tsoi, H.; Chan, K.; Wong, B.H.L.; Che, X.; Tam, V.K.P.; Tam, S.C.F.; Cheng, V.C.C.; Hung, I.F.N.; et al. Relative rates of non-pneumonic SARS coronavirus infection and SARS coronavirus pneumonia. Lancet 2004, 363, 841–845. [Google Scholar] [CrossRef]
  22. Chan, J.F.-W.; Choi, G.K.-Y.; Tsang, A.K.-L.; Tee, K.-M.; Lam, H.-Y.; Yip, C.C.-Y.; To, K.K.-W.; Cheng, V.C.-C.; Yeung, M.-L.; Lau, S.K.-P.; et al. Development and Evaluation of Novel Real-Time Reverse Transcription-PCR Assays with Locked Nucleic Acid Probes Targeting Leader Sequences of Human-Pathogenic Coronaviruses. J. Clin. Microbiol. 2015, 53, 2722–2726. [Google Scholar] [CrossRef] [PubMed]
  23. Chan, J.F.-W.; Kok, K.-H.; Zhu, Z.; Chu, H.; To, K.K.-W.; Yuan, S.; Yuen, K.-Y. Genomic characterization of the 2019 novel human-pathogenic coronavirus isolated from a patient with atypical pneumonia after visiting Wuhan. Emerg. Microbes Infect. 2020, 9, 221–236. [Google Scholar] [CrossRef] [PubMed]
  24. Chan, J.F.-W.; Yip, C.C.-Y.; To, K.K.-W.; Tang, T.H.-C.; Wong, S.C.-Y.; Leung, K.-H.; Fung, A.Y.-F.; Ng, A.C.-K.; Zou, Z.; Tsoi, H.-W.; et al. Improved molecular diagnosis of COVID-19 by the novel, highly sensitive and specific COVID-19-RdRp/Hel real-time reverse transcription-polymerase chain reaction assay validated in vitro and with clinical specimens. J. Clin. Microbiol. 2020. [Google Scholar] [CrossRef] [PubMed]
  25. Shen, Z.; Xiao, Y.; Kang, L.; Ma, W.; Shi, L.; Zhang, L.; Zhou, Z.; Yang, J.; Zhong, J.; Yang, D.; et al. Genomic diversity of SARS-CoV-2 in Coronavirus Disease 2019 patients. Clin. Infect. Dis. 2020. [Google Scholar] [CrossRef] [PubMed]
  26. Corman, V.M.; Landt, O.; Kaiser, M.; Molenkamp, R.; Meijer, A.; Chu, D.K.W.; Bleicker, T.; Brünink, S.; Schneider, J.; Schmidt, M.L.; et al. Detection of 2019 novel coronavirus (2019-nCoV) by real-time RT-PCR. Eurosurveillance 2020, 25, 2000045. [Google Scholar] [CrossRef]
  27. Chu, D.K.W.; Pan, Y.; Cheng, S.M.S.; Hui, K.P.Y.; Krishnan, P.; Liu, Y.; Ng, D.Y.M.; Wan, C.K.C.; Yang, P.; Wang, Q.; et al. Molecular Diagnosis of a Novel Coronavirus (2019-nCoV) Causing an Outbreak of Pneumonia. Clin. Chem. 2020, 66, 549–555. [Google Scholar] [CrossRef]
  28. Yip, C.C.Y.; Sridhar, S.; Leung, K.-H.; Cheng, A.K.W.; Chan, K.-H.; Chan, J.F.W.; Cheng, V.C.C.; Yuen, K.-Y. Evaluation of RealStar® Alpha Herpesvirus PCR Kit for Detection of HSV-1, HSV-2, and VZV in Clinical Specimens. Biomed. Res. Int. 2019, 2019, 5715180. [Google Scholar] [CrossRef]
  29. Yip, C.C.Y.; Sridhar, S.; Cheng, A.K.W.; Fung, A.M.Y.; Cheng, V.C.C.; Chan, K.-H.; Yuen, K.-Y. Comparative evaluation of a laboratory developed real-time PCR assay and the RealStar® HHV-6 PCR Kit for quantitative detection of human herpesvirus 6. J. Virol. Methods 2017, 246, 112–116. [Google Scholar] [CrossRef]
  30. Angeletti, S.; Benvenuto, D.; Bianchi, M.; Giovanetti, M.; Pascarella, S.; Ciccozzi, M. COVID-2019: The role of the nsp2 and nsp3 in its pathogenesis. J. Med. Virol. 2020. [Google Scholar] [CrossRef]
  31. To, K.K.-W.; Tsang, O.T.-Y.; Leung, W.-S.; Tam, A.R.; Wu, T.-C.; Lung, D.C.; Yip, C.C.-Y.; Cai, J.-P.; Chan, J.M.-C.; Chik, T.S.-H.; et al. Temporal profiles of viral load in posterior oropharyngeal saliva samples and serum antibody responses during infection by SARS-CoV-2: An observational cohort study. Lancet Infect. Dis. 2020, S1473309920301961. [Google Scholar] [CrossRef]
  32. Li, Z.; Yi, Y.; Luo, X.; Xiong, N.; Liu, Y.; Li, S.; Sun, R.; Wang, Y.; Hu, B.; Chen, W.; et al. Development and Clinical Application of A Rapid IgM-IgG Combined Antibody Test for SARS-CoV-2 Infection Diagnosis. J. Med. Virol. 2020. [Google Scholar] [CrossRef] [PubMed]
  33. Guo, L.; Ren, L.; Yang, S.; Xiao, M.; Chang, D.; Yang, F.; Dela Cruz, C.S.; Wang, Y.; Wu, C.; Xiao, Y.; et al. Profiling Early Humoral Response to Diagnose Novel Coronavirus Disease (COVID-19). Clin. Infect. Dis. 2020. [Google Scholar] [CrossRef] [PubMed]
  34. Zhang, J.-F.; Yan, K.; Ye, H.-H.; Lin, J.; Zheng, J.-J.; Cai, T. SARS-CoV-2 turned positive in a discharged patient with COVID-19 arouses concern regarding the present standard for discharge. Int. J. Infect. Dis. 2020. [Google Scholar] [CrossRef] [PubMed]
  35. Legido-Quigley, H.; Mateos-García, J.T.; Campos, V.R.; Gea-Sánchez, M.; Muntaner, C.; McKee, M. The resilience of the Spanish health system against the COVID-19 pandemic. Lancet Public Health 2020. [Google Scholar] [CrossRef]
  36. Remuzzi, A.; Remuzzi, G. COVID-19 and Italy: What next? Lancet 2020. [Google Scholar] [CrossRef]
  37. Lu, R.; Zhao, X.; Li, J.; Niu, P.; Yang, B.; Wu, H.; Wang, W.; Song, H.; Huang, B.; Zhu, N.; et al. Genomic characterisation and epidemiology of 2019 novel coronavirus: Implications for virus origins and receptor binding. Lancet 2020, 395, 565–574. [Google Scholar] [CrossRef]
  38. Yip, C.C.Y.; Lam, C.S.F.; Luk, H.K.H.; Wong, E.Y.M.; Lee, R.A.; So, L.-Y.; Chan, K.-H.; Cheng, V.C.C.; Yuen, K.-Y.; Woo, P.C.Y.; et al. A six-year descriptive epidemiological study of human coronavirus infections in hospitalized patients in Hong Kong. Virol. Sin. 2016, 31, 41–48. [Google Scholar] [CrossRef]
  39. Ho, C.-C.; Wu, A.K.L.; Tse, C.W.S.; Yuen, K.-Y.; Lau, S.K.P.; Woo, P.C.Y. Automated pangenomic analysis in target selection for PCR detection and identification of bacteria by use of ssGeneFinder Webserver and its application to Salmonella enterica serovar Typhi. J. Clin. Microbiol. 2012, 50, 1905–1911. [Google Scholar] [CrossRef]
  40. Ho, C.-C.; Yuen, K.-Y.; Lau, S.K.P.; Woo, P.C.Y. Rapid identification and validation of specific molecular targets for detection of Escherichia coli O104:H4 outbreak strain by use of high-throughput sequencing data from nine genomes. J. Clin. Microbiol. 2011, 49, 3714–3716. [Google Scholar] [CrossRef]
  41. Ho, C.-C.; Lau, C.C.Y.; Martelli, P.; Chan, S.-Y.; Tse, C.W.S.; Wu, A.K.L.; Yuen, K.-Y.; Lau, S.K.P.; Woo, P.C.Y. Novel pan-genomic analysis approach in target selection for multiplex PCR identification and detection of Burkholderia pseudomallei, Burkholderia thailandensis, and Burkholderia cepacia complex species: A proof-of-concept study. J. Clin. Microbiol. 2011, 49, 814–821. [Google Scholar] [CrossRef]
  42. Chu, H.; Chan, J.F.-W.; Yuen, T.T.; Shuai, H.; Yuan, S.; Wang, Y.; Hu, B.; Yip, C.C.-Y.; Tsang, J.O.-L.; Huang, X.; et al. An observational study on the comparative tropism, replication kinetics, and cell damage profiling of SARS-CoV-2 and SARS-CoV: Implications for clinical manifestations, transmissibility, and laboratory studies of COVID-19. Lancet Microbe 2020, in press. [Google Scholar]
  43. Chan, J.F.-W.; Zhang, A.J.; Yuan, S.; Poon, V.K.-M.; Chan, C.C.-S.; Lee, A.C.-Y.; Chan, W.-M.; Fan, Z.; Tsoi, H.-W.; Wen, L.; et al. Simulation of the clinical and pathological manifestations of Coronavirus Disease 2019 (COVID-19) in golden Syrian hamster model: Implications for disease pathogenesis and transmissibility. Clin. Infect. Dis. 2020, ciaa325. [Google Scholar] [CrossRef] [PubMed]
  44. Yip, C.C.-Y.; Chan, W.-M.; Ip, J.D.; Seng, C.W.-M.; Leung, K.-H.; Poon, R.W.-S.; Ng, A.C.-K.; Wu, W.-L.; Zhao, H.; Chan, K.-H.; et al. Nanopore sequencing reveals novel targets for the diagnosis and surveillance of human and avian influenza A virus. J. Clin. Microbiol. 2020. [Google Scholar] [CrossRef] [PubMed]
  45. Wong, S.S.Y.; Yip, C.C.Y.; Sridhar, S.; Leung, K.-H.; Cheng, A.K.W.; Fung, A.M.Y.; Lam, H.-Y.; Chan, K.-H.; Chan, J.F.W.; Cheng, V.C.C.; et al. Comparative evaluation of a laboratory-developed real-time PCR assay and RealStar® Adenovirus PCR Kit for quantitative detection of human adenovirus. Virol. J. 2018, 15, 149. [Google Scholar] [CrossRef] [PubMed]
  46. Chan, J.F.-W.; Yip, C.C.-Y.; Tee, K.-M.; Zhu, Z.; Tsang, J.O.-L.; Chik, K.K.-H.; Tsang, T.G.-W.; Chan, C.C.-S.; Poon, V.K.-M.; Sridhar, S.; et al. Improved detection of Zika virus RNA in human and animal specimens by a novel, highly sensitive and specific real-time RT-PCR assay targeting the 5′-untranslated region of Zika virus. Trop. Med. Int. Health 2017, 22, 594–603. [Google Scholar] [CrossRef] [PubMed]
Ijms 21 02574 g001
Figure 1. Genome uniqueness/conservedness plot generated by GolayMetaMiner. The orange curve denotes the Savitzky–Golay smoothed conservedness score (C-score), and the blue curve and red line denote the similarly smoothed uniqueness score (U-score) with the corresponding cutoff in the 98th percentile cutoff score. Areas of the blue curve above the cutoff represent the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) unique targets, potentially. The genomic targets (> 50 nt) identified were marked by the numbers 1, 2, 3 and 4 in the figure as part of the program output.
Figure 1. Genome uniqueness/conservedness plot generated by GolayMetaMiner. The orange curve denotes the Savitzky–Golay smoothed conservedness score (C-score), and the blue curve and red line denote the similarly smoothed uniqueness score (U-score) with the corresponding cutoff in the 98th percentile cutoff score. Areas of the blue curve above the cutoff represent the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) unique targets, potentially. The genomic targets (> 50 nt) identified were marked by the numbers 1, 2, 3 and 4 in the figure as part of the program output.
Ijms 21 02574 g001
Table 1. SARS-CoV-2 specific targets (>50 nt) reported by GolayMetaMiner.
Table 1. SARS-CoV-2 specific targets (>50 nt) reported by GolayMetaMiner.
TargetNucleotide Position 1Target Length (nt)Genomic Region
11865–2018154nsp2
221,731–21,78858Spike
323,536–23,59863Spike
427,997–28,90993ORF8
1 With reference to SARS-CoV-2 isolate HKU-SZ-005b_2020, accession MN975262.1.
Table 2. Evaluation of the limit of detection (LOD) of the COVID-19-nsp2 real-time reverse transcription-polymerase chain reaction (RT-PCR) assay using SARS-CoV-2 genomic RNA from cell culture lysate.
Table 2. Evaluation of the limit of detection (LOD) of the COVID-19-nsp2 real-time reverse transcription-polymerase chain reaction (RT-PCR) assay using SARS-CoV-2 genomic RNA from cell culture lysate.
Virus Quantity (TCID50/mL)Cp (Intra-Run)Cp (Inter-Run)
Test 1Test 2Test 3Test 1Test 2Test 3
1.8 × 10229.9130.1229.9029.2329.5429.28
1.8 × 10133.5533.4933.7832.4132.9532.69
1.8 × 10037.3937.3137.2036.7236.2537.20
1.8 × 10−1----38.96-
Cp: crossing point at which the fluorescence of a sample rises above the background fluorescence.
Table 3. Imprecision testing of the COVID-19-nsp2 assay using SARS-CoV-2 isolate extracts.
Table 3. Imprecision testing of the COVID-19-nsp2 assay using SARS-CoV-2 isolate extracts.
Virus Quantity (TCID50/mL)Intra-AssayInter-Assay
No. of Positive ReplicatesMean Cp ± SD
(% Coefficient of Variation)		Mean Cp ± SD
(% Coefficient of Variation)
1.8 × 102329.98 ± 0.12 (0.41)29.66 ± 0.37 (1.24)
1.8 × 101333.61 ± 0.15 (0.46)33.15 ± 0.54 (1.64)
1.8 × 100337.30 ± 0.10 (0.26)37.01 ± 0.44 (1.19)

Share and Cite

MDPI and ACS Style

Yip, C.C.-Y.; Ho, C.-C.; Chan, J.F.-W.; To, K.K.-W.; Chan, H.S.-Y.; Wong, S.C.-Y.; Leung, K.-H.; Fung, A.Y.-F.; Ng, A.C.-K.; Zou, Z.; et al. Development of a Novel, Genome Subtraction-Derived, SARS-CoV-2-Specific COVID-19-nsp2 Real-Time RT-PCR Assay and Its Evaluation Using Clinical Specimens. Int. J. Mol. Sci. 2020, 21, 2574. https://doi.org/10.3390/ijms21072574

AMA Style

Yip CC-Y, Ho C-C, Chan JF-W, To KK-W, Chan HS-Y, Wong SC-Y, Leung K-H, Fung AY-F, Ng AC-K, Zou Z, et al. Development of a Novel, Genome Subtraction-Derived, SARS-CoV-2-Specific COVID-19-nsp2 Real-Time RT-PCR Assay and Its Evaluation Using Clinical Specimens. International Journal of Molecular Sciences. 2020; 21(7):2574. https://doi.org/10.3390/ijms21072574

Chicago/Turabian Style

Yip, Cyril Chik-Yan, Chi-Chun Ho, Jasper Fuk-Woo Chan, Kelvin Kai-Wang To, Helen Shuk-Ying Chan, Sally Cheuk-Ying Wong, Kit-Hang Leung, Agnes Yim-Fong Fung, Anthony Chin-Ki Ng, Zijiao Zou, and et al. 2020. "Development of a Novel, Genome Subtraction-Derived, SARS-CoV-2-Specific COVID-19-nsp2 Real-Time RT-PCR Assay and Its Evaluation Using Clinical Specimens" International Journal of Molecular Sciences 21, no. 7: 2574. https://doi.org/10.3390/ijms21072574

APA Style

Yip, C. C.-Y., Ho, C.-C., Chan, J. F.-W., To, K. K.-W., Chan, H. S.-Y., Wong, S. C.-Y., Leung, K.-H., Fung, A. Y.-F., Ng, A. C.-K., Zou, Z., Tam, A. R., Chung, T. W.-H., Chan, K.-H., Hung, I. F.-N., Cheng, V. C.-C., Tsang, O. T.-Y., Tsui, S. K. W., & Yuen, K.-Y. (2020). Development of a Novel, Genome Subtraction-Derived, SARS-CoV-2-Specific COVID-19-nsp2 Real-Time RT-PCR Assay and Its Evaluation Using Clinical Specimens. International Journal of Molecular Sciences, 21(7), 2574. https://doi.org/10.3390/ijms21072574

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop