Next Article in Journal
A Comprehensive Review on Medicinal Plants as Antimicrobial Therapeutics: Potential Avenues of Biocompatible Drug Discovery
Next Article in Special Issue
Short-Term Temporal Metabolic Behavior in Halophilic Cyanobacterium Synechococcus sp. Strain PCC 7002 after Salt Shock
Previous Article in Journal
Influence of Drying Method on NMR-Based Metabolic Profiling of Human Cell Lines
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Metabolites
Volume 9
Issue 11
10.3390/metabo9110257
metabolites-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Inter-Laboratory Comparison of Metabolite Measurements for Metabolomics Data Integration

by
Yoshihiro Izumi
1,
Fumio Matsuda
2,*,
Akiyoshi Hirayama
3,
Kazutaka Ikeda
4,
Yoshihiro Kita
5,
Kanta Horie
6,
Daisuke Saigusa
7,
Kosuke Saito
8,
Yuji Sawada
9,
Hiroki Nakanishi
10,
Nobuyuki Okahashi
2,
Masatomo Takahashi
1,
Motonao Nakao
1,
Kosuke Hata
1,
Yutaro Hoshi
11,
Motohiko Morihara
12,
Kazuhiro Tanabe
13,
Takeshi Bamba
1,* and
Yoshiya Oda
5
1
Division of Metabolomics, Medical Institute of Bioregulation, Kyushu University, 3-1-1 Maidashi, Higashi-ku, Fukuoka 812-8582, Japan
2
Department of Bioinformatic Engineering, Graduate School of Information Science and Technology, Osaka University, 1-5 Yamadaoka, Suita, Osaka 565-0871, Japan
3
Institute for Advanced Biosciences, Keio University, 246-2 Mizukami, Kakuganji, Tsuruoka, Yamagata 997-0052, Japan
4
Laboratory for Metabolomics, RIKEN Center for Integrative Medical Sciences, 1-7-22 Suehiro-cho, Tsurumi-Ku, Yokohama, Kanagawa 230-0045, Japan
5
Department of Lipidomics, Graduate School of Medicine, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo 113-0033, Japan
6
Translational Science, Neurology Business Group, Eisai Co., Ltd., 5-1-3 Tokodai, Tsukuba, Ibaraki 300-2635, Japan
7
Tohoku Medical Megabank Organization, Tohoku University, 2-1 Seiryo-machi, Aoba-ku, Sendai, Miyagi 980-8573, Japan
8
Division of Medical Safety Science, National Institute of Health Science, 3-25-26 Tonomachi, Kawasaki-ku, Kawasaki, Kanagawa 210-9501, Japan
9
RIKEN Center for Sustainable Resource Science, 1-7-22 Suehiro-cho, Tsurumi-ku, Yokohama, Kanagawa 230-0045, Japan
10
Research Center for Biosignal, Akita University, 1-1-1 Hondo, Akita-city, Akita 010-8543, Japan
11
Pharmacokinetic Research Laboratories, Ono Pharmaceutical Co., Ltd., 17-2 Wadai, Tsukuba, Ibaraki 300-4247, Japan
12
Translational Research Laboratories, Ono Pharmaceutical Co., Ltd., 3-1-1 Sakurai Shimamoto-cho, Mishima-gun, Osaka 618-8585, Japan
13
Medical Solution Promotion Department, Medical Solution Segment, LSI Medience Corporation, 3-30-1, Shimura, Itabashi-ku, Tokyo 174-8555, Japan
 
add Show full affiliation list
 
remove Hide full affiliation list
*
Authors to whom correspondence should be addressed.
Metabolites 2019, 9(11), 257; https://doi.org/10.3390/metabo9110257
Submission received: 29 September 2019 / Revised: 26 October 2019 / Accepted: 28 October 2019 / Published: 31 October 2019
(This article belongs to the Special Issue Metabolomics-Driven Biotechnology)
Browse Figures
Review Reports Versions Notes

Abstract

:
Background: One of the current problems in the field of metabolomics is the difficulty in integrating data collected using different equipment at different facilities, because many metabolomic methods have been developed independently and are unique to each laboratory. Methods: In this study, we examined whether different analytical methods among 12 different laboratories provided comparable relative quantification data for certain metabolites. Identical samples extracted from two cell lines (HT-29 and AsPc-1) were distributed to each facility, and hydrophilic and hydrophobic metabolite analyses were performed using the daily routine protocols of each laboratory. Results: The results indicate that there was no difference in the relative quantitative data (HT-29/AsPc-1) for about half of the measured metabolites among the laboratories and assay methods. Data review also revealed that errors in relative quantification were derived from issues such as erroneous peak identification, insufficient peak separation, a difference in detection sensitivity, derivatization reactions, and extraction solvent interference. Conclusion: The results indicated that relative quantification data obtained at different facilities and at different times would be integrated and compared by using a reference materials shared for data normalization.

1. Introduction

Metabolomics using mass spectrometry (MS) is a promising tool for the life science and biotechnology fields [1,2,3,4,5]. In recent years, relative quantification data produced mainly by the targeted metabolomics approach were integrated into large datasets for researches in medical biotechnology, precision medicine, cohort studies, epidemiological studies, and genome-wide association studies [6,7,8]. It is anticipated that a massive generation of reliable data by inter-laboratory collaborative research will promote data exchange and result in a larger accumulation of data over the next few decades. However, there are several problems regarding the quantification of metabolites that must be solved in order to share data obtained in different laboratories.
One of the biggest problems that must be addressed is that the targeted metabolome methods have not been well validated to guarantee the production of reliable and comparable data. For the case of drug metabolites analysis in biological samples, a draft guideline for method validation using blank matrix and standard materials has been published (International Council for Harmonization of Technical Requirements for Pharmaceuticals for Human Use) [9]. In targeted metabolomics, method validation using a similar approach seems to be quite a difficult task. This is because true values are unclear due to a lack of suitable blank matrix as well as many standard materials [10]. Therefore, reproducibility and reliability are always a matter of concern [11]. When peak separation is insufficient, the calculation of peak area or intensity becomes less accurate. Additionally, the certainty of identifying metabolites without standard substances is diminished [12].
Another problem is that the general gold standard approaches are lacking in metabolomics [13]. There are some activities regarding standardization of metabolome measurement; however, it is unlikely that all researchers conduct unified protocols, as multiple combinations of MS, including quadrupole mass spectrometry (QMS), time-of-flight mass spectrometry (TOFMS), quadrupole-time-of-flight mass spectrometry (QTOFS), triple quadrupole mass spectrometry (TQMS), quadrupole-Orbitrap mass spectrometry (Q Exactive), and quadrupole-Orbitrap-linear ion trap mass spectrometry (Orbitrap Fusion) can be used. Several separation techniques, such as gas chromatography (GC), liquid chromatography (LC), supercritical fluid chromatography (SFC), ion chromatography (IC), or capillary electrophoresis (CE), are also available for the investigation of metabolites in biological components.
Despite the diverse methods for relative quantitation, results that are essentially the same must be produced when identical samples are analyzed by different methods in different laboratories. When the results are similar, the relative quantitation results are probably close to the true value, and these methodologies seem to be reliable. Moreover, a global quality control or a reference material is available to normalize the datasets produced across various laboratories.
In the proteomic field, a multi-laboratory evaluation study at eleven sites around the world was conducted using an identical protocol for the sequential window acquisition of all theoretical mass spectra (SWATH-MS). They evaluated reproducibility for more than 4000 proteins in HEK293 cells and concluded that the quantitative characteristics were highly comparable across all sites [14]. In the metabolomics field, interlaboratory reproducibility for hydrophilic and hydrophobic metabolites (mainly amino acids and phospholipids) was tested through the analysis of human serum and plasma using Biocrates’ AbsoluteIDQ kit [15]. However, in the real world, different laboratories use different protocols on different devices. In this regard, community-based efforts reportedly improved the versatility of lipidomics. Consensus values of plasma lipids in the standard reference material (SRM) 1950‒metabolites in frozen human plasma were obtained through the LIPID MAPS consortium and the National Institute of Standards and Technologies (NIST) study group [16]. For instance, Bowden et al. conducted a thirty-one inter-laboratory study using different lipidomics workflows to SRM 1950 [17]. The results of absolute quantitation of plasma lipid concentration were different among these laboratories, suggesting that it is necessary to find the reasons behind these differences [18]. Issues that need to be addressed were found in the process of pre-analytics [19,20], analytics, and post-analytics [21,22]. Therefore, generally accepted guidelines for lipidomics across independent laboratories are required, and community-initiated approaches have been attempted for data harmonization among different instrumentation platforms [23].
In this study, we focused on the relative comparisons of 206 hydrophilic and 584 hydrophobic metabolite levels among samples and performed an inter-laboratory comparison study of metabolite measurements across 12 laboratories. One of the main purposes of this study was to verify the targeted metabolomics methods based on a majority rule. A comparison of relative quantitation data (HT-29/AsPc-1) showed that essentially identical results were obtained on more than half of the measured metabolites among laboratories and assay methods. Another purpose of the inter-laboratory study was to examine error shooting of metabolome analysis using a data review. The results confirmed that comparable data could be produced for more than half of the metabolites using different metabolome analysis methods, and several reasons leading to the incomparable results were successfully identified.

2. Results and Discussion

2.1. Experimental Design

In the present study, we performed relative quantitation of various metabolites in two identical samples using different targeted metabolomics methods (Figure 1). Two cell extract pools (samples) were prepared from HT-29 and AsPc-1 cell cultures. The two samples were then distributed to 12 participating laboratories throughout Japan. In each laboratory, the peak was identified for each metabolite and their relative signal intensity value (HT-29/AsPc-1) was measured according to their own routine analytical methods. We did not share any protocols or lists of target metabolites. Herein, an analytical method includes sample pretreatment, separation, detection, and data processing. A total of six analytical runs were performed for triplicate extracts of two cell lines in each method. The relative signal intensity data of metabolites were compiled to compare among laboratories. The integrated data were subsequently analyzed using statistical tests to evaluate whether similar results were produced by distinct analytical methods.

2.2. Data Acquisition and Integration

In this study, inconsistency in compound identifier (ID) usage became a problem during the data integrating task, because different compound names and IDs were used in different laboratories. Specifically, lipid structures have not been fully elucidated in many cases, and different names are given to MS peaks among laboratories due to the lack of standardized metabolite nomenclature [24]. Thus, we created a consensus list of compound IDs as well as a naming rule for lipidomics among participants in order to address this issue. For the hydrophobic metabolites (lipids) analysis, we targeted 21 lipid classes, including acylcarnitine (AC), cholesterol ester (ChE), ceramide (NS) (Cer(NS)), diacylglycerol (DG), free fatty acid (FA), hexose ceramide (NS) (HexCer(NS)), lysophosphatidic acid (LPA), lysophosphatidylcholine (LPC), lysophosphatidylethanolamine (LPE), lysophosphatidylglycerol (LPG), lysophosphatidylinositol (LPI), lysophosphatidylserine (LPS), monoacylglycerol (MG), phosphatidic acid (PA), phosphatidylcholine (PC), phosphatidylethanolamine (PE), phosphatidylglycerol (PG), phosphatidylinositol (PI), phosphatidylserine (PS), sphingomyelin (SM), and triacylglycerol (TG), with a variety of 20 FA side chains. Thus, the targeted lipid molecular species comprised 3390 compounds, including lysophospholipid positional isomers (e.g., LPA 16:0 (sn-1) and LPA 16:0 (sn-2)).
Identification of the hydrophilic metabolites, including amino acids, organic acids, sugar phosphates, nucleic acids, and coenzymes, was accomplished by each laboratory’s protocol such as by comparing the retention time (or migration time), MS and MS/MS spectra, and the multiple reaction monitoring (MRM) transition of the target metabolites in the samples with those of authentic standards analyzed under identical conditions. Identification of lipids was conducted based on the retention time, precursor ion, and the fragmentation patterns or specific MRM transitions of each molecule.
The metabolite extracts obtained from HT-29 and AsPc-1 cells with methanol were aliquoted and distributed among 12 laboratories in April 2018. These samples were to be used for metabolome analysis via routine measurements at participating laboratories. The list of measured metabolites and their relative amounts were returned by August 2018 and compiled into a dataset. The completed dataset consists of relative quantification results obtained using 15 methods for hydrophilic metabolites and nine methods for lipids (Table 1 and Table 2). It should be noted that ranges of measured metabolites were partly overlapped but different among laboratories.
By integrating the results from all analytical methods, a total of 206 hydrophilic metabolites and 584 hydrophobic metabolites were identified from the HT-29 and/or AsPc-1 cell extracts at least by one analytical method (Figure 2A and Table 3). Among these, a total of 148 hydrophilic metabolites and 285 hydrophobic metabolites in both HT-29 and AsPc-1 cell extracts were detected using two or more analytical methods (Figure 2B and Table 3). A total of 433 metabolites were identified by multiple methods, which corresponded to 54.8% of the total 790 metabolites. The number was much higher than that of previous report. For instance, it has been reported that 217 metabolites in total were identified by multiple methods [24]. These results demonstrate that the coverage of metabolomics could be greatly improved by sharing data among multiple laboratories.

2.3. Comparison of Analytical Methods for Relative Quantification

Relative ratios (HT-29/AsPc-1) of 206 hydrophilic metabolites obtained using 15 different methods and of 584 hydrophobic metabolites obtained using nine different methods are shown in Tables S1 and S2, respectively. Statistical significance of each metabolite between samples HT-29 and AsPc-1 was determined using a two-sided Student’s t-test (p < 0.05). In total, 104 hydrophilic metabolites and 199 hydrophobic metabolites were statistically significant between samples HT-29 and AsPc-1 among two or more methods (Table 3 and Tables S1 and S2). Among them, the HT-29/AsPc-1 values of five hydrophilic and seven hydrophobic metabolites were significantly changed to distinct directions among multiple methods (Table 3, Figure S1, and Tables S1 and S2). For instance, the incorrect results were observed for acetylglycine (Acetyl-Gly), allantoin, dihydroxyacetone phosphate (DHAP), isocitric acid, (IsoCit), and lysine (Lys) as well as LPC 16:0 (sn-1), LPC 20:1 (sn-2), LPE 22:6 (sn-1), PE 16:0/18:0, PE 18:0/18:0, PG 16:0/18:1, and PI 18:0/20:2 (Figure S1). An obviously incorrect result was observed for only 4.0% (12/303) of metabolites in total, indicating a basic agreement of the relative amounts data among all analytical methods.
The one-way ANOVA using HT-29/AsPc-1 values (α = 0.05) shows that there is no difference between the 57 hydrophilic and 113 hydrophobic metabolites across the various methods (Table 3). The total of 170 metabolites corresponded to 39.2% for 433 metabolites identified from both samples by two or more methods. The results of the one-way ANOVA indicated that, when considering AsPc-1 cells as a global quality control sample in this study, the ratios of HT-29/AsPC-1 for 10 amino acids, including asparagine (Asn), aspartic acid (Asp), cysteine (Cys), glutamic acid (Glu), glycine (Gly), histidine (His), leucine (Leu), serine (Ser), threonine (Thr), and tyrosine (Tyr), were similar among multiple methods (Figure 3). However, the ratio of tryptophan (Trp) ranged from 0.93 to 1.11 in the six methods, but in one protocol was as high as 3.81 (Figure 3). Similar outliers were observed for 41 hydrophilic metabolites and 49 hydrophobic metabolites (Table 3 and Tables S1 and S2), likely due to errors in the analysis method as discussed below.
When ignoring one outlier in the data, the results improved such that HT-29/AsPc-1 levels were similar among 98 hydrophilic and 162 hydrophobic metabolites. The total 260 metabolites corresponded to 60.0% for 433 metabolites identified from both samples by two or more methods (Table 3). The values of these metabolites seem to be close to the true values because a similar result was obtained regardless of the difference in measurement method (Tables S1 and S2). Although the results cannot be compared directly, the analysis of plasma samples by the metabolomics platforms in Metabolon and Broad Institute demonstrated that 111 overlapped metabolites were correlated with each other (the median Spearman correlation was 0.79) [24]. Although the majority voting is not always correct and there are still many outliers, the results demonstrated that identical relative quantitation data was produced by the targeted metabolomics methods throughout various laboratories.

2.4. Community-Based Correction of Targeted Metabolome Analysis Methods

Data review of the inter-laboratory study also allowed for the troubleshooting of each metabolome analysis method. Since the dataset was large, we could review only a small part of this study. For instance, almost all the outlier values in the amino acid data including Gln, Phe, Pro, and Trp were produced by the methods using GC/MS (Figure 3). Among the GC/MS-based methods for hydrophilic metabolite analysis, including methods M, N, and O, the ratios of Gln and Pro determined by method N were slightly different from that of other methods. The result suggested that the derivatization reaction for Gln and Pro in method N might be insufficient. On the other hand, the relative quantification of Lys using method G (C18-LC/TQMS, MRM) was significantly different from the other seven methods (Figure 3). The possible reason was the co-elution with the isobaric ions because method G set similar MRM transitions for Lys (146.9 > 84.1) and Gln (147.0 > 84.1), and both compounds were not chromatographically separated.
Furthermore, several errors were derived from the insufficient separation of various structural isomers such as glucose and fructose. In this study, the relative quantification value of glucose was obtained from four laboratories (methods E, L, N, and O for hydrophilic metabolites). However, the value obtained from method L was an outlier (Figure 4A). The data review pointed out that the method L did not include fructose in the targeted metabolite list, suggesting that glucose and fructose were coeluted in the method L. A similar case was found in phospholipid analysis. For example, PI 38:2 contains PI 18:0/20:2 and PI 18:1/20:1. Both isomers were measured by methods C, E, and H for hydrophobic metabolites (Figure 4B). The relative values of PI 18:0/20:2 and PI 18:1/20:1 determined by methods C, E, and H were close to each other. On the other hand, methods A and D commonly employed the C18-LC separation and detected only PI 18:0/20:2. The relative values of PI 18:0/20:2 determined by methods A and D were significantly larger than that of other methods, suggesting that PI 18:0/20:2 and PI 18:1/20:1 was likely to be coeluted by methods A and D. Similarly, PE 34:2 primarily contains PE 16:1/18:1 and PE 16:0/18:2. Both isomers were measured by methods E and H that produced similar quantification values each other (Figure 4C). Another three facilities measured only PE 16:1/18:1 and produced incomparable values (Figure 4C). The data review found that different peaks having different retention times were identified in the method C. There results showed that these errors and misidentifications would not have been noticed unless it was checked using reference material. To minimize such error, strict thresholds for metabolic identification or peak integration, as well as standardization of data analysis, are desired. However, the work will require many compromises because one of the main objectives of metabolome analysis is to identify as many molecules as possible.

3. Materials and Methods

3.1. Cell Cultures

Human colon colorectal adenocarcinoma HT-29 cells and human pancreatic cancer AsPC-1 cells were obtained from the American Type Culture Collection (ATCC, Manassas, VA, USA). Both cells were cultured in RPMI 1640 medium (Nissui Pharmaceutical Co., Ltd., Tokyo, Japan) supplemented with 10% (v/v) fetal bovine serum, 100 unit mL−1 penicillin, 100 mg mL−1 streptomycin, and 0.25 mg mL−1 amphotericin B at 37 °C in a humidified atmosphere with 5% CO2.

3.2. Preparation of Cell Extract for Metabolite Quantification

Human HT-29 and AsPc-1 cells were seeded at a density of 4 × 106 and 3 × 106 cells/15 cm dish, respectively, and 31 dishes (one dish was used for cell count) were prepared for each sample. Each dish was cultured for 72 h. After the cultivation, the cells were washed with phosphate-buffered saline (PBS, Sigma-Aldrich, St Louis, MO, USA) and lysed in 5 mL (per dish) methanol. Thirty dishes were scraped and pooled for each sample. Finally, each sample cell number was adjusted to 4 × 106 cells mL−1 by adding methanol. After mixing to obtain a homogenous solution, 350 µL of the sample were packaged at −80 °C and sent to individual laboratories.

3.3. Analytical Procedure

The metabolite extract was distributed among 12 laboratories and was analyzed using their own metabolome analysis methods, including 15 methods [25,26,27,28,29,30,31,32,33,34,35,36,37] for hydrophilic metabolites and nine methods [38,39,40,41,42,43,44] for hydrophobic metabolites. Here, an analysis method includes the pretreatment of samples (such as addition of internal standards, extraction, phase separation, clean up, and/or derivatization), chromatographic separation, MS detection, and data processing. From each six distributed samples (triplicate extracts of two cell lines), six pretreated samples were prepared. Metabolome data were obtained by six runs in total, from which signal intensity data were prepared. The details of each analytical method are described in the Supplementary Materials Tables S3 and S4.

3.4. Data Analysis

Data processing, including peak picking and metabolite identification, was conducted according to each laboratory’s specific method. The relative quantitative data (HT-29/AsPc-1) for each metabolite were obtained from the triplicate analyses. The details of data processing and normalization data for each analytical method are described in the Tables S3 and S4. The integrated data were subsequently analyzed based on a two-sided Student’s t-test or a one-way ANOVA to evaluate whether similar results were produced by multi-laboratory distinct analytical methods. Statistical significance of each metabolite between samples HT-29 and AsPc-1 was determined using a two-sided Student’s t-test (p < 0.05). The number of metabolites that showed HT-29/AsPc-1 levels in different directions among two or more methods was examined based on a two-sided Student’s t-test and a relative quantitative value of 1 (Tables S1 and S2). The number of metabolites with statistically similar HT-29/AsPc-1 levels was also examined among multiple methods using a one-way ANOVA analysis (p > 0.05). Subsequently, the number of metabolites that changed to a p-value of >0.05 by a one-way ANOVA when ignoring one outlier in the data showing a p-value of <0.05 by a one-way ANOVA was searched (Tables S1 and S2). All statistical analyses were performed using in-house scripts written in Python 3 using Numpy and Scipy modules.

4. Conclusions

In the present study, even if the results were obtained by different analytical methods, the results could be compared by relative quantification. This indicates that if global quality control samples or reference materials are prepared and shared for data normalization, data obtained at different facilities and at different times may be integrated and compared. On the contrary, each analytical method that gave similar results for a certain substance seemed to be accurate. However, it is difficult to generalize this, and it seems that it can be applied only to specific metabolites. Of course, if the matrix (i.e., serum, plasma, urine, etc.) is different, the assay must be revalidated for each metabolite. The reason why the results differed among analyses was not only that other peaks (i.e., isobaric or isomeric ions) were overlapping, but also because the peaks were identified incorrectly, or the sensitivity was poor and the noise was significantly impacted. For the former, it could be improved by using a standard material and for the latter by specifying a lower limit of quantification. In this study, relative values were often very different, but if these variations could be corrected, relative quantitative data obtained from different laboratories could be integrated for new biological findings by a large dataset that cannot be achieved by one facility. It can also be a means to verify the certainty of new analytical methods.

Supplementary Materials

The following are available online at https://www.mdpi.com/2218-1989/9/11/257/s1, Figure S1: Incomparable relative quantitative values produced from multiple methods (PDF), Table S1: Relative quantitative data (HT-29 cell extracts/AsPc-1 cell extracts) and results of statistical tests of 206 hydrophilic metabolites obtained using 15 different methods (XLSX), Table S2: Relative quantitative data (HT-29 cell extracts/AsPc-1 cell extracts) and results of statistical tests of 584 hydrophobic metabolites obtained by 9 different methods (XLSX), Table S3: Sample preparation procedure, separation, MS detection, data processing, and normalization of data for each analytical method of hydrophilic metabolites (XLSX), Table S4: Sample preparation procedure, separation, MS detection, data processing, and normalization of data for each analytical method of hydrophobic metabolites (XLSX).

Author Contributions

Conceptualization, Y.I., A.H., Y.O., F.M., and T.B.; experiments and data analysis, Y.I., A.H., K.I., Y.K., K.H. (Kanta Horie), D.S., K.S., Y.S., H.N., N.O., M.T., K.H. (Kosuke Hata), Y.H., M.M., and K.T.; data integration and statistical analyses, Y.I., F.M., A.H., and M.N.; writing—original draft preparation, Y.I., F.M., A.H., T.B., K.I., K.H. (Kanta Horie), Y.K., D.S., K.S., Y.S., H.N., N.O., M.M., K.T., and Y.O.; writing—review and editing, Y.I., Y.O., and F.M.; visualization, Y.I. and F.M.; supervision, F.M., T.B., and Y.O.; project administration, Y.O., F.M., and T.B. All authors read and approved the final manuscript.

Funding

This study was supported in part by a Grant-in-Aid for Scientific Research on Innovative Areas (17H06304 for Y.I. and T.B., and 17H06303 for F.M. and N.O.) from Japan Society for the Promotion of Science (JSPS), a Grant-in-Aid for Scientific Research (C) (19K05167 for Y.I.) from JSPS, the Japan Agency for Medical Research and Development (AMED) projects (the Research on Development of New Drugs, GAPFREE for A.H., JP18gm5910001 for K.I., and 19ak0101043j0605 for K.S.) from AMED, and the Tohoku Medical Megabank Projects (JP19km0105001 and JP19km0105002 for D.S.) from the Ministry of Education, Culture, Sports, Science and Technology (MEXT) and AMED.

Acknowledgments

We thanks to all technical stuff of all laboratories.

Conflicts of Interest

The authors declare the following competing financial interest(s) and role of the company in composing this paper: Y.O. receives financial support from Eisai Co., Ltd.; K.H. (Kanta Horie) works for Eisai Co., Ltd. (experiments and data analysis, and writing—original draft preparation); Y.H. works for Ono Pharmaceutical Co., Ltd. (experiments and data analysis); M.M. works for Ono Pharmaceutical Co., Ltd. (experiments and data analysis, and writing—original draft preparation); and K.T. works for LSI Medience Corporation (experiments and data analysis, and writing—original draft preparation).

References

  1. Mapelli, V.; Olsson, L.; Nielsen, J. Metabolic footprinting in microbiology: Methods and applications in functional genomics and biotechnology. Trends Biotechnol. 2008, 26, 490–497. [Google Scholar] [CrossRef] [PubMed]
  2. Saito, K.; Matsuda, F. Metabolomics for functional genomics, systems biology, and biotechnology. Annu. Rev. Plant Biol. 2010, 61, 463–489. [Google Scholar] [CrossRef] [PubMed]
  3. Schrimpe-Rutledge, A.C.; Codreanu, S.G.; Sherrod, S.D.; McLean, J.A. Untargeted metabolomics strategies–challenges and emerging directions. J. Am. Soc. Mass Spectrom. 2016, 27, 1897–1905. [Google Scholar] [CrossRef] [PubMed]
  4. Wang, M.; Wang, C.; Han, R.H.; Han, X. Novel advances in shotgun lipidomics for biology and medicine. Prog. Lipid Res. 2016, 61, 83–108. [Google Scholar] [CrossRef] [PubMed]
  5. Wilcoxen, K.M.; Uehara, T.; Myint, K.T.; Sato, Y.; Oda, Y. Practical metabolomics in drug discovery. Expert Opin. Drug Discov. 2010, 5, 249–263. [Google Scholar] [CrossRef] [PubMed]
  6. Adamski, J. Genome-wide association studies with metabolomics. Genome Med. 2012, 4, 34. [Google Scholar] [CrossRef] [PubMed]
  7. Dunn, W.B.; Lin, W.; Broadhurst, D.; Begley, P.; Brown, M.; Zelena, E.; Vaughan, A.A.; Halsall, A.; Harding, N.; Knowles, J.D.; et al. Molecular phenotyping of a UK population: Defining the human serum metabolome. Metabolomics 2015, 11, 9–26. [Google Scholar] [CrossRef]
  8. Zhou, S.; Kremling, K.A.; Bandillo, N.; Richter, A.; Zhang, Y.K.; Ahern, K.R.; Artyukhin, A.B.; Hui, J.X.; Younkin, G.C.; Schroeder, F.C.; et al. Metabolome-scale genome-wide association studies reveal chemical diversity and genetic control of maize specialized metabolites. Plant Cell 2019, 31, 937–955. [Google Scholar] [CrossRef]
  9. Arnold, M.E. Perspectives on the draft ICH-M10 guidance: An interview with Mark Arnold. Bioanalysis 2019, 11, 1379–1382. [Google Scholar] [CrossRef]
  10. Lindon, J.C.; Nicholson, J.K.; Holmes, E.; Keun, H.C.; Craig, A.; Pearce, J.T.; Bruce, S.J.; Hardy, N.; Sansone, S.-A.; Antti, H.; et al. Summary recommendations for standardization and reporting of metabolic analyses. Nat. Biotechnol. 2005, 23, 833–838. [Google Scholar]
  11. Cui, L.; Lu, H.; Lee, Y.H. Challenges and emergent solutions for LC-MS/MS based untargeted metabolomics in diseases. Mass Spectrom. Rev. 2018, 37, 772–792. [Google Scholar] [CrossRef] [PubMed]
  12. Chaleckis, R.; Meister, I.; Zhang, P.; Wheelock, C.E. Challenges, progress and promises of metabolite annotation for LC-MS-based metabolomics. Curr. Opin. Biotechnol. 2019, 55, 44–50. [Google Scholar] [CrossRef] [PubMed]
  13. Liebisch, G.; Ekroos, K.; Hermansson, M.; Ejsing, C.S. Reporting of lipidomics data should be standardized. Biochim. Biophys. Acta Mol. Cell Biol. Lipids 2017, 1862, 747–751. [Google Scholar] [CrossRef] [PubMed]
  14. Collins, B.C.; Hunter, C.L.; Liu, Y.; Schilling, B.; Rosenberger, G.; Bader, S.L.; Chan, D.W.; Gibson, B.W.; Gingras, A.-C.; Held, J.M.; et al. Multi-laboratory assessment of reproducibility, qualitative and quantitative performance of SWATH-mass spectrometry. Nat. Commun. 2017, 8, 291. [Google Scholar] [CrossRef] [PubMed]
  15. Siskos, A.P.; Jain, P.; Römisch-Margl, W.; Bennett, M.; Achaintre, D.; Asad, Y.; Marney, L.; Richardson, L.; Koulman, A.; Griffin, J.L.; et al. Interlaboratory reproducibility of a targeted metabolomics platform for analysis of human serum and plasma. Anal. Chem. 2016, 89, 656–665. [Google Scholar] [CrossRef] [PubMed]
  16. Ulmer, C.Z.; Ragland, J.M.; Koelmel, J.P.; Heckert, A.; Jones, C.M.; Garrett, T.J.; Yost, R.A.; Bowden, J.A. LipidQC: Method validation tool for visual comparison to SRM 1950 using NIST interlaboratory comparison exercise lipid consensus mean estimate values. Anal. Chem. 2017, 89, 13069–13073. [Google Scholar] [CrossRef] [PubMed]
  17. Bowden, J.A.; Heckert, A.; Ulmer, C.Z.; Jones, C.M.; Koelmel, J.P.; Abdullah, L.; Ahonen, L.; Alnouti, Y.; Armando, A.M.; Asara, J.M.; et al. Harmonizing lipidomics: NIST interlaboratory comparison exercise for lipidomics using SRM 1950–Metabolites in Frozen Human Plasma. J. Lipid Res. 2017, 58, 2275–2288. [Google Scholar] [CrossRef]
  18. Burla, B.; Arita, M.; Arita, M.; Bendt, A.K.; Cazenave-Gassiot, A.; Dennis, E.A.; Ekroos, K.; Han, X.; Ikeda, K.; Liebisch, G.; et al. MS-based lipidomics of human blood plasma: A community-initiated position paper to develop accepted guidelines. J. Lipid Res. 2018, 59, 2001–2017. [Google Scholar] [CrossRef]
  19. Anton, G.; Wilson, R.; Yu, Z.H.; Prehn, C.; Zukunft, S.; Adamski, J.; Heier, M.; Meisinger, C.; Römisch-Margl, W.; Wang-Sattler, R.; et al. Pre-analytical sample quality: metabolite ratios as an intrinsic marker for prolonged room temperature exposure of serum samples. PLoS ONE 2015, 10, e0121495. [Google Scholar] [CrossRef]
  20. Haid, M.; Muschet, C.; Wahl, S.; Römisch-Margl, W.; Prehn, C.; Möller, G.; Adamski, J. Long-term stability of human plasma metabolites during storage at–80 °C. J. Proteome Res. 2017, 17, 203–211. [Google Scholar] [CrossRef]
  21. Checa, A.; Bedia, C.; Jaumot, J. Lipidomic data analysis: Tutorial, practical guidelines and applications. Anal. Chim. Acta 2015, 885, 1–16. [Google Scholar] [CrossRef] [PubMed]
  22. Antonelli, J.; Claggett, B.L.; Henglin, M.; Kim, A.; Ovsak, G.; Kim, N.; Deng, K.; Rao, K.; Tyagi, O.; Watrous, J.D.; et al. Statistical workflow for feature selection in human metabolomics data. Metabolites 2019, 9, 143. [Google Scholar] [CrossRef] [PubMed]
  23. Stevens, V.L.; Hoover, E.; Wang, Y.; Zanetti, K.A. Pre-analytical factors that affect metabolite stability in human urine, plasma, and serum: A review. Metabolites 2019, 9, 156. [Google Scholar] [CrossRef] [PubMed]
  24. Yu, B.; Zanetti, K.A.; Temprosa, M.; Albanes, D.; Appel, N.; Barrera, C.B.; Ben-Shlomo, Y.; Boerwinkle, E.; Casas, J.P.; Clish, C.; et al. The consortium of metabolomics studies (COMETS): Metabolomics in 47 prospective cohort studies. Am. J. Epidemiol. 2019, 188, 991–1012. [Google Scholar] [CrossRef]
  25. Soga, T.; Ohashi, Y.; Ueno, Y.; Naraoka, H.; Tomita, M.; Nishioka, T. Quantitative metabolome analysis using capillary electrophoresis mass spectrometry. J. Proteome Res. 2003, 2, 488–494. [Google Scholar] [CrossRef]
  26. Soga, T.; Igarashi, K.; Ito, C.; Mizobuchi, K.; Zimmermann, H.P.; Tomita, M. Metabolomic profiling of anionic metabolites by capillary electrophoresis mass spectrometry. Anal. Chem. 2009, 81, 6165–6174. [Google Scholar] [CrossRef]
  27. Nogami, C.; Sawada, H. Positional and geometrical anionic isomer separations by capillary electrophoresis-electrospray ionization-mass spectrometry. Electrophoresis 2005, 26, 1406–1411. [Google Scholar] [CrossRef]
  28. Klampfl, C.W.; Buchberger, W. Determination of carbohydrates by capillary electrophoresis with electrospray-mass spectrometric detection. Electrophoresis 2001, 22, 2737–2742. [Google Scholar] [CrossRef]
  29. Wikoff, W.R.; Gangoiti, J.A.; Barshop, B.A.; Siuzdak, G. Metabolomics identifies perturbations in human disorders of propionate metabolism. Clin. Chem. 2007, 53, 2169–2176. [Google Scholar] [CrossRef]
  30. Sawada, Y.; Akiyama, K.; Sakata, A.; Kuwahara, A.; Otsuki, H.; Sakurai, T.; Saito, K.; Hirai, M.Y. Widely targeted metabolomics based on large-scale MS/MS data for elucidating metabolite accumulation patterns in plants. Plant Cell Physiol. 2008, 50, 37–47. [Google Scholar] [CrossRef]
  31. Tomita, R.; Todoroki, K.; Maruoka, H.; Yoshida, H.; Fujioka, T.; Nakashima, M.; Yamaguchi, M.; Nohta, H. Amino acid metabolomics using LC-MS/MS: Assessment of cancer-cell resistance in a simulated tumor microenvironment. Anal. Sci. 2016, 32, 893–900. [Google Scholar] [CrossRef] [PubMed]
  32. Shimbo, K.; Oonuki, T.; Yahashi, A.; Hirayama, K.; Miyano, H. Precolumn derivatization reagents for high-speed analysis of amines and amino acids in biological fluid using liquid chromatography/electrospray ionization tandem mass spectrometry. Rapid Commun. Mass Spectrom. 2009, 23, 1483–1492. [Google Scholar] [CrossRef] [PubMed]
  33. Yoshida, H.; Mizukoshi, T.; Hirayama, K.; Miyano, H. Comprehensive analytical method for the determination of hydrophilic metabolites by high-performance liquid chromatography and mass spectrometry. J. Agric. Food Chem. 2007, 55, 551–560. [Google Scholar] [CrossRef] [PubMed]
  34. Hu, S.; Wang, J.; Ji, E.H.; Christison, T.; Lopez, L.; Huang, Y. Targeted metabolomic analysis of head and neck cancer cells using high performance Ion chromatography coupled with a Q exactive HF mass spectrometer. Anal. Chem. 2015, 87, 6371–6379. [Google Scholar] [CrossRef]
  35. Okahashi, N.; Kawana, S.; Iida, J.; Shimizu, H.; Matsuda, F. Fragmentation of dicarboxylic and tricarboxylic acids in the krebs cycle using GC-EI-MS and GC-EI-MS/MS. Mass Spectrom. (Tokyo) 2019, 8, A0073. [Google Scholar] [CrossRef]
  36. Fiehn, O.; Kopka, J.; Trethewey, R.N.; Willmitzer, L. Identification of uncommon plant metabolites based on calculation of elemental compositions using gas chromatography and quadrupole mass spectrometry. Anal. Chem. 2000, 72, 3573–3580. [Google Scholar] [CrossRef]
  37. Nishiumi, S.; Kobayashi, T.; Kawana, S.; Unno, Y.; Sakai, T.; Okamoto, K.; Yamada, Y.; Sudo, K.; Yamaji, T.; Saito, Y.; et al. Investigations in the possibility of early detection of colorectal cancer by gas chromatography/triple-quadrupole mass spectrometry. Oncotarget 2017, 8, 17115–17126. [Google Scholar] [CrossRef] [Green Version]
  38. Tsugawa, H.; Ikeda, K.; Tanaka, W.; Senoo, Y.; Arita, M.; Arita, M. Comprehensive identification of sphingolipid species by in silico retention time and tandem mass spectral library. J. Cheminform. 2017, 9, 19. [Google Scholar] [CrossRef] [Green Version]
  39. Yamada, T.; Uchikata, T.; Sakamoto, S.; Yokoi, Y.; Fukusaki, E.; Bamba, T. Development of a lipid profiling system using reverse-phase liquid chromatography coupled to high-resolution mass spectrometry with rapid polarity switching and an automated lipid identification software. J. Chromatogr. A 2013, 1292, 211–218. [Google Scholar] [CrossRef]
  40. Saito, K.; Ikeda, M.; Kojima, Y.; Hosoi, H.; Saito, Y.; Kondo, S. Lipid profiling of pre-treatment plasma reveals biomarker candidates associated with response rates and hand-foot skin reactions in sorafenib-treated patients. Cancer Chemother. Pharmacolo 2018, 82, 677–684. [Google Scholar] [CrossRef]
  41. Shindou, H.; Koso, H.; Sasaki, J.; Nakanishi, H.; Sagara, H.; Nakagawa, K.M.; Takahashi, Y.; Hishikawa, D.; Iizuka-Hishikawa, Y.; Tokumasu, F.; et al. Docosahexaenoic acid preserves visual function by maintaining correct disc morphology in retinal photoreceptor cells. J. Biol. Chem. 2017, 292, 12054–12064. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  42. Okudaira, M.; Inoue, A.; Shuto, A.; Nakanaga, K.; Kano, K.; Makide, K.; Saigusa, D.; Tomioka, Y.; Aoki, J. Separation and quantification of 2-acyl-1-lysophospholipids and 1-acyl-2-lysophospholipids in biological samples by LC-MS/MS. J. Lipid Res. 2014, 55, 2178–2192. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Takeda, H.; Izumi, Y.; Takahashi, M.; Paxton, T.; Tamura, S.; Koike, T.; Yu, Y.; Kato, N.; Nagase, K.; Shiomi, M.; et al. Widely-targeted quantitative lipidomics method by supercritical fluid chromatography triple quadrupole mass spectrometry. J. Lipid Res. 2018, 59, 1283–1293. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Ogawa, T.; Izumi, Y.; Kusumoto, K.; Fukusaki, E.; Bamba, T. Wide target analysis of acylglycerols in miso (Japanese fermented soybean paste) by supercritical fluid chromatography coupled with triple quadrupole mass spectrometry and the analysis of the correlation between taste and both acylglycerols and free fatty acids. Rapid Commun. Mass Spectrom. 2017, 31, 928–936. [Google Scholar] [PubMed]
Metabolites 09 00257 g001 550
Figure 1. Experimental design in this study. Two crude extract pools were prepared from HT-29 and AsPc-1 cell cultures. The two samples were dispensed and distributed to 12 participating laboratories. In each laboratory, the peak was identified for each metabolite and their relative signal intensity value (HT-29/AsPc-1) was measured according to their sample pretreatment, separation, detection, and data processing methods. Data were compiled and analyzed using statistical tests.
Figure 1. Experimental design in this study. Two crude extract pools were prepared from HT-29 and AsPc-1 cell cultures. The two samples were dispensed and distributed to 12 participating laboratories. In each laboratory, the peak was identified for each metabolite and their relative signal intensity value (HT-29/AsPc-1) was measured according to their sample pretreatment, separation, detection, and data processing methods. Data were compiled and analyzed using statistical tests.
Metabolites 09 00257 g001
Metabolites 09 00257 g002 550
Figure 2. Number of metabolites detected by each analytical method (A) and percentage of metabolites commonly measured by the multiple methods (B). In total 203 hydrophilic metabolites and 580 hydrophobic metabolites were identified in both HT-29 and AsPc-1 cell extracts. Among them, 148 hydrophilic metabolites and 285 hydrophobic metabolites were measured across multiple methods.
Figure 2. Number of metabolites detected by each analytical method (A) and percentage of metabolites commonly measured by the multiple methods (B). In total 203 hydrophilic metabolites and 580 hydrophobic metabolites were identified in both HT-29 and AsPc-1 cell extracts. Among them, 148 hydrophilic metabolites and 285 hydrophobic metabolites were measured across multiple methods.
Metabolites 09 00257 g002
Metabolites 09 00257 g003 550
Figure 3. Inter-laboratory comparison of relative quantification for amino acids. Red bars indicate outliers based on a one-way ANOVA analysis (α = 0.05). Values are presented as the mean ± SD obtained from triplicate experiments.
Figure 3. Inter-laboratory comparison of relative quantification for amino acids. Red bars indicate outliers based on a one-way ANOVA analysis (α = 0.05). Values are presented as the mean ± SD obtained from triplicate experiments.
Metabolites 09 00257 g003
Metabolites 09 00257 g004 550
Figure 4. The effect of isomer discrimination on comparison of relative determinations for hexoses (A), PI 38:2 (B), and PE 34:2 (C). Values are presented as the mean ± SD obtained from triplicate experiments.
Figure 4. The effect of isomer discrimination on comparison of relative determinations for hexoses (A), PI 38:2 (B), and PE 34:2 (C). Values are presented as the mean ± SD obtained from triplicate experiments.
Metabolites 09 00257 g004
Table
Table 1. Information on analytical methods used for hydrophilic metabolites.
Table 1. Information on analytical methods used for hydrophilic metabolites.
Method IDLab IDAnalytical MethodAnalytical ModeTargeted Hydrophilic MetabolitesRef.
A1CE-TOFMS (cation mode)Scan (positive)Amino acids, Bases, Nucleosides, Amines, etc.[25]
B2CE-TOFMS (cation mode)Scan (positive)Amino acids, Bases, Nucleosides, Amines, etc.[25]
C1CE-TOFMS (anion mode)Scan (negative)Organic acids, Sugar phosphates, Nucleotides, etc.[26]
D2CE-TOFMS (anion mode)Scan (negative)Organic acids, Sugar phosphates, Nucleotides, etc.[27]
E1CE-TQMS (anion mode)MRM (negative)Monosaccharides[28]
F2C18-LC/QTOFMSScan (positive/negative)Amino acids, Organic acids, Nucleotides, etc.[29]
G3C18-LC/TQMSMRM (positive/negative)Amino acids, Organic acids, Nucleotides, etc.[30]
H4C18-LC/TQMSMRM (positive)Amino acids[31]
I5Derivatization and C18-LC/TQMSMRM (positive)Amino acids, etc.[32]
J6PFPP-LC/Q Exactive Scan (positive/negative)Amino acids, Bases, Nucleosides, Amines, Organic acids, etc.[33]
K1Capillary-IC/Q ExactiveScan (negative)Organic acids, Sugar phosphates, Nucleotides, etc.[34]
L6IC/Q ExactiveScan (positive/negative)Organic acids, Sugar phosphates, Nucleotides, etc.[34]
M7Derivatization and GC/QMSSIMAmino acids, Organic acid, etc.[35]
N6Derivatization and GC/QMSScanAmino acids, Organic acid, etc.[36]
O8Derivatization and GC/TQMSMRMAmino acids, Organic acid, Base, Nucleosides, etc.[37]
PFPP, pentafluorophenylpropyl; and SIM, selected ion monitoring.
Table
Table 2. Information on analytical methods used to analyze hydrophobic metabolites.
Table 2. Information on analytical methods used to analyze hydrophobic metabolites.
Method IDLab IDAnalytical MethodAnalytical ModeTargeted LipidsRef.
A9C18-LC/QTOFMS Scan (positive/negative)ChE, Cer(NS), DG, FA, HexCer(NS), LPC, LPE, LPI, LPS, PC, PE, PG, PI, PS, SM[38]
B5C8-LC/Q ExactiveScan (positive)AC, HexCer(NS), LPC, LPE, LPS, PC, PE, SM[39]
C5C8-LC/Q ExactiveScan (negative)LPE, LPG, LPI, PC, PE, PG, PI, PS[39]
D10C18-LC/Orbitrap FusionScan (positive/negative)AC, ChE, Cer(NS), DG, HexCer(NS), LPC, LPE, LPI, LPS, PC, PE, PG, PI, PS, SM, TG[40]
E11C8-LC/TQMSMRM (positive/negative)LPC, LPE, LPI, LPS, PC, PE, PI, PS, SM‒
F12C18-LC/TQMSMRM (positive)ChE, Cer(NS), LPA, LPC, LPE, LPG, LPI, LPS, MG[41]
G8C18-LC/TQMSMRM (positive/negative)LPA, LPC, LPE, LPG, LPI, LPS[42]
H6Diethylamine-SFC/TQMSMRM (positive/negative)Cer(NS), DG, HexCer(NS), LPC, LPE, MG, PA, PC, PE, PG, PI, PS, SM[43]
I6C18-SFC/TQMSMRM (positive/negative)ChE, FA, TG[44]
Table
Table 3. Summary of the dataset.
Table 3. Summary of the dataset.
Hydrophilic MetaboliteHydrophobic MetaboliteTotal
1. Number of identified metabolites from HT-29 and/or AsPc-1 samples by at least one analytical method206584790
2. Number of identified metabolites from both samples by two or more methods148285433
3. Number of metabolites that were statistically significant between samples HT-29 and AsPc-1 among multiple methods based on a two-sided Student’s t-test (α = 0.05)104199303
4. Number of metabolites that showed HT-29/AsPc-1 levels in different directions among methods based on a two-sided Student’s t-test (α = 0.05) and a relative quantitative value of 15712
5. Number of metabolites that were statistically similar HT-29/AsPc-1 levels among multiple methods using a one-way ANOVA (α = 0.05)57113170
6. Number of metabolites that were statistically similar HT-29/AsPc-1 levels among multiple methods ignoring one outlier method using a one-way ANOVA (α = 0.05)98162260

Share and Cite

MDPI and ACS Style

Izumi, Y.; Matsuda, F.; Hirayama, A.; Ikeda, K.; Kita, Y.; Horie, K.; Saigusa, D.; Saito, K.; Sawada, Y.; Nakanishi, H.; et al. Inter-Laboratory Comparison of Metabolite Measurements for Metabolomics Data Integration. Metabolites 2019, 9, 257. https://doi.org/10.3390/metabo9110257

AMA Style

Izumi Y, Matsuda F, Hirayama A, Ikeda K, Kita Y, Horie K, Saigusa D, Saito K, Sawada Y, Nakanishi H, et al. Inter-Laboratory Comparison of Metabolite Measurements for Metabolomics Data Integration. Metabolites. 2019; 9(11):257. https://doi.org/10.3390/metabo9110257

Chicago/Turabian Style

Izumi, Yoshihiro, Fumio Matsuda, Akiyoshi Hirayama, Kazutaka Ikeda, Yoshihiro Kita, Kanta Horie, Daisuke Saigusa, Kosuke Saito, Yuji Sawada, Hiroki Nakanishi, and et al. 2019. "Inter-Laboratory Comparison of Metabolite Measurements for Metabolomics Data Integration" Metabolites 9, no. 11: 257. https://doi.org/10.3390/metabo9110257

APA Style

Izumi, Y., Matsuda, F., Hirayama, A., Ikeda, K., Kita, Y., Horie, K., Saigusa, D., Saito, K., Sawada, Y., Nakanishi, H., Okahashi, N., Takahashi, M., Nakao, M., Hata, K., Hoshi, Y., Morihara, M., Tanabe, K., Bamba, T., & Oda, Y. (2019). Inter-Laboratory Comparison of Metabolite Measurements for Metabolomics Data Integration. Metabolites, 9(11), 257. https://doi.org/10.3390/metabo9110257

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop