Next Article in Journal
Federated Learning Approach with Pre-Trained Deep Learning Models for COVID-19 Detection from Unsegmented CT images
Previous Article in Journal
Abundance and Niche Differentiation of Comammox in the Sludges of Wastewater Treatment Plants That Use the Anaerobic–Anoxic–Aerobic Process
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Integration of Morphometrics and Machine Learning Enables Accurate Distinction between Wild and Farmed Common Carp

by
Omid Jafari
1,*,
Mansour Ebrahimi
2,
Seyed Ali-Akbar Hedayati
3,
Mehrshad Zeinalabedini
4,
Hadi Poorbagher
5,
Maryam Nasrolahpourmoghadam
5 and
Jorge M. O. Fernandes
6,*
1
International Sturgeon Research Institute, Iranian Fisheries Science Research Institute, Agricultural Research, Education and Extension Organization, Rasht 416353464, Iran
2
Department of Biology, School of Basic Science, University of Qom, Qom 3716146611, Iran
3
Department of Fisheries, Faculty of Fisheries and Environmental Sciences, Gorgan University of Agricultural Sciences and Natural Resources, Gorgan 4913815739, Iran
4
Department of Genomics, Agricultural Biotechnology Research Institute of Iran (ABRII), Karaj 3135933151, Iran
5
Department of Fisheries Sciences, Faculty of Natural Resources, University of Tehran, Karaj 3158777871, Iran
6
Faculty of Biosciences and Aquaculture, Nord University, 8026 Bodø, Norway
*
Authors to whom correspondence should be addressed.
Life 2022, 12(7), 957; https://doi.org/10.3390/life12070957
Submission received: 4 April 2022 / Revised: 16 June 2022 / Accepted: 20 June 2022 / Published: 25 June 2022

Abstract

:
Morphology and feature selection are key approaches to address several issues in fisheries science and stock management, such as the hypothesis of admixture of Caspian common carp (Cyprinus carpio) and farmed carp stocks in Iran. The present study was performed to investigate the population classification of common carp in the southern Caspian basin using data mining algorithms to find the most important characteristic(s) differing between Iranian and farmed common carp. A total of 74 individuals were collected from three locations within the southern Caspian basin and from one farm between November 2015 and April 2016. A dataset of 26 traditional morphometric (TMM) attributes and a dataset of 14 geometric landmark points were constructed and then subjected to various machine learning methods. In general, the machine learning methods had a higher prediction rate with TMM datasets. The highest decision tree accuracy of 77% was obtained by rule and decision tree parallel algorithms, and “head height on eye area” was selected as the best marker to distinguish between wild and farmed common carp. Various machine learning algorithms were evaluated, and we found that the linear discriminant was the best method, with 81.1% accuracy. The results obtained from this novel approach indicate that Darwin’s domestication syndrome is observed in common carp. Moreover, they pave the way for automated detection of farmed fish, which will be most beneficial to detect escapees and improve restocking programs.

1. Introduction

The Cyprinidae clade has the broadest geographical distribution among fish families, with more than 2000 species across four continents [1]. Cyprinids contribute to over 20 million metric tons of worldwide fish production, which equates to 40% of total global aquaculture production, and 70% of total freshwater fish farming [2]. Common carp (Cyprinus carpio) is an economically important species of Cyprinidae, originally native to Central Asia and introduced worldwide over time [3]. Native common carp is found throughout all Caspian Sea drainages from north to south and from west to east, as the fish enter the rivers to breed. A dramatic stock reduction has been observed recently due to overfishing and dam construction during the last few decades. While the Iranian Fisheries Organization has practiced semi-artificial fingerling production to boost Caspian Sea fish stocks, the capture rate of Caspian carp still shows no improvement. Among several reasons accounting for the unsuccessful recovery programs of Caspian fish species, mixing events between wild and farmed populations are of utmost importance.
Investigation of the diagnostic morphological features has been taken into consideration in fisheries science and ichthyology to identify and define different species and strains [4,5,6]. The farmed stocks of common carp in Iranian farms are from the European strain, which has a deeper body form than native common carp from the Caspian Sea. Domestication, as a process in which wild animals are adapted to anthropogenic conditions, has been recognized to produce behavioral, molecular, and morphological alterations through generations [7,8]. According to the phenomenon known as Darwin’s domestication syndrome [9], the captive phenotypes show distinctive traits compared with their wild conspecifics of similar sizes, such as faster growth and maturity under the nurture conditions and lower reproductive success [10] and reduced swimming performance in nature [11]. It has been postulated that the cultured carp strain may have escaped from the farms and hybridized with common wild carp in the Caspian Sea [12,13,14]. In their study, Khalili and Amirkolaie [15] found some genotypes of farmed common carp in the Caspian Sea. Mixing wild populations and/or hybridization events between farmed and native species will reduce the genetic diversity and fitness of the species [16,17,18].
Computational approaches such as machine learning, decision trees, and attribute weighting have been used in biological data processing to determine evolutionary solutions of pattern identification, classification, and prediction [19,20,21,22,23]. Decision tree models find the best possible decision from serial decisions made in uncertain conditions [24,25,26,27,28]. These robust models can be used on different sets of biological (e.g., phenotypic) data. Guisande et al. [29] successfully identified 847 marine and freshwater fish species using a machine-learning-based system (IPez) and supportably a high accuracy and fast prediction for fish classification based on machine learning techniques reported by Hnin and Lynn [30]. Genetic/genomic data provide helpful information on the assignment of fish populations, but morphometric data have advantages compared with molecular data, since they are relatively easier, cheaper, and faster to obtain. The application of morphometric data in robust machine-learning-based algorithms is expected to provide fast, reliable, and accurate detection in fish animals compared with traditional methods [31]. Hence, the present study was conducted to investigate the potential of machine learning to (i) identify morph variability of common carp in different habitats, and to (ii) introduce the diagnostic morphometric feature(s) to distinguish wild Caspian carp population from their farmed counterparts.

2. Materials and Methods

2.1. Sampling

Sixty specimens were taken from three locations in the southern Caspian basin, including Gomishan (E: 53°29′, N: 37°51′), Miankaleh (E: 53°30′, N: 36°52′), and Anzali (E: 49°26′, N: 37°25′) (Figure 1) from November 2015 to April 2016. In addition, 14 specimens of farmed common carp were obtained from a fish farm at Sijoval (E: 54°07′, N: 36°53′) in Golestan province. Fish were anesthetized immediately by immersion in a 200 ppm solution of clove powder, weighed, and a photo from the left side of each fish was taken. The number of annuli in scales or otoliths was not determined but, based on fish size, their age range can be estimated from one to three years.

2.2. Data Preparation

The traditional morphometric (TMM) data, including 26 features (Figure 2), were extracted using the ImageJ Software Version 1.45s, Bethesda, MD, USA [32]. To minimize the effect of fish size on the measured morphometric characters, the allometric method of the PAST Software Version 2.17c, Oslo, Norway [33] was used on the raw morphometric data [34].
M a d j = M   ( L s L o ) b
Madj is the adjusted measurement of size, M is the observed length of each character, and Ls is the overall average size of standard length. Lo stands for standard height for each sample, and b is related to the allometric growth coefficient. All measurements can be found in Supplementary Materials Table S1.
In order to investigate the body form variations of common carp understudy, 14 landmark points were digitized on the left side of each specimens using tpsDig2 Version 2.16 (Figure 3).

2.3. Data Analysis

Regarding the TMM, a dataset containing 76 samples (14 from Anzali, 27 from Gomishan, 19 from Miankaleh, and 14 from farmed population) with 26 measured features were imported into RapidMiner software Version 7.0 (Rapid-I, GmbH, Dortmund, Germany), shuffled, and missing data were handled, and the output cleaned file was named as FCDB (final cleaned database). A one-way ANOVA was performed on the morphometric data to assess the level of variability of each trait among different locations. In order to remove the effects of non-shape data, including scale, direction, and position on geometric morphometric data, a generalized Procrustes analysis (GPA) was performed on the landmark-obtained data using Morpho J version 1.02 [35]. After normalization, the consensus shape variations of Caspian and farmed common carp were visualized using the wireframe graphs in Morpho J. Then, the following steps of data mining analysis were performed on the FCDB datasets of both TMM and geomorph data.

2.3.1. Attribute Weighting

Attribute weighting is a unique method to illustrate the impact of each feature on the target or label attribute [36,37]. Ten attribute weighting algorithms, namely PCA, SVM, relief, uncertainty, Gini index, chi-squared, deviation, rule, information gain, and information gain ratio, were applied to the FCDB. Each attribute weighting method or feature selection model gives a weighted score between 0.0 and 1.0 for each attribute based on their impact on the population target feature. The attributes with a weighted score greater than 0.70 in all algorithms were considered important features. Generally speaking, the relevance of a feature to each weighting model is calculated based on the class distribution, as follows [38].
  • Information gain: The relevance of an attribute is evaluated by computing the information gain.
  • Information gain ratio: Calculates the correlation of a feature by computing the information gain ratio.
  • Weight by rule: The operator calculates the relation of a feature through computing the error rate of a model on the dataset without this attribute.
  • Weight by deviation: Weights from the standard deviations of all the features are used by this operator.
  • Weight by Chi Squared statistic: This operator quantifies the correlation of a feature by computing for each attribute of the input dataset the value of the chi-squared statistic considering the class attribute.
  • Weight by Gini Index: The relevance of a feature is determined by computing the Gini index of the class distribution.
  • Weight by Uncertainty: This operator uses the connection of an attribute by measuring the symmetrical uncertainty considering the class distribution.
  • Weight by Relief: This operator calculates the relevance of the attributes by relief. The key idea of relief is to estimate the quality of features according to how well their values distinguish between the instances of the same and different classes that are near each other.
  • Weight by Support Vector Machine (SVM): The coefficients of the normal vector of a linear SVM are considered as weights of the features.
  • Weight by PCA: Factors of the first principal component are used to weight features.

2.3.2. Machine Learning Prediction of Target Populations

The original FCDB and the ten datasets from the attribute weighting models above were then used to develop machine-based prediction systems. The performance of each model on each dataset was measured based on their accuracy [38].

Tree Induction

Tree induction is an efficient and popular method in the classification of populations. In order to make decision trees, four different induction algorithms (decision tree, random forest, decision tree parallel, and decision stump) were applied to all 11 datasets (the FCDB and 10 generated datasets from attribute weighting models, including only the important features that scored higher than 0.70; Supplementary Materials Table S1). Each tree induction algorithm was run with four other criteria (gain ratio, information gain, Gini index, and accuracy) using a 10-fold cross-validation based on our previously published papers and default parameters for a local random seed and stratified sampling type [39,40,41,42,43]. Hence, a total of 176 trees were generated.

2.3.3. Linear Discriminant Analysis (LDA)

The LDA method [44] tries to separate two or more target classes by linear features. The resulting linear classifier made of combination features is used to discriminate variables between two or more naturally occurring groups, whether with a descriptive or a predictive objective. The same 11 datasets mentioned above were fed into this model and calculated its accuracy performance. The LDA on geomorph data was per-192 formed using the Morpho J software version 1.02.

3. Results

3.1. Attribute Weighting (Feature Selection) Models

One-way ANOVA on morphometric data showed that 24 out of 26 investigated morphometric traits were significantly different from each other (p < 0.05), the exceptions being caudal peduncle length and anal fin base length. In traditional morphometric (TMM) data, 80% of attribute weighting models allocated weights greater than 0.7–HH1 (maximum head height); Gini index, info gain, and info gain ratio models computed the highest possible weights of 1.0 to this feature. A proportion of 70% of the attribute weighting models assigned weights greater than 0.7 to PelH (pelvic fin height) feature while POL (postorbital length), HL (head length), and PH (pectoral fin height) were identified by 50% of the models with weights above 0.7 (Table 1). The complete attribute weighting results are available in Supplementary Materials Table S2. In attribute weighting models using the geomorph dataset, landmark point 12 (related to the pectoral fin position) was recognized by 70% of the models to have weight higher than 0.7 and after that landmark point 5 (close to the beginning position of dorsal fin) was supported by 50% of models with weight above 0.7 (Table 2).

3.2. Predictions Based on Machine-Learning Algorithms

The overall performance of the 16 different tree induction models applied on 11 datasets was less than 60% in most cases. The best performance (77%) on the basis of TMM approach was obtained when the decision tree parallel model ran on the rule dataset with accuracy criterion. The best performance of the decision tree stump model was 59%; under the decision tree model, the performance went up to 0.72 (see Table 3). The Gini index criterion showed the best performance on the Gini Index database was for the random forest algorithm.
Based on the visualized induced tree with the highest performance on TMM (Figure 4A), the HH1 (head height) trait was recognized as the best feature of the tree’s root to identify common carp populations. When HH1 was greater than 8.079, and the value for ED feature (eye diameter) was higher than 1.44, the samples belonged to the Anzali population; otherwise, they were from the farmed group. Moreover, when the value of POL is >4.249, carp individuals with HH1 ≤ 7.824 and 7.824 < HH1 ≤ 8.079 originate from Anzali and Gomishan populations, respectively. The Miankaleh population includes individuals with POL is ≤4.249 and HH1 ≤ 6.335. Based on geomorph data, Random Forest with accuracy criterion resulted in a maximum of 61% precision using FCDB dataset (Figure 4B). The best performance of the naïve Bayes models on the 11 prepared datasets of each traditional and geomorph approaches was 0.77 and 0.60, respectively, obtained when the naïve Bayes model ran on FCDB (Table 4).

3.3. Linear Discriminant Analysis (LDA)

The overall prediction accuracy of LDA was over 81% with the FCDB of TMM approach, while the LDA accuracy based on geometric morphometric was only 57.9%. The best class prediction was computed for farmed site samples with a precision that reached 100%. The Anzali class was the second best, predicted with 87.5% accuracy but less precision (Table 5). The clustering of individual fish in the LDA model showed that the first two components of the LD explained 89% of the variation among the populations. The farmed populations constituted an utterly separate group according to LD1 and LD2 (Figure 5). The ANOVA based on LD1 showed significant differences between the populations of common carp (F-value = 229.5, p < 0.001); the Gomishan and Miankaleh samples were the only pairwise comparison that did not show a significant difference (p = 0.266).

3.4. Geomorph Variations

The body form variations of common carp showed that the first two components represented 89% of the variance (PC1 = 58% and PC2 = 31%) among the populations studied; landmarks 4, 5, 11, 12, and 13 were the most variable (Figure 5). The CVA scatter plot based on the geomorph data illustrated a distribution pattern similar to the TMM approach, separating the farmed population from the Caspian carp populations (Figure S1). Comparison of body shapes between Caspian and farmed common carp populations revealed that they differed in body depth and head size (Figure 6).

4. Discussion

The new machine learning tools used in the present study enabled us to accurately distinguish farmed common carp from its wild counterparts in the southern Caspian Sea using morphometric information. Based on the morphological data obtained in this study, we suggest a considerable admixture structure of wild common carp in the south–southeast of the Caspian Sea, while Anzali in the southwest represented a distinct stock of the Caspian common carp. Wild population management is critically dependent on maintaining the populations’ differentiation to stabilize the productivity of ecosystems as a whole [45]. Machine learning analysis is well documented in biology [46], but in aquaculture and fisheries science, this approach is still in its infancy. This study analyzed the morphometric data (traditional morphometric and geometric morphometric) taken from common carp across the southern Caspian basin using new machine learning analysis methods, including attribute weighting, decision tree, and naïve Bayes prediction. The highest accuracy and prediction power were obtained by applying these models on traditional morphometric datasets. The higher accuracy by traditional morphometrics may be due to the fact that geometric morphometric data are two-dimensional data and need to be converted to distance-like data in TMM. Based on 10 attribute weighting models, 80% of the models identified head height as the key trait contributing to variation among populations. The farmed population had a larger head height (8.19 ± 0.52 cm) compared with the wild forms (Table S3), while amongst the wild Caspian common carp, head height was larger in Anzali (7.36 ± 2.13 cm) than in Gomishan (7.03 ± 1.60 cm) and Miankaleh (6.99 ± 1.18 cm). This phenotype is likely linked to the domestication syndrome in farmed carp and to differences in environmental conditions between locations in the case of Anzali (a resident form of wild carp in Anzali lagoon) versus Miankaleh and Gomishan populations (Caspian carp). Domestication generates morphologic alterations leading to captive phenotypes across several generations and is accompanied by epigenetic and genetic changes [7,8,47]. Head depth enlargement and deeper caudal peduncle and body profile have been observed as typical characteristics of the captive phenotypes in steelhead trout compared with the wild counterparts [48]. Body shape variation of common carp based on geomorph data also supported a deeper body form and larger head size in farmed population compared with the Caspian form of common carp. Hence, head size, especially head height, and body depth are the main parameters that distinguish the Iranian stocks of common carp from the farmed population.
The results obtained from decision trees have categorized the fish groups correctly. The comparison between the best-obtained accuracy by decision tree (79%) and naïve Bayesian model (77%) indicates no substantial difference between these two methods of machine learning analysis in categorizing common carp populations using morphometric information. The highest accuracy obtained was 81% by LDA, which could be further improved by increasing the dataset size. Nevertheless, the farmed population was accurately identified through the current models. It seems that admixture of the wild stocks has diminished the overall accuracy, especially in the southeast population. The wild stocks of common carp across the southern coasts of the Caspian Sea have been experiencing mixing between them due to the semi-natural proliferation and restocking program. It should be noted that some individuals that have not been correctly categorized based on the location of sampling can be related to migration between sites. Several publications have mentioned the negative effects of dam constructions on marine life [49,50]. The Caspian Sea is a closed lake, and its seawater level has decreased by two meters since 1995 [51]. Dam building programs on the main drainages of the Caspian Sea and global warming are thought to be the main causes of the lowering sea level, which in turn reduces the breeding and feeding grounds of common carp, and makes mixing of wild populations more likely than before. Migration events can also be explained by the restocking program since fish are not always released in the location where they had initially been caught for reproduction. Based on the classification using cluster analysis, it can be concluded that, in the Caspian Sea, there are two phenotypically distinct and geographically separated groups of common carp: (i) one population in the west (Anzali) and (ii) a stock including Gomishan and Miankaleh populations. This observation is supported by the genomic structure investigation of common carp in the Caspian Sea [52]. During the past decade, landings of common carp have seen a dramatic reduction, and the LDA plot obtained in the present study indicates that the stocks of common carp are experiencing a reduction in heterozygosity. Machine-learning- and deep-learning-based analytical toolkits provide the most accurate predictions, practical advantages over the basic statistical models, such as easily identification of trends and patterns, continued improvement, handling multi-dimensional and multi-variety data, and a wide range of applications [53]. While population and sub-population identification of fish species is of great importance in conservation ecology and applied ichthyology [54], most studies of novel analytical methods such as deep learning on the fish animals have focused their applicability on fish species identification. In a study performed on commercial carp species, deep-learning-based methods were applied and successfully identified four different species of farmed carp [55]. In the Triglidae family, three morphologically similar species were recognized based on morphometric data using the deep learning approach [56]. Courtenay et al. [57] have tested the potential of deep learning on the processing of morphological data to provide a hybrid approach that efficiently overcomes taphonomic equifinality in the archaeological and paleontological register.

5. Conclusions

To the best of our knowledge, this is the first time that machine learning algorithms have been used in fish stock management using both morphometric and geometric–morphometric information. The origin of common carp individuals caught in the southern basin of the Caspian Sea was predicted with maximum accuracy by the LDA prediction model, which could be further improved using a larger dataset. The present study demonstrates that machine-learning-based methods can be successfully applied to morphometric data to accurately assign common carp specimens to farmed or wild populations. Thus, machine learning and deep learning methods have enormous potential in aquaculture, fisheries, and ecology to identify farmed escapees in wild stocks, manage restocking programs, and monitor the robustness of fish in aquaculture conditions.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/life12070957/s1, Table S1: 11 different generated datasets using attribute weighting models on the morphometric traits of common carp, Table S2: The whole results of ten attribute weighting models on traditional morphometric data of Caspian carp, Table S3: Mean ± SD for each morphometric trait of common carp per each region, Figure S1: The CVA scatter plot of farmed and Caspian carp populations based on the first two components using geomorph data (A—Anzali lagoon; P—farmed population; M—Miankaleh; G: Gomishan).

Author Contributions

O.J. designed and performed the field sampling, data analysis and wrote the manuscript; J.M.O.F. contributed to writing and final revision of the manuscript; M.E. performed the related machine learning analysis; H.P. and M.N. assisted in sampling and statistical data analysis; M.Z. contributed to writing the manuscript; S.A.-A.H. provided the required infrastructure for fish sampling. All authors have read and agreed to the published version of the manuscript.

Funding

This study received additional support from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation program [Grant agreement no. 683210] and from the Research Council of Norway under the Toppforsk program [Grant agreement no. 250548/F20].

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of the Canadian Council on Animal Care, and approved by the ethics committee of Gorgan University of Agricultural Sciences and Natural Resources, Iran (project 95-354-98, November 2015).

Data Availability Statement

All datasets generated for this study are included in the manuscript and in the Supplementary Materials.

Acknowledgments

The authors are grateful to the Agricultural Research, Education, and Extension Organization (AREEO) for providing the required financial and technical support and Nord University (Norway) covering the open access publication fee.

Conflicts of Interest

The authors declare that they have no competing interest.

References

  1. Imoto, J.M.; Saitoh, K.; Sasaki, T.; Yonezawa, T.; Adachi, J.; Kartavtsev, Y.P.; Miya, M.; Nishida, M.; Hanzawa, N. Phylogeny and biogeography of highly diverged freshwater fish species (Leuciscinae, Cyprinidae, Teleostei) inferred from mitochondrial genome analysis. Gene 2013, 514, 112–124. [Google Scholar] [CrossRef] [PubMed]
  2. Xu, P.; Zhang, X.; Wang, X.; Li, J.; Liu, G.; Kuang, Y.; Xu, J.; Zheng, X.; Ren, L.; Wang, G. Genome sequence and genetic diversity of the common carp, Cyprinus carpio. Nat. Genet. 2014, 46, 1212–1219. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Kohlmann, K.; Gross, R.; Murakaeva, A.; Kersten, P. Genetic variability and structure of common carp (Cyprinus carpio) populations throughout the distribution range inferred from allozyme, microsatellite and mitochondrial DNA markers. Aquat. Living Resour. 2003, 16, 421–431. [Google Scholar] [CrossRef]
  4. Akbarzadeh, A.; Farahmand, H.; Shabani, A.; Karami, M.; Kaboli, M.; Abbasi, K.; Rafiee, G. Morphological variation of the pikeperch Sander lucioperca (L.) in the southern Caspian Sea, using a truss system. J. Appl. Ichthyol. 2009, 25, 576–582. [Google Scholar] [CrossRef]
  5. Ibañez, A.L.; Cowx, I.G.; O’higgins, P. Geometric morphometric analysis of fish scales for identifying genera, species, and local populations within the Mugilidae. Can. J. Fish. Aquat. Sci. 2007, 64, 1091–1100. [Google Scholar] [CrossRef] [Green Version]
  6. Krpo-Ćetković, J.; Stamenković, S. Morphological differentiation of the pikeperch Stizostedion lucioperca (L.) populations from the Yugoslav part of the Danube. In Proceedings of the Annales Zoologici Fennici, Helsinki, Finland, 28 November 1996; pp. 711–723. [Google Scholar]
  7. Konstantinidis, I.; Saetrom, P.; Mjelle, R.; Nedoluzhko, A.V.; Robledo, D.; Fernandes, J.M.O. Major gene expression changes and epigenetic remodelling in Nile tilapia muscle after just one generation of domestication. Epigenetics 2020, 15, 1052–1067. [Google Scholar] [CrossRef] [Green Version]
  8. Podgorniak, T.; Brockmann, S.; Konstantinidis, I.; Fernandes, J.M.O. Differences in the fast muscle methylome provide insight into sex-specific epigenetic regulation of growth in Nile tilapia during early stages of domestication. Epigenetics 2019, 14, 818–836. [Google Scholar] [CrossRef]
  9. Wilkins, A.S.; Wrangham, R.W.; Fitch, W.T. The “domestication syndrome” in mammals: A unified explanation based on neural crest cell behavior and genetics. Genetics 2014, 197, 795–808. [Google Scholar] [CrossRef] [Green Version]
  10. Araki, H.; Cooper, B.; Blouin, M.S. Genetic effects of captive breeding cause a rapid, cumulative fitness decline in the wild. Science 2007, 318, 100–103. [Google Scholar] [CrossRef] [Green Version]
  11. Magnan, P.; Reinbold, D.; Thorgaard, G.H.T.H.; Carter, P.A.C.A. Reduced swimming performance and increased growth in domesticated rainbow trout, Oncorhynchus mykiss. Can. J. Fish. Aquat. Sci. 2009, 66, 1025–1032. [Google Scholar] [CrossRef]
  12. Hansen, L.P.; Jacobsen, J.A.; Lund, R.A. High numbers of farmed Atlantic salmon. Salmo salar L., observed in oceanic waters north of the Faroe Islands. Aquac. Res. 1993, 24, 777–781. [Google Scholar] [CrossRef]
  13. Naylor, R.L.; Goldburg, R.J.; Primavera, J.H.; Kautsky, N.; Beveridge, M.C.; Clay, J.; Folke, C.; Lubchenco, J.; Mooney, H.; Troell, M. Effect of aquaculture on world fish supplies. Nature 2000, 405, 1017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Ohara, K.; Ariyoshi, T.; Sumida, E.; Sitizyo, K.; Taniguchi, N. Natural hybridization between diploid crucian carp species and genetic independence of triploid crucian carp elucidated by DNA markers. Zool. Sci. 2000, 17, 357–364. [Google Scholar]
  15. Khalili, K.J.; Amirkolaie, A.K. Comparison of common carp (Cyprinus carpio L.) morphological and electrophoretic characteristics in the southern coast of the Caspian Sea. J. Fish. Aquat. Sci. 2010, 5, 200–207. [Google Scholar] [CrossRef] [Green Version]
  16. Wang, L.; Shi, X.; Su, Y.; Meng, Z.; Lin, H. Loss of genetic diversity in the cultured stocks of the large yellow croaker, Larimichthys crocea, revealed by microsatellites. Int. J. Mol. Sci. 2012, 13, 5584–5597. [Google Scholar] [CrossRef] [Green Version]
  17. Johnson, D.; Freiwald, J.; Bernardi, G. Genetic diversity affects the strength of population regulation in a marine fish. Ecology 2016, 97, 627–639. [Google Scholar] [CrossRef]
  18. Li, L.; Lin, H.; Tang, W.; Liu, D.; Bao, B.; Yang, J. Population genetic structure in wild and aquaculture populations of Hemibarbus maculates inferred from microsatellites markers. Aquac. Fish. 2017, 2, 78–83. [Google Scholar] [CrossRef]
  19. Zhang, H. The Optimality of Naive Bayes. In Proceedings of the Seventeenth International Florida Artificial Intelligence Research Society Conference, Menlo Park, CA, USA, 12–14 May 2004. [Google Scholar]
  20. Nasa, C. Evaluation of different classification techniques for web data. Int. J. Comput. Appl. 2012, 52, 34–40. [Google Scholar] [CrossRef]
  21. Grossman, D.; Domingos, P. Learning Bayesian network classifiers by maximizing conditional likelihood. In Proceedings of the Twenty-first international conference on Machine learning, Banff, AB, Canada, 4–8 July 2004; p. 46. [Google Scholar]
  22. Lewis, D.D. Naive (Bayes) at forty: The independence assumption in information retrieval. In Proceedings of the European conference on machine learning, Chemnitz, Germany, 21–23 April 1998; pp. 4–15. [Google Scholar]
  23. Bernardo, J.; Bayarri, M.; Berger, J.; Dawid, A.; Heckerman, D.; Smith, A.; West, M. Bayesian factor regression models in the “large p, small n” paradigm. Bayesian Stat. 2003, 7, 733–742. [Google Scholar]
  24. Zhao, Y.; Zhang, Y. Comparison of decision tree methods for finding active objects. Adv. Space Res. 2008, 41, 1955–1959. [Google Scholar] [CrossRef] [Green Version]
  25. Provost, F.; Domingos, P. Tree induction for probability-based ranking. Mach. Learn. 2003, 52, 199–215. [Google Scholar] [CrossRef]
  26. Kingsford, C.; Salzberg, S.L. What are decision trees? Nat. Biotechnol. 2008, 26, 1011. [Google Scholar] [CrossRef] [PubMed]
  27. Quinlan, J.R. Induction of decision trees. Mach. Learn. 1986, 1, 81–106. [Google Scholar] [CrossRef] [Green Version]
  28. Kohavi, R.; Quinlan, J.R. Data mining tasks and methods: Classification: Decision-tree discovery. In Handbook of Data Mining and Knowledge Discovery; Springer: Heidelber/Berlin, Germany, 2002; pp. 267–276. [Google Scholar]
  29. Guisande, C.; Manjarrés-Hernández, A.; Pelayo-Villamil, P.; Granado-Lorencio, C.; Riveiro, I.; Acuña, A.; Prieto-Piraquive, E.; Janeiro, E.; Matías, J.; Patti, C. IPez: An expert system for the taxonomic identification of fishes based on machine learning techniques. Fish. Res. 2010, 102, 240–247. [Google Scholar] [CrossRef]
  30. Hnin, T.T.; Lynn, K.T. Fish Classification Based on Robust Features Selection Using Machine Learning Techniques. In Genetic and Evolutionary Computing; Springer: Heidelber/Berlin, Germany, 2016; pp. 237–245. [Google Scholar]
  31. Zhao, S.; Zhang, S.; Liu, J.; Wang, H.; Zhu, J.; Li, D.; Zhao, R. Application of machine learning in intelligent fish aquaculture: A review. Aquaculture 2021, 540, 736724. [Google Scholar] [CrossRef]
  32. Abràmoff, M.D.; Magalhães, P.J.; Ram, S.J. Image processing with ImageJ. Biophotonics Int. 2004, 11, 36–42. [Google Scholar]
  33. Hammer, Ø.; Harper, D.A.; Ryan, P.D. PAST: Paleontological statistics software package for education and data analysis. Palaeontol. Electron. 2001, 4, 9. [Google Scholar]
  34. Elliott, N.; Haskard, K.; Koslow, J. Morphometric analysis of orange roughy (Hoplostethus atlanticus) off the continental slope of southern Australia. J. Fish Biol. 1995, 46, 202–220. [Google Scholar] [CrossRef]
  35. Mouludi-Saleh, A.; Eagderi, S.; Cicek, E.; Sungur, S. Morphological variation of Transcaucasian chub, Squalius turcicus in southern Caspian Sea basin using geometric morphometric technique. Biologia 2020, 75, 1585–1590. [Google Scholar] [CrossRef]
  36. Langley, P. Selection of relevant features in machine learning. In Proceedings of the AAAI Fall symposium on relevance, Monteleone Hotel, New Orleans, LA, USA, 4–6 September 1994; pp. 245–271. [Google Scholar]
  37. Guyon, I.; Elisseeff, A. An introduction to variable and feature selection. J. Mach. Learn. Res. 2003, 3, 1157–1182. [Google Scholar]
  38. Ebrahimie, E.; Ebrahimi, M.; Sarvestani, N.R.; Ebrahimi, M. Protein attributes contribute to halo-stability, bioinformatics approach. Saline Syst. 2011, 7, 1. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Ebrahimi, M.; Lakizadeh, A.; Agha-Golzadeh, P.; Ebrahimie, E.; Ebrahimi, M. Prediction of thermostability from amino acid attributes by combination of clustering with attribute weighting: A new vista in engineering enzymes. PLoS ONE 2011, 6, e23146. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Ebrahimi, M.; Mohammadi-Dehcheshmeh, M.; Ebrahimie, E.; Petrovski, K.R. Comprehensive analysis of machine learning models for prediction of sub-clinical mastitis: Deep Learning and Gradient-Boosted Trees outperform other models. Comput. Biol. Med. 2019, 114, 103456. [Google Scholar] [CrossRef] [PubMed]
  41. Shekoofa, A.; Emam, Y.; Shekoufa, N.; Ebrahimi, M.; Ebrahimie, E. Determining the most important physiological and agronomic traits contributing to maize grain yield through machine learning algorithms: A new avenue in intelligent agriculture. PLoS ONE 2014, 9, e97288. [Google Scholar] [CrossRef] [Green Version]
  42. Bakhtiarizadeh, M.R.; Moradi-Shahrbabak, M.; Ebrahimi, M.; Ebrahimie, E. Neural network and SVM classifiers accurately predict lipid binding proteins, irrespective of sequence homology. J. Theor. Biol. 2014, 356, 213–222. [Google Scholar] [CrossRef]
  43. Hosseinzadeh, F.; Ebrahimi, M.; Goliaei, B.; Shamabadi, N. Classification of lung cancer tumors based on structural and physicochemical properties of proteins by bioinformatics models. PLoS ONE 2012, 7, e40017. [Google Scholar] [CrossRef]
  44. Beiki, A.H.; Saboor, S.; Ebrahimi, M. A new avenue for classification and prediction of olive cultivars using supervised and unsupervised algorithms. PLoS ONE 2012, 7, e44164. [Google Scholar] [CrossRef] [Green Version]
  45. Larson, W.A.; Seeb, L.W.; Everett, M.V.; Waples, R.K.; Templin, W.D.; Seeb, J.E. Genotyping by sequencing resolves shallow population structure to inform conservation of Chinook salmon (Oncorhynchus tshawytscha). Evol. Appl. 2014, 7, 355–369. [Google Scholar] [CrossRef]
  46. Torkzaban, B.; Kayvanjoo, A.H.; Ardalan, A.; Mousavi, S.; Mariotti, R.; Baldoni, L.; Ebrahimie, E.; Ebrahimi, M.; Hosseini-Mazinani, M. Machine learning based classification of microsatellite variation: An effective approach for phylogeographic characterization of olive populations. PLoS ONE 2015, 10, e0143465. [Google Scholar]
  47. Anastasiadi, D.; Piferrer, F. Epimutations in developmental genes underlie the onset of domestication in farmed European sea bass. Mol. Biol. Evol. 2019, 36, 2252–2264. [Google Scholar] [CrossRef]
  48. Pulcini, D.; Wheeler, P.; Cataudella, S.; Russo, T.; Thorgaard, G. Domestication shapes morphology in rainbow trout Oncorhynchus mykiss. J. Fish Biol. 2013, 82, 390–407. [Google Scholar] [CrossRef] [PubMed]
  49. Zeng, L.; Zhou, L.; Guo, D.L.; Fu, D.H.; Xu, P.; Zeng, S.; Tang, Q.D.; Chen, A.L.; Chen, F.Q.; Luo, Y. Ecological effects of dams, alien fish, and physiochemical environmental factors on homogeneity/heterogeneity of fish community in four tributaries of the Pearl River in China. Ecol. Evol. 2017, 7, 3904–3915. [Google Scholar] [CrossRef] [PubMed]
  50. Akbari, M.; Baubekova, A.; Roozbahani, A.; Gafurov, A.; Shiklomanov, A.; Rasouli, K.; Ivkina, N.; Kløve, B.; Haghighi, A.T. Vulnerability of the Caspian Sea shoreline to changes in hydrology and climate. Environ. Res. Lett. 2020, 15, 115002. [Google Scholar] [CrossRef]
  51. Crétaux, J.-F.; Jelinski, W.; Calmant, S.; Kouraev, A.; Vuglinski, V.; Bergé-Nguyen, M.; Gennero, M.-C.; Nino, F.; Del Rio, R.A.; Cazenave, A. SOLS: A lake database to monitor in the Near Real Time water level and storage variations from remote sensing data. Adv. Space Res. 2011, 47, 1497–1507. [Google Scholar] [CrossRef]
  52. Jafari, O.; Zeinalabedini, M.; Robledo, D.; Fernandes, J.M.D.O.; Hedayati, A.A.; Babak, A. Genotyping-by-Sequencing Reveals the Impact of Restocking on Wild Common Carp Populations of the Southern Caspian Basin. Front. Ecol. Evol. 2022, 10, 872176. [Google Scholar] [CrossRef]
  53. Ebrahimie, E.; Ebrahimi, M.; Ebrahimi, M. Searching for patterns of thermostability in proteins and defining the main features contributing to enzyme thermostability through screening, clustering, and decision tree algorithms. EXCLI J. 2010, 8, 218–233. [Google Scholar]
  54. Jafari, O.; Fernandes, J.M.D.O.; Hedayati, A.-A.; Shabany, A.; Nasrolahpourmoghadam, M. Microsatellite analysis of five populations of Alosa braschnikowi (Borodin, 1904) across the southern coast of the Caspian Sea. Front. Genet. 2019, 10, 760. [Google Scholar] [CrossRef] [Green Version]
  55. Banan, A.; Nasiri, A.; Taheri-Garavand, A. Deep learning-based appearance features extraction for automated carp species identification. Aquac. Eng. 2020, 89, 102053. [Google Scholar] [CrossRef]
  56. Kutlu, Y.; Altan, G.; İşçimen, B.; Doğdu, S.A.; Turan, C. Recognition of species of triglidae family using deep learning. J. Black Sea/Mediterr. Environ. 2017, 23, 56–65. [Google Scholar]
  57. Courtenay, L.A.; Huguet, R.; González-Aguilera, D.; Yravedra, J. A hybrid geometric morphometric deep learning approach for cut and trampling mark classification. Appl. Sci. 2020, 10, 150. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Sampling locations of common carp across the southern coasts of the Caspian Sea. Gomishan (E: 53°29′, N: 37°51′), Miankaleh (E: 53°30′, N: 36°52′), Anzali (E: 49°26′, N: 37°25′), and farm center at Sijoval (E: 54°07′, N: 36°53′).
Figure 1. Sampling locations of common carp across the southern coasts of the Caspian Sea. Gomishan (E: 53°29′, N: 37°51′), Miankaleh (E: 53°30′, N: 36°52′), Anzali (E: 49°26′, N: 37°25′), and farm center at Sijoval (E: 54°07′, N: 36°53′).
Life 12 00957 g001
Figure 2. TMM characters defined in common carp. The key is as follows: 1: TL—total length; 2: FL—fork length; 3: SL—standard length; 4: HL—head length; 5: HH1—maximum head height; 6: HH2—head height on the eye area; 7: BD—body depth; 8: ED—eye diameter; 9: POL—post-orbital length; 10: ML—mouth length; 11: CPL—caudal peduncle length; 12: CPH—caudal peduncle height; 13: DBL—dorsal fin base length; 14: DH—dorsal fin height; 15: ABL—anal fin base length; 16: A.H.—anal fin height; 17: PBL—pectoral fin base length; 18: P.H.—pectoral fin height; 19: pelvic fin height; 20: pre-pectoral length; 21: pre-dorsal length; 22: post-dorsal length; 23: pre-anal length; 24: post-anal length; 25: dorsal anal length; 26: EDFAL—distance between the endpoint of dorsal fin and start point of the anal fin.
Figure 2. TMM characters defined in common carp. The key is as follows: 1: TL—total length; 2: FL—fork length; 3: SL—standard length; 4: HL—head length; 5: HH1—maximum head height; 6: HH2—head height on the eye area; 7: BD—body depth; 8: ED—eye diameter; 9: POL—post-orbital length; 10: ML—mouth length; 11: CPL—caudal peduncle length; 12: CPH—caudal peduncle height; 13: DBL—dorsal fin base length; 14: DH—dorsal fin height; 15: ABL—anal fin base length; 16: A.H.—anal fin height; 17: PBL—pectoral fin base length; 18: P.H.—pectoral fin height; 19: pelvic fin height; 20: pre-pectoral length; 21: pre-dorsal length; 22: post-dorsal length; 23: pre-anal length; 24: post-anal length; 25: dorsal anal length; 26: EDFAL—distance between the endpoint of dorsal fin and start point of the anal fin.
Life 12 00957 g002
Figure 3. Landmark points defined on Caspian and farmed common carp for body shape data extraction. 1: anterior-most point of the snout tip on the upper jaw; 2: center of the eye; 3: dorsal edge of the head perpendicular to the center of eye; 4: maximum head height perpendicular to the operculum; 5: origin of the dorsal fin; 6: end point of dorsal fin; 7: postero-dorsal end of the caudal peduncle at its connection to caudal fin; 8: posteroventral end of the caudal peduncle at its connection to caudal fin; 9: insertion point of the anal fin; 10: origin point of the anal fin; 11: the ventral fin origin; 12: the pectoral fin origin; 13: ventral end of the operculum; 14: ventral edge of the head perpendicular to the center of eye.
Figure 3. Landmark points defined on Caspian and farmed common carp for body shape data extraction. 1: anterior-most point of the snout tip on the upper jaw; 2: center of the eye; 3: dorsal edge of the head perpendicular to the center of eye; 4: maximum head height perpendicular to the operculum; 5: origin of the dorsal fin; 6: end point of dorsal fin; 7: postero-dorsal end of the caudal peduncle at its connection to caudal fin; 8: posteroventral end of the caudal peduncle at its connection to caudal fin; 9: insertion point of the anal fin; 10: origin point of the anal fin; 11: the ventral fin origin; 12: the pectoral fin origin; 13: ventral end of the operculum; 14: ventral edge of the head perpendicular to the center of eye.
Life 12 00957 g003
Figure 4. Decision tree generated models ((A) based on TMM and (B) based on geomorph) showing segregation between populations of common carp (A—Anzali lagoon; P—farmed population; M—Miankaleh; G—Gomishan).
Figure 4. Decision tree generated models ((A) based on TMM and (B) based on geomorph) showing segregation between populations of common carp (A—Anzali lagoon; P—farmed population; M—Miankaleh; G—Gomishan).
Life 12 00957 g004
Figure 5. Linear discriminant analysis (LDA) scatter plot of common carp individuals based on the two first linear discriminants LD1 and LD2. A—Anzali lagoon; G—Gomishan; M—Miankaleh; P—farmed population. The ellipses were generated showing clustering with 95% confidence interval under a normal distribution.
Figure 5. Linear discriminant analysis (LDA) scatter plot of common carp individuals based on the two first linear discriminants LD1 and LD2. A—Anzali lagoon; G—Gomishan; M—Miankaleh; P—farmed population. The ellipses were generated showing clustering with 95% confidence interval under a normal distribution.
Life 12 00957 g005
Figure 6. Consensus body shape variations of Caspian and farmed common carp. Dark blue line represents the farmed population and the pale blue shows the Caspian carp.
Figure 6. Consensus body shape variations of Caspian and farmed common carp. Dark blue line represents the farmed population and the pale blue shows the Caspian carp.
Life 12 00957 g006
Table 1. Top 6 attribute weighting models based on morphometric data from common carp.
Table 1. Top 6 attribute weighting models based on morphometric data from common carp.
PCASVMReliefUncertaintyGini IndexChi-SquaredDeviationRuleInfo Gain
Ratio
Info GainAttributeCount Weights > 0.7
0.850.450.870.831.000.760.760.421.001.00HH18
0.440.490.910.820.770.910.431.000.810.73PelH7
0.540.361.001.000.761.000.420.040.680.98POL5
1.000.080.550.770.700.751.000.310.540.76HL5
0.480.230.470.700.770.700.621.000.810.65PH5
0.230.330.700.670.780.650.150.460.790.80CPH3
Table 2. Applied attribute weighting models on the geomorph data of Caspian and farmed common carp.
Table 2. Applied attribute weighting models on the geomorph data of Caspian and farmed common carp.
Attribute (Landmarks)Weight_
Info Gain
Weight_Info Gain RatioWeight_RuleWeight_DeviationWeight_Chi SquaredWeight_Gini IndexWeight_
Uncertainty
Weight_ReliefWeight_SVMWeight_PCACount Weights > 0.7
L121.01.000.61.01.01.01.01.00.67
L50.70.31.01.00.90.60.90.40.51.05
L130.80.71.00.40.60.70.60.50.80.44
L70.40.91.00.40.50.40.40.40.40.42
L10.40.41.00.50.50.50.60.500.41
L80.30.31.00.40.10.20.20.20.40.31
L30.40.41.00.00.20.40.30.20.20.11
L20.40.21.00.00.20.40.20.10.501
L90.20.11.00.30.10.20.10.30.501
L40.10.11.00.40.10.10.200.10.31
L110.10.300.60.10.10.20.10.400
L10001.00.200000.601
L140.10.51.00.10.10.1000.101
L60.10.100.400.200.10.40.10
Table 3. The accuracy performance of 176 different decision trees based upon 4 main algorithms on 11 datasets of traditional morphometric (TMM) data.
Table 3. The accuracy performance of 176 different decision trees based upon 4 main algorithms on 11 datasets of traditional morphometric (TMM) data.
Database
DT AlgorithmsChi-SquaredInfo GainDeviationGini IndexInfo Gain RatioPCAReliefRuleUncertaintyFCDBSVM
DT Random Forest Accuracy0.650.560.550.610.540.60.560.480.530.510.52
DT Random Forest Gain Ratio0.520.640.490.570.510.630.60.550.580.590.4
DT Random Forest Gini Index0.590.580.590.710.510.540.530.50.530.560.5
DT Random Forest Info Gain0.610.570.540.640.560.510.580.510.610.540.41
Max Performance0.650.640.590.710.560.630.60.550.610.590.52
DT Stump Accuracy0.530.50.540.50.50.540.530.50.530.50.52
DT Stump Gain Ratio0.560.560.590.560.560.560.560.590.560.560.43
DT Stump Gini Index0.570.570.570.570.570.570.570.570.570.570.51
DT Stump Info Gain0.510.510.540.510.510.510.510.570.510.510.51
Max Performance0.570.570.590.570.570.570.570.590.570.570.52
DT Parallel Accuracy0.60.610.740.650.650.620.620.770.740.660.51
DT Parallel Gain Ratio0.650.630.60.590.660.640.650.710.670.610.54
DT Parallel Gini Index0.660.70.670.650.710.630.620.710.660.650.58
DT Parallel Info Gain0.680.650.620.740.630.580.630.620.670.730.56
Max Performance0.680.70.740.740.710.640.650.770.740.730.58
Decision Tree Accuracy0.650.680.660.680.650.610.660.720.710.740.51
Decision Tree Gain Ratio0.620.590.60.590.640.570.60.570.60.590.42
Decision Tree Gini Index0.610.660.60.660.560.590.630.70.650.680.44
Decision Tree Info Gain0.640.560.610.560.590.550.610.580.590.540.41
Max Performance0.650.680.660.680.650.610.660.720.710.740.51
DT—decision tree.
Table 4. The accuracy prediction obtained from different prepared datasets of morphological data from common carp.
Table 4. The accuracy prediction obtained from different prepared datasets of morphological data from common carp.
DatasetGeometric MorphometricTraditional Morphometric
Bayes KernelNaïve BayesBayes KernelNaïve Bayes
Rule0.360.430.640.73
SVM0.360.530.420.52
Uncertainty0.360.460.640.71
Relief0.360.470.640.68
PCA0.360.470.620.61
Info Gain Ratio0.360.540.550.61
Info Gain0.360.470.630.68
Gini Index0.360.470.570.64
Deviation0.360.520.640.64
Chi-Squared0.360.460.640.69
FCDB0.400.600.700.77
Table 5. The confusion matrix based on linear discriminant prediction model and TMM approach.
Table 5. The confusion matrix based on linear discriminant prediction model and TMM approach.
Predicted AnzaliPredicted GomishanPredicted MiankalehPredicted FarmedPrecision (%)
Actual Anzali742150.0
Actual Gomishan1233085.2
Actual Minkaleh0316084.2
Actual Farmed00014100.0
Recall (%)87.576.776.293.3
Overall Accuracy: 81.1%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Jafari, O.; Ebrahimi, M.; Hedayati, S.A.-A.; Zeinalabedini, M.; Poorbagher, H.; Nasrolahpourmoghadam, M.; Fernandes, J.M.O. Integration of Morphometrics and Machine Learning Enables Accurate Distinction between Wild and Farmed Common Carp. Life 2022, 12, 957. https://doi.org/10.3390/life12070957

AMA Style

Jafari O, Ebrahimi M, Hedayati SA-A, Zeinalabedini M, Poorbagher H, Nasrolahpourmoghadam M, Fernandes JMO. Integration of Morphometrics and Machine Learning Enables Accurate Distinction between Wild and Farmed Common Carp. Life. 2022; 12(7):957. https://doi.org/10.3390/life12070957

Chicago/Turabian Style

Jafari, Omid, Mansour Ebrahimi, Seyed Ali-Akbar Hedayati, Mehrshad Zeinalabedini, Hadi Poorbagher, Maryam Nasrolahpourmoghadam, and Jorge M. O. Fernandes. 2022. "Integration of Morphometrics and Machine Learning Enables Accurate Distinction between Wild and Farmed Common Carp" Life 12, no. 7: 957. https://doi.org/10.3390/life12070957

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop