Next Article in Journal
Antigenicity and Safety Evaluation of Lactiplantibacillus plantarum 7-2 Screened to Reduce α-Casein Antigen
Previous Article in Journal
Development of Selection Indices for Improvement of Seed Yield and Lipid Composition in Bambara Groundnut (Vigna subterranea (L.) Verdc.)
Previous Article in Special Issue
Challenge Test as Special Tool to Estimate the Dynamic of Listeria monocytogenes and Other Foodborne Pathogens
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Quantitative Methods for the Prioritization of Foods Implicated in the Transmission of Hepatititis E to Humans in Italy

1
Department of Food Safety, Nutrition and Veterinary Public Health, National Institute of Health, 00161 Rome, Italy
2
Department of Mathematics, University of Rome, Piazzale Aldo Moro 5, 00185 Rome, Italy
3
National Center for Global Health, National Institute of Health, 00161 Rome, Italy
4
Regional Department for Health Activities and Epidemiological Observatory of the Sicilian Region, 90145 Palermo, Italy
*
Author to whom correspondence should be addressed.
Foods 2022, 11(1), 87; https://doi.org/10.3390/foods11010087
Submission received: 2 November 2021 / Revised: 9 December 2021 / Accepted: 23 December 2021 / Published: 29 December 2021
(This article belongs to the Special Issue Microbiological Risk Assessment in Foods)

Abstract

:
Hepatitis E is considered an emerging foodborne disease in Europe. Several types of foods are implicated in the transmission of the hepatitis E virus (HEV) to humans, in particular, pork and wild boar products. We developed a parametric stochastic model to estimate the risk of foodborne exposure to HEV in the Italian population and to rank the relevance of pork products with and without liver (PL and PNL, respectively), leafy vegetables, shellfish and raw milk in HEV transmission. Original data on HEV prevalence in different foods were obtained from a recent sampling study conducted in Italy at the retail level. Other data were obtained by publicly available sources and published literature. The model output indicated that the consumption of PNL was associated with the highest number of HEV infections in the population. However, the sensitivity analysis showed that slight variations in the consumption of PL led to an increase in the number of HEV infections much higher than PNL, suggesting that PL at an individual level are the top risky food. Uncertainty analysis underlined that further characterization of the pork products preparation and better assessment of consumption data at a regional level is critical information for fine-tuning the most risky implicated food items in Italy.

1. Introduction

Hepatitis E virus (HEV) is the causative agent of hepatitis E, an emerging disease of worldwide occurrence affecting humans. The clinical course of hepatitis E is frequently asymptomatic. Clinical signs include fever, anorexia and jaundice. Extrahepatic manifestations and serious sequelae, including chronic condition leading to liver failure and death, may occur especially in immunocompromised patients and in the presence of comorbidity [1,2,3,4,5]. A major risk for chronic and fulminant hepatitis E is reported for pregnant women, with the possibility of abortion or infant mortality [6].
For many decades, in Europe and in the USA, hepatitis E was considered a health problem limited to travelers coming back from areas where hepatitis E was endemic [7,8]. However, since the early 1990s, autochthonous cases have been increasingly reported [9]. In Europe and other high-income countries, hepatitis E is considered a foodborne zoonosis causing mainly sporadic cases [7,8,10]. Outbreaks of HEV infection were also occasionally reported in the European Union (EU) [11,12,13]. In the EU, however, surveillance of HEV infection is sparse and not harmonized, hampering the possibility to adequately characterize the epidemiology of hepatitis E, including the accurate identification of the food items implicated in the transmission of HEV to humans.
HEV genotypes affecting humans mainly belong to HEV3 and HEV4. These genotypes are frequently detected in pigs and wild boars, which are considered the main HEV animal reservoirs [3]. The majority of human cases are attributable to consumption of pork and wild boar meat and products thereof [2,14,15]. Likewise, in Italy, evidence from several studies indicates that the consumption of raw or undercooked pork and wild boar meat is an important risk factor [14,15]. Some studies also reported shellfish and leafy vegetables as vehicles potentially implicated in foodborne transmission of HEV [16,17,18,19]. Evidence is also available of a higher risk for professionally-exposed workers such as veterinarians, farmers and hunters [20,21,22,23].
Circulation of HEV in farmed pigs in Italy is widely documented [24,25,26,27,28]. In the food chain, HEV has been detected in pork foods such as dry and fresh sausages at retail level [29,30,31] but also in shellfish sampled in the production areas or in biomonitoring points [32,33], at retail [34] or in biomonitoring points [35]. Observational studies conducted in several countries also documented HEV contamination of vegetables and fruits [18,36,37,38]. HEV RNA was found in sewage and surface water samples, suggesting possible environmental contamination via recycled water [33,39,40].
Understanding the dynamics and transmission of HEV from animal reservoirs to humans and of food contamination is key to reducing the incidence of hepatitis E in the population through the adoption of specific control actions in the food production chain. In recent years, several studies modeled the dynamic of HEV spread along the food chain in different EU countries at both the pre-harvest and post-harvest level, including consumer exposures [41,42,43,44,45].
In our study, we developed a mathematical model to rank the importance of various types of food potentially implicated in the transmission of HEV to humans in the adult Italian population (around 50,000,000). The food categories considered in our study are pork products with liver (PL), pork products without liver (PNL), bivalve shellfish (SH), green leafy vegetables (GV) and raw milk (RM).

2. Methods

In order to obtain the ranking of food items most frequently implicated in HEV transmission in Italy, we developed a parametric stochastic model to estimate the expected number of newly infected persons who develop HEV infection in the Italian population (≥18 years) through the consumption of the different foods in a one-year period.
The analyses were carried out with the R software version 3.6.0 [46]. For the heaviest calculation, the Gauss Cluster at the Turing Lab of Mathematics Department “Guido Castelnuovo” of Rome “La Sapienza” was used (http://centrocalcolo.mat.uniroma1.it, http://turinglab.mat.uniroma1.it, accessed on 1 November 2021).

2.1. The Mathematical Model

We modeled the individual infectious dose distribution S to HEV using a proxy of the infectious dose based on data available in the literature. We thus built the distribution C i of HEV concentration in a food serving of category i, based on data on prevalence of HEV contamination of food at retail obtained from a recent sampling study in Italy. Using these two quantities, we estimated the probability q i for a single person to develop a HEV infection after the consumption of a single serving of food belonging to category i. The average number of portions of each food consumed per year per person and over the number of susceptible individuals in the Italian population (Figure 1) were then summed up to estimate the average number of newly infected cases in the Italian population in one year. All the parameters used in the model are summarized in Table 1.
The model framework is showed in Figure 1.
We built the distribution of concentration per serving C i for each food category using HEV load data in food expressed in genome equivalent per gram of food (g.e./gram) (see Section 2.2), and defining a mean serving size s e r v i (grams) for each food category, according to guidelines of Council for Agricultural Research and Analysis of the Agricultural Economy [51]. Multiplying these two quantities, we obtained the distribution of the total genome equivalent HEV per serving (g.e./serving). The distribution was built as a mixture of random variables as follow
C i = α i C 0 i + β i C 1 i where C 0 i δ 0 , C 1 i e x p ( λ i )
C 0 i is a Dirac delta with point mass in zero and represents the HEV negative food samples belonging to category i. The random variable C 1 i models the distribution of the viral concentration in the HEV positive samples belonging to category i and it is distributed according to an exponential distribution. The rate of the exponential distribution is the inverse of the mean viral concentration λ i 1 of HEV positive samples that we estimated using the maximum likelihood estimation (MLE). The weights α i and β i are the fraction of HEV negative and positive food samples, respectively.
To model the individual infectious dose distribution S, we used data from outbreaks for which the HEV load in implicated food (g.e./gr) was documented [13,47,48,49]. We fitted S on the estimated foodborne HEV intake (g.e.) of cases involved in these outbreaks. The individual intake of HEV (g.e.) was estimated based on the viral concentration in the implicated food (HEV g.e./gr) for a mean serving size (gr) of the implicated food. The mean serving size ( s e r v 0 ) was estimated according to the same data source used for s e r v i . We modeled S as an exponential distribution with parameter μ , which was estimated using MLE.
Any exposure to HEV, through the consumption of a single food serving, leading to an intake of HEV g.e. higher than the individual infectious threshold was defined as a new HEV infection event. We defined q i as the probability of infection given the consumption of one single food serving. Each foodborne exposure to HEV was considered independent and no cumulative exposure to HEV in multiple meals was assumed possible.
Based on the available data on food consumption in Italy, we estimated the number of average servings consumed in one year per person d a i , for each food category i. Considering each meal as a Bernoulli trial of probability q i , we built a geometrical random variable T of parameter q i modeling the number of failures before the first successful exposure (i.e., infection). We estimated the probability p i for an individual to become infected in one year as
p i = P ( T d a i )
meaning the probability that the first successful exposure happens within one single year. The number N of susceptible individuals in the Italian adult population was estimated subtracting to the total Italian population the fraction of HEV seropositive individuals. This latter fraction was estimated based on data from a HEV seroprevalence survey among blood donors in Italy. We assumed a long-life immunization status against HEV of seropositive subjects (i.e., no reinfection possible). Moreover, we assumed immune individuals homogeneously distributed all over the Italian population. We considered the total number of new infections per year X, given the consumption of food belonging to category i, to be binomially distributed with parameters ( N , p i ) . Whence, we obtained the average number of new infected individuals in one year, as the expected value of X, meaning N i n f i = E ( X ) = N p i .

2.2. Data and Data Sources

Data on HEV prevalence and concentration in food were generated from a sampling study carried out in Italy between 2016 and 2019 within the project “CCM 2016—Hepatitis E, an emerging problem in food safety” (Suffredini, personal communication). Briefly, 730 samples were collected at retail level in different areas of Italy: North, Center and South (see Table 2). Samples were analyzed using matrix-specific viral concentration procedure for pork products [52], bivalve shellfish, green leafy vegetables (ISO, 2017) and raw milk [12]. Detection and quantification of HEV in samples was performed by real-time RT-qPCR as detailed in Di Pasquale et al. [53].
The number of individuals susceptible to HEV in the Italian population was estimated based on official demography data (as of 1 January 2021) (ISTAT (http://dati.istat.it/, accessed on 6 December 2021) and on a HEV seroprevalence study conducted among 10,011 blood donors’ plasma unit samples (≥18 years) in 2018 (0.02% of the adult Italian population as of 31 December 2018) [50].
The number of food servings consumed in one year by a single person was estimated based on food consumption data sourced from a nation-wide consumption survey conducted in Italy in 2005–2006 [54], available on FAO/WHO GIFT tool platform (http://www.fao.org/gift-individual-food-consumption/en/, accessed on 1 November 2021). Details are reported in Appendix A.
Data collected during outbreak investigations with implicated food analysis were used to estimate the dose–response curve [13,47,48,49].

2.2.1. Uncertainty and Sensitivity

We performed uncertainty and sensitivity analysis to quantify the variability in the output due to the variability in the input parameters [55]. We followed a sampling-based method as described in Saltelli [56,57] and generated 10,000 samples for each estimated parameter (i.e., c o n s d a y i , λ and μ ) using parametric bootstrap [58,59] and ran the model obtaining a sample of the same size for the output. This output sample was used to quantify the uncertainty and to perform the sensitivity steps with the aim to explore the effect of each parameter on the model output. We followed a two-step approach. We first analyzed the scatterplots of input parameters versus the output and then calculated the standardized regression coefficient for each of the parameters by linear regression analysis. This latter step gave us the metric to rank the parameters. Details are described in Appendix C and Appendix D.

2.2.2. Evidence from the Italian Surveillance System

Information on food consumption in cases of hepatitis E reported to the Italian surveillance system for acute viral hepatitis (SEIEVA) between 2016 and 2019 was used to discuss the outputs of the model. The SEIEVA is a voluntary system set up in 1985 by the Italian National Institute of Health, now covering 83% of the Italian population [60,61]. Since 2007, the local health units voluntary participating in the surveillance are required to perform and report HEV laboratory testing. Hepatitis E case definition is based on the positivity to IgM anti-HEV antibodies and elevate serum transaminases level (with or without clinical symptoms). Since the start of the SEIEVA activities, information on risk factors including food exposures were collected using a standardized questionnaire for all cases of acute viral hepatitis. The questionnaire was revised and released to include specific hepatitis E risk factors in late 2016. This activity was also completed within the national project “CCM 2016—Hepatitis E, an emerging problem in food safety”.

3. Results

3.1. Parameter Estimation

Food-specific parameter estimations are reported in Table 3. We also reported a 95% interval confidence for the parameters estimated directly from data.
The results of the food sampling survey indicated that the highest proportion of HEV positive samples (i.e., HEV food prevalence α i ) belongs to PL products (11%), followed by PNL (2.8%) and SH (0.48%). No positive samples were found for the GV and RM categories (0% prevalence) (Table 3).
The number of expected genome equivalents per 100 gr size of serving (i.e., λ i 1 = E ( C 1 i ) ) for PL and PNL products were 7.8 × 10 4 g.e./serving and 3.4 × 10 4 g.e./serving, respectively. The average servings consumed per person per year was 3 and 73, respectively, for PL and PNL. The only positive sample for SH resulted in 8.7 × 10 4 g.e. per a 150 g average serving size. The expected number of SH servings consumed yearly are 26. For GV and RM categories, we did not obtain results for λ i because no positive samples were detected. These estimates are shown in Table 4, where all the parameters directly involved in the ranking activity are also reported. We included in Appendix E a risk matrix that uses these parameters to also profile a qualitative ranking of the food categories.
The other parameter estimations are reported in Table 5. The average serving size consumed at outbreak events s e r v o u t resulted to be 100 gr, yielding to a mean individual infectious dose of 7.3 × 10 6 g.e. (i.e., μ 1 ). The proportion of seropositive individuals of Italian population h was derived by Spada et al. [50] and resulted to be 8.3%. We subtract this proportion to the total Italian population to obtain the amount of susceptible individuals. The total population as of 1 January 2021 was estimated to be 50,208,329, yielding to 45,840,205 susceptible individuals. All the detail on methodological aspects of parameters estimation are reported in Appendix B.

3.2. Model Output

For each food category, the outputs of each step of the model are presented in Table 6, including individual probability of infection following the consumption of a single serving q i , individual probability of infection in a year p i and the expected number of new infected per year N i n f i = E ( X i ) .
In addition, we reported density and cumulative probability sketches for new HEV infected individuals per year X P L , X P N L and X S H (Figure 2). Standard deviations of these three binomial random variables are 409 for PL, 668 for PNL and 260 for SH.

3.3. Uncertainty Analysis

We obtained bootstrap samples from input parameters and model output as described in Section 2.2.1. We considered parameters uncorrelated given the Pearson correlation test results that are reported in Appendix C, where standard deviations of input parameter samples are also shown (see Table A1).
In Table 7, we reported summary statistics of the output distribution for the three categories involved in the analysis. In Figure 3, Figure 4 and Figure 5, we displayed the histogram and the sample cumulative distribution of the output samples for category PL, PNL and SH, respectively. The output shown for this analysis is the individual infection probability in a year p i .

3.4. Sensitivity Analysis

From uncertainty analysis, we obtained samples of input parameters and output used to perform the sensitivity analysis. The three scatterplots (Figure 6, Figure 7 and Figure 8) show the variations of the output samples versus the three parameters involved in the analysis, underlying the strength of the dependencies between them. The shape c o n s d a y i plot is a bit flattened on the bottom with no strong structure for all the food categories, suggesting a very light dependency between the output and this parameter. λ seems to have a little more structured outline, especially for the PL category, but the output exhibits the strongest dependency with the μ parameter whose plots shows a well-defined shape, especially for PL and PNL.
To quantify the relative importance of input parameters, we conducted a regression analysis using λ i , c o n s d a y i and μ as covariates. This, as explained in [57] (Cap.1), allowed us to rank these three input parameters based on their impact on the output. Results are reported in Table 8, Table 9 and Table 10.
As already suggested by scatterplots, μ was the parameter that most influences the output for both the categories PL, PNL. The overall influence order for each category is the following:
| μ ^ | > | c o n s d a y P L ^ | > | λ P L ^ |
and
| μ ^ | > | λ P N L ^ | > | c o n s d a y P N L ^ |
From the value of the standardized estimates of the coefficients, we can evaluate the impact of each of them for perturbations equal to a fixed fraction of parameter’s standard deviation [56] (Cap. 6). For the PL category, μ has an impact 4% higher than c o n s d a y P L and 14% higher than λ P L , while λ P L has an impact 11% higher than c o n s d a y P L . For the PNL category, μ has an impact 55% higher than λ P N L and 68% higher than c o n s d a y P N L . The impact of λ P N L is about 29% higher than c o n s d a y P N L . For the PL category, it is clear that c o n s d a y P L and λ P L are very close and all the three parameters have a relatively small impact.
The R 2 statistics for both categories are high, 0.97 for PL and 0.83 for PNL, meaning that these three parameters account for almost the entire uncertainty in the output.
A slightly different pattern is shown by SH category, where
| μ ^ | > | c o n s d a y S H ^ | > | λ S H ^ | .
We found that μ has an impact 98% higher than λ and 92% higher than c o n s d a y S H , for a perturbation equal to a fixed fraction of parameter’s standard deviation. The R 2 for this parameter resulted much smaller with a 0.51, suggesting that other factors are contributing to the uncertainty. This is not surprising given that we have only one positive sample for this category.
Last, in order to have a final quantification of the stability of the output, we made a simple experiment on d i a parameter (so, indirectly on c o n s d a y i ). We increased the d P L a to actually see the results in number of exposed people per year. We observed that with d P L a = 6 the number of infected people reached 335,446 and with d P L a = 8 N i n f P L = 446,715 .
More details on results of these analysis are reported in Appendix C.

3.5. Food Consumption in Italian Hepatitis E Cases

Between 2016 and 2019, a total of 213 autochthonous cases of hepatitis E were reported to the SEIEVA system. The availability of information on foods consumed by patients before the onset of the disease varied considerably among the different foods, depending on the type of questionnaire administered to hepatitis E patients. Information on shellfish consumption was available for a high proportion of cases (N = 186; 87%) because the exposure to this foodstuff was investigated through both the general questionnaire for acute viral hepatitis and the specific questionnaire for hepatitis E, in place from late 2016. For all the other food items, which were investigated with the hepatitis E questionnaire only, this proportion did not exceed the 43% of the hepatitis E cases (Table 11), making the uncertainty around the exposure prevalence to these foods much higher. Pork meat and pork cured meat were by far the food items most frequently consumed by hepatitis E cases, with more than 69% of the patients having consumed these foods, followed by pork liver, fruits, shellfish, vegetables and wild boar meat (Table 11).

4. Discussion

The model output shows that the consumption of PNL led to the greatest exposure to HEV in the Italian population and was associated with the highest number of new expected HEV infections per year, followed by the consumption of PL and SH. Based on these findings, the risk posed by PNL is ranked first at the population level among foods implicated in the transmission of HEV, followed by PL and SH. For the other foods considered by our study (i.e., GV and RM), no expected cases of HEV infections were estimated by our model. The consumption of pork products has been frequently indicated as a risk factor for foodborne HEV infection [62]. This type of food has also been frequently linked to foodborne outbreaks of hepatitis E [47,48,63,64]. The consumption of shellfish has also been pointed out as a possible risk factor in some studies [48,65], although, to our knowledge, no outbreaks implicating the consumption of contaminated shellfish have ever been reported in Europe.
PNL are consumed much more frequently than PL and SH and by a larger proportion of population. This explains why the highest expected number of new cases in the population is associated with this food despite the mean prevalence of HEV contamination and the viral load per serving being higher for PL and SH.
The sensitivity analysis indicates that even a slight increase in the consumption of PL servings at the individual level results in a remarkable increase in the expected number of new cases of HEV infection. As an example, passing from three to eight portions of PL consumed per person per year, which is a realistic variation at individual level, the number of new HEV infections in the population increases from about 168,000 to approximately 450,000 cases, revealing that the number of servings of PL at the individual level is a critical element to be taken into account for food risk ranking. Similar variations in the consumption of PNL do not result in comparable increases in the number of new HEV infection cases in the population. These findings provide evidence of the importance of collecting very accurate data on PL consumption at the population level in order to strengthen the HEV food risk ranking and highlight the importance of PL consumption for the risk of HEV transmission at the individual level.
The consumption of PL in Italy varies hugely among both individuals and population subgroups, depending not only on personal preferences but also on traditional differences in consumption habits. There is a wide geographic variability in the recipes and mode of preparation of pork products, with important local peculiarities, especially for products such as cured meat and offal. This may lead to highly heterogeneous consumption of PL and exposure to HEV in specific population subgroups and geographical area. Unfortunately, the food consumption data source used in our study lacks sufficient details to allow for more accurate estimations of HEV exposure associated with the different types of PL.
Food consumption data from hepatitis E cases reported to the SEIEVA (see Section 3.5) are too scarce to support a formal validation process of our model. However, they are in line with the evidence obtained in our study about the importance of both PNL and PL as top risk foods for the transmission of HEV to humans. The consumption of pork meat and pork cured meat was reported by a high proportion of cases (>70%), while pork liver as well as shellfish by a much lower proportion of cases (i.e., each food group not exceeding 30% of the cases). Although the SEIEVA data would indicate that a minor proportion of hepatitis E cases had consumed pork liver, it is necessary to consider that this food is not usually consumed as single food but it is much more frequently consumed as an ingredient in mixed pork cured meat, such as sausages, salami, mortadella, etc., which were consumed by a high proportion of cases. Unfortunately, the lack of food consumption data from healthy controls hampers drawing more specific conclusions on the magnitude of the association between PNL and PL food consumption and hepatitis E, at the individual level.
Our model was built to support risk ranking. The sensitivity analysis shows that the parameter that brings the larger uncertainty is the mean μ 1 of the HEV individual infectious dose distribution. This is not surprising given that the scarce availability of data to estimate μ affected the possibility to build a robust dose–response model, similar to many other exposure studies in humans. In our study, we used the total HEV load (g.e.) in food implicated in hepatitis E outbreaks as a proxy for the individual HEV infectious dose in humans. It is impossible, however, to evaluate to what degree the quantitative assessment of HEV in food differs from the true individual infectious dose. In addition, two different sources of uncertainty affect our dose–response model. On one hand, we only found four outbreak reports in the literature providing the information needed. On the other hand, the uncertainty associated with the quantitative methods used for the assessment of HEV in food should be also considered.
To obtain more reliable estimates of the actual number of HEV infections in humans, a more robust estimation of parameter μ would be needed. Nonetheless, the food ranking does not appear to be influenced by the uncertainty introduced by this specific parameter since the dose–response model acts in the same way on all types of food considered in our study. The parameters potentially introducing differences in the ranking are the ones displayed in Table 4. To have a more direct view of how these parameters affect the ranking, we have provided a qualitative risk classification by building a risk matrix. The analysis is reported in Appendix E.
Other important factors affecting the model outcomes are the mean quantity of food consumed in a year c o n s d a y and the mean viral concentration in food λ 1 . While the λ parameter was estimated from data from a large national sampling study, the c o n s d a y was estimated from a consumption dataset whose current reliability is difficult to assess for several reasons. First, the survey was conducted in the Italian population more than fifteen years ago and data might no longer reflect the current consumption in terms of type of food, frequency of consumption and quantity with the same level of accuracy. Second, the consumption data refer to general food categories and the lack of details on the food ingredients makes it difficult to extract the true quantities of food consumed for some categories, introducing uncertainty, in particular, for PL. Finally, estimates were only available at the national level and did not allow to take account for regional and local differences, which in the case of PL and PNL may be critical, as described above.
Another limitation of our study is the use of one single dataset for the estimation of the prevalence of HEV contamination in food. This methodological choice was driven by the lack of full comparability of the prevalence estimates among different studies due to a poor harmonization of laboratory methods used to detect HEV in food. In addition, the uncertainty analysis that we performed in our study would have been impossible using estimates from other studies. Due to the extremely high variety of foods and mode of preparation, estimating the prevalence of HEV contamination in food based on one single survey may introduce a selection bias depending on the goodness of randomization of the samples. In our study, this type of bias may be suspected for GV and SH prevalence estimation. For both these foodstuffs the estimated prevalence was 0.5% and 0%, respectively, representing a highly discrepant value compared with other similar studies conducted in Italy and abroad. In SH, Suffredini et al. and La Rosa et al. [32,33] reported much higher prevalence of HEV contamination with values ranging up to 8.1%. The prevalence of GV contamination, although considerably lower than SH, was never estimated to be 0% in other studies [18,37,38]. These considerations suggest that the role of SH and GV for HEV transmission in the Italian population may be more important than our study showed. In terms of risk ranking, however, this does not appear to substantially change our results. Different is the case of RM. This food was included in our study because it was focused as a potential risk food for HEV transmission in China in 2016, where a high prevalence of active HEV infection in cows was reported [66]. However, no further studies confirmed these findings [67,68,69].

5. Conclusions

Our model allowed to rank the relevance of different food categories for HEV transmission in the Italian population. In agreement with the literature and with data from Italian surveillance, pork products with and without liver emerged as the most important food implicated in HEV transmission. In particular, since our data and analyses highlight a specific risk associated with liver-containing products, actions to reduce the risk could leverage on the reduction of HEV contamination of the final products, for example, by screening livers destined to make up seasoned cured meat products or by reducing the viral load through heat treatment (e.g. pasteurization) of tissues and livers allocated to food production. Moreover, consumer information on the risk posed by liver consumption represents an important component of the mitigation strategies, in particular, in areas where the consumption of liver-containing traditional products is popular.
Another important value of our study is its contribution in shedding light into the existing data gaps that the research and surveillance activities should cover in the future to improve the risk ranking. From this perspective, the availability of a mathematical model represents a useful tool that could be further refined as new data and knowledge will be made available.

Author Contributions

Conceptualization, E.S., P.S., G.S.; methodology, M.I., O.M., G.S.; software, O.M.; validation, G.S., M.I. and E.S.; formal analysis, O.M., M.E.T.; investigation, E.S., M.E.T.; resources, P.S., E.S.; data curation, E.S., P.S., O.M., M.E.T.; writing—original draft preparation, O.M., G.S.; writing—review and editing, G.S., M.I., E.S., M.E.T.; visualization, O.M.; supervision, G.S., M.I.; project administration, G.S.; funding acquisition, P.S., E.S., G.S. All authors have read and agreed to the published version of the manuscript.

Funding

The study has received funding from the Italian Ministry of Health in the framework of the national project “Hepatitis E, an emerging problem in food safety: ‘One Health’ approach for risk assessment” (CCM 2016 program).

Data Availability Statement

Unpublished data on viral presence in food used are not publicly available. All the other datasets used are referenced in Section 2.2. R code used for main estimation can be found here: https://github.com/Mezzanenne/Risk_ranking_Script, accessed on 1 November 2021.

Acknowledgments

We would like to acknowledge Dario De Medici, Ilaria Di Bartolo, Eleonora Chelli and Stefania D’Amato, and Andrea Gabrielli for the support in the use of the Gauss Cluster.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
HEVHepatits E Virus
EFSAEuropean Authority for Food Safety
PLPork products containing liver
PNLPork products not containing liver
SHShellfish
GVGreen leafy vegetables
RMRaw milk
MLEMaximum Likelihood Estimation
SRCStandardized Regression Coefficient
g.e.genome equivalent
MDPIMultidisciplinary Digital Publishing Institute

Appendix A. Consumption Data

Observations from the consumption survey database [54] were filtered from the survey data to select the products belonging to each food category using the “ingredient” variable. For RM and PL, it was not possible to filter directly from data. For the former, we assumed that all the dairy cow milk consumed was raw, choosing a worst-case scenario. For the latter, data were not available for all the processed and/or seasoned food items. Therefore, we assumed that 20% of all pork sausages could contain liver.

Appendix B. Parameter Estimation

Appendix B.1. Maximum Likelihood Estimation

For the parameter estimated from data, we used the maximum likelihood estimation technique. We report here the estimator definition as in [58] (Par. 9.3).
The maximum likelihood estimation is one of the most common methods for estimating parameters in a parametric model. Let X 1 , · , X n be independent and identically distributed samples from a random variable with probability density function f ( x ; θ ) depending on an unknown parameter θ .
Definition A1.
The likelihood function is defined by
L n ( θ ) = i = 1 n f ( X i ; θ ) .
The maximum likelihood estimator (MLE), denoted by θ ^ n , is the value of θ that maximizes L n ( θ ) , meaning
θ ^ n = max θ L n ( θ ) .
So, for our purposes, X 1 , , X n are the data values that we supposed coming from a given probability distribution. In particular, we supposed that all the data we had came from an exponential distribution. Let us define what an exponential distribution is.
Definition A2.
A continuous random variable whose probability density function is given, for some λ > 0 , by
f ( x ) = λ e λ x i f x 0 0 i f x < 0
is said to be exponential random variable with parameter (or rate) λ.
It is possible to prove the following result:
Proposition A1.
If X 1 , , X n are independent exponential random variables each having mean θ, the maximum likelihood estimator of θ is the sample mean i = 1 n X i n .
We then estimated the rate of the exponential distribution λ simply as the reciprocal 1 θ of the sample mean.

Appendix B.2. Confidence Interval

As we supposed all the data coming from exponential distributions and given the use of the MLE for the parameter estimation, we refer to [70] (Par. 5.7, Par. 7.6) to build confidence intervals. We need to introduce some results. No proofs will be presented here, the entire development is available in [70].
We begin defining the gamma distribution.
Definition A3.
A random variable X is said to have a gamma distribution with parameters ( α , λ ) , λ > 0 , α > 0 , is its density function is given by
f ( x ) = λ e λ x ( λ x ) α 1 Γ ( α ) x 0 0 x < 0
where Γ ( α ) is called Gamma function and is defined as
Γ ( α ) = 0 λ e λ x ( λ x ) α 1 d x
or, if α = n is an integer
Γ ( n ) = ( n 1 ) ! : = ( n 1 ) · ( n 2 ) 2 · 1 .
Remark A1.
It is straightforward to see, given the two previous definitions, that when α = 1 the gamma distribution reduces to the exponential with mean 1 λ (recalling that 0 ! = 1 .).
Proposition A2.
If X i , i = 1 , , n are independent gamma random variables with respective parameters ( α i , λ ) , then i = 1 n X i is gamma with parameters i = 1 n α i , λ
From Remark A1 and Proposition A2 follows the next result:
Corollary A1.
If X 1 , , X n are independent exponential random variables, each having rate λ, then i = 1 n X i is a gamma random variable with parameters ( n , λ ) .
The last type of random variable needed here is the chi squared
Definition A4.
If Z 1 , , Z n are independent standard normal random variables, then X, defined by
X = Z 1 2 + Z 2 2 + + Z n 2
is said to have a chi-square distribution with n degree of freedom. We will use the following notation X χ n 2 .
A property that we are interested in for this kind of random variable is the following
Lemma A1.
If X χ n 2 , X is identical to a G a m m a ( n 2 , 1 2 ) .
From this last result, we obtain that 2 θ i = 1 n X i χ 2 n 2 . Now, we recall that if X χ n 2 we define the quantity χ α , n 2 to be such that
P X χ α , n 2 = α
An illustration of this value is shown in Figure A1 from [70] (Figure 5.11).
Figure A1. The chi-square density function with eight degrees of freedom.
Figure A1. The chi-square density function with eight degrees of freedom.
Foods 11 00087 g0a1
Given the previous results and remarks, for any α ( 0 , 1 ) , we have
P χ 1 α 2 , 2 n 2 < 2 θ i = 1 n X i < χ α 2 , 2 n 2 = 1 α
equivalently
P 2 i = 1 n X i χ α 2 , 2 n 2 < θ < 2 i = 1 n X i χ 1 α 2 , 2 n 2 = 1 α
Hence, a 100 × ( 1 α ) percent confidence interval for θ is
θ 2 i = 1 n X i χ α 2 , 2 n 2 , 2 i = 1 n X i χ 1 α 2 , 2 n 2

Appendix C. Uncertainty Analysis

Appendix C.1. Standard Deviations of Input Parameters

Table A1. Uncertainty analysis for input parameters.
Table A1. Uncertainty analysis for input parameters.
ParameterStandard Deviation
λ P L 7.76 × 10 6
c o n s d a y P L 2.14 × 10 2
λ P N L 1 × 10 4
c o n s d a y P N L 2.5 × 10 1
λ S H 3 × 10 2
c o n s d a y S H 1.21
μ 7 × 10 8

Appendix C.2. Parameter Correlations

We report the correlation test results and the scatterplots between them for the three categories involved in the analysis, meaning PL, PNL and SH.
Table A2. Parameter correlations for category PL.
Table A2. Parameter correlations for category PL.
ParametersEstimate95%CIp-Value
λ P L | μ 0.018 [−0.03–0.001]0.06
μ | c o n s d a y P L 0.01 [−0.0095–0.03]0.3
c o n s d a y P L | λ P L 0.0056 [−0.025–0.014]0.5
Figure A2. Scatterplots paired between input parameters for category PL.
Figure A2. Scatterplots paired between input parameters for category PL.
Foods 11 00087 g0a2
Table A3. Parameter correlations for category PNL.
Table A3. Parameter correlations for category PNL.
ParametersEstimate95%CIp-Value
λ P N L | μ 0.0043 [−0.023–0.015]0.06
μ | c o n s d a y P N L 0.02 [−0.021–0.017]0.82
c o n s d a y P N L | λ P N L 0.007 [−0.026–0.012]0.46
Figure A3. Scatterplots paired between input parameters for category PNL.
Figure A3. Scatterplots paired between input parameters for category PNL.
Foods 11 00087 g0a3
Table A4. Parameter correlations for category SH.
Table A4. Parameter correlations for category SH.
ParametersEstimate95%CIp-Value
λ S H | μ 0.014 [−0.034–0.0048]0.13
μ | c o n s d a y S H 0.016 [−0.002–0.03]0.09
c o n s d a y S H | λ S H 0.0001 [−0.019–0.019]0.9
Figure A4. Scatterplots paired between input parameters for category SH.
Figure A4. Scatterplots paired between input parameters for category SH.
Foods 11 00087 g0a4
We can see from tables and plots that some of the parameters show a certain structure in plots, especially for the PL category, even if the numbers seem rather small. However, we considered parameter uncorrelated given the small correlation coefficients.

Appendix C.3. Parametric Bootstrap

We report here a brief explanation of basics on parametric bootstrap theory, modified from [59] (Cap. 6, 21).
Suppose we have x = [ x 1 , , x n ] a random sample from a probability distribution F and that we are interested in some unknown parameter θ = t ( F ) , on the basis of ( x ) . A good way to estimate the sampling distribution and variance of θ ^ = M L E ( θ ) when we know F is to use parametric bootstrap, which consists of two main steps.
  • We draw m samples of size n (same size of original sample) from the parametric model density f θ ^ ( y ) , using the estimation θ ^ obtained with maximum likelihood estimation.
  • We calculate for each sample the maximum likelihood estimation of θ . This way we obtain a m size sample of θ ^
For more detail on the topic, see the reference cited above.

Appendix D. Linear Regression

Appendix D.1. Introduction

We report here some basics on regression analysis in the context of sensitivity analysis, modified from [56] (Par. 6.6.2, 6.6.3). Performing the sampling-based method for sensitivity analysis, we generated a m sized sample for each of the n input variables and, consequently, for the output. So we want to investigate the map
[ x k , y ( x k ) ] , k = 1 , , m
where, for each k x k = [ x k 1 , , x k n ] represents the k-th observation of the sample of the input variables and y ( · ) is our model. In the linear regression framework, a model of the form
y ^ = b 0 + j = 1 n b j x j
is developed from the mapping between analysis input and analysis results, where the x j are the input variables under consideration and the b j are coefficients that must be determined. The coefficients b j can be used to indicate the importance of the individual x j with respect to the uncertainty in y.
We start from the map showed in (A1), whence there exists a sequence y k = y ( x k ) , k = 1 , , m of values for the output variable, that is the output sample obtained. When expressed in the form of the Equation (A2), each y k becomes
y k = b 0 + j = 1 n b j x k j + ϵ k , k = 1 , , m
where the error terms ϵ k , k = 1 , , m are defined by ϵ k = y k y ^ k and thus equal the difference between the observed value y k and the corresponding predicted value y ^ k defined by (A2). To determine the b j , the method of least squares is the most widely used.
We introduce here the matrix representation for the equality (A3):
y = xb + ϵ ,
where
y = y 1 y m , x = 1 x 11 x 1 n 1 x m 1 x m n , b = b 0 b n , ϵ = ϵ 1 ϵ m .
In the least-squares approach, the b j are determined such that the sum
S ( b ) = k = 1 m y k b 0 j = 1 n b j x k j 2 = ( y xb ) T ( y xb ) = k = 1 m ϵ k 2
is a minimum, meaning such that the squared error terms is a minimum. After some calculation, provided that the matric x T x is invertible( it is usually the case in sampling-based study in which the number of sample elements (i.e., m) exceeds the number of independent variables (i.e., n).), we have a unique value for b given by:
b = ( x T x ) 1 x T y .
Now, the regression model in (A2) can be algebraically reformulated as
y ^ y ¯ s ^ = j = 1 n b j s ^ j s ^ x j x ¯ j s ^ j ,
where
y ¯ = k = 1 m y k m , s ^ = k = 1 m ( y k y ¯ ) 2 m 1 1 2 ,
x ¯ j = k = 1 m x k j m , s ^ j = k = 1 m ( x k j x ¯ j ) 2 m 1 1 2 ,
The coefficients b j s ^ j / s ^ appearing in (A4) are called standardized regression coefficients (SRCs). When the x j are independent, the absolute value of the SRCs can be used to provide a measure of variable importance. Specifically, the coefficients provide a measure of importance based on the effect moving each variable away from its expected value by a fixed fraction of its standard deviation while retaining all other variables at their expected values. Calculating SRCs is equivalent to performing the regression analysis with the input and output variables normalized to mean zero and standard deviation one.

Appendix D.2. Parameter Impact

As explained above, we can use the SRCs to rank the parameters used in the analysis based on their effect on the output. Our linear regression with SRCs resulted in the following expression for the two categories:
y P L = 0.864 λ P L + 0.865 c o n s d a y P L + 0.99 μ
y P N L = 0.9 λ P N L + 0.88 c o n s d a y P N L + 0.995 μ

Appendix E. Risk Matrix

We report here a risk matrix to qualitatively score the risk of each food category, based on the severity and likelihood of food contamination [71]. We are here considering the parameters reported in Table 4.
We defined the severity as the expected HEV genome equivalents per serving E ( C 1 i ) = λ i 1 , transformed in l o g e . Severity scores definition are reported in Table A5. The likelihood is defined as the fraction of contaminated servings consumed in one year. Meaning the number of servings consumed in a year d i a times the prevalence of HEV contaminated food samples α i . Likelihood scores are displayed in Table A5.
Table A5. Severity (left side) and likelihood (right side) scores definition.
Table A5. Severity (left side) and likelihood (right side) scores definition.
log e E ( C 1 i ) Score d i a · α i Score
<91<0.21
9–1120.2–0.52
11–1330.5–13
>134>14
Based on the definitions and on the data sheet reported in Table A6, we can calculate the risk for each of the food categories as risk = likelihood x severity (see Table A6) and assign to each category a qualitative risk level, as illustrated in Figure A5.
Table A6. Data sheet and scores for each food category.
Table A6. Data sheet and scores for each food category.
Category log e E ( C 1 i ) d i a · α i SeverityLikelihoodRisk
PL 11.2 0.33 326 (medium)
PNL 10.4 2248 (medium)
SH 11.3 0.124 313 (low)
ML00000
VGT00000
Figure A5. Risk matrix.
Figure A5. Risk matrix.
Foods 11 00087 g0a5

References

  1. White, P.A.; Netzler, N.E.; Hansman, G.S. Foodborne Viral Pathogens; CRC Press: Boca Raton, FL, USA, 2016. [Google Scholar]
  2. Kumar, S.; Subhadra, S.; Singh, B.; Panda, B. Hepatitis E virus: The current scenario. Int. J. Infect. Dis. 2013, 17, e228–e233. [Google Scholar] [CrossRef] [Green Version]
  3. Kamar, N.; Izopet, J.; Dalton, H.R. Chronic hepatitis E virus infection and treatment. J. Clin. Exp. Hepatol. 2013, 3, 134–140. [Google Scholar] [CrossRef] [Green Version]
  4. Woolson, K.; Forbes, A.; Vine, L.; Beynon, L.; McElhinney, L.; Panayi, V.; Hunter, J.; Madden, R.; Glasgow, T.; Kotecha, A.; et al. Extra-hepatic manifestations of autochthonous hepatitis E infection. Aliment. Pharmacol. Ther. 2014, 40, 1282–1291. [Google Scholar] [CrossRef] [PubMed]
  5. Ripellino, P.; Pasi, E.; Melli, G.; Staedler, C.; Fraga, M.; Moradpour, D.; Sahli, R.; Aubert, V.; Martinetti, G.; Bihl, F.; et al. Neurologic complications of acute hepatitis E virus infection. Neurol.-Neuroimmunol. Neuroinflamm. 2020, 7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Hakim, M.S.; Wang, W.; Bramer, W.M.; Geng, J.; Huang, F.; de Man, R.A.; Peppelenbosch, M.P.; Pan, Q. The global burden of hepatitis E outbreaks: A systematic review. Liver Int. 2017, 37, 19–31. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Ruggeri, F.M.; Di Bartolo, I.; Ponterio, E.; Angeloni, G.; Trevisani, M.; Ostanello, F. Zoonotic transmission of hepatitis E virus in industrialized countries. New Microbiol. 2013, 36, 331–344. [Google Scholar] [PubMed]
  8. Park, W.J.; Park, B.J.; Ahn, H.S.; Lee, J.B.; Park, S.Y.; Song, C.S.; Lee, S.W.; Yoo, H.S.; Choi, I.S. Hepatitis E virus as an emerging zoonotic pathogen. J. Vet. Sci. 2016, 17, 1–11. [Google Scholar] [CrossRef]
  9. Meng, X.J.; Purcell, R.H.; Halbur, P.G.; Lehman, J.R.; Webb, D.M.; Tsareva, T.S.; Haynes, J.S.; Thacker, B.J.; Emerson, S.U. A novel virus in swine is closely related to the human hepatitis E virus. Proc. Natl. Acad. Sci. USA 1997, 94, 9860–9865. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Pavio, N.; Meng, X.J.; Renou, C. Zoonotic hepatitis E: Animal reservoirs and emerging risks. Vet. Res. 2010, 41, 46. [Google Scholar] [CrossRef] [Green Version]
  11. Guillois, Y.; Abravanel, F.; Miura, T.; Pavio, N.; Vaillant, V.; Lhomme, S.; Le Guyader, F.S.; Rose, N.; Le Saux, J.C.; King, L.A.; et al. High proportion of asymptomatic infections in an outbreak of hepatitis E associated with a spit-roasted piglet, France, 2013. Clin. Infect. Dis. 2016, 62, 351–357. [Google Scholar] [CrossRef]
  12. Henneùchart-Collette, C.; Martin-Latil, S.; Fraisse, A.; Perelle, S. Comparison of three extraction methods to detect noroviruses in dairy products. Food Microbiol. 2017, 61, 113–119. [Google Scholar] [CrossRef] [PubMed]
  13. Rivero-Juarez, A.; Frias, M.; Martinez-Peinado, A.; Risalde, M.; Rodriguez-Cano, D.; Camacho, A.; Garcia-Bocanegra, I.; Cuenca-Lopez, F.; Gomez-Villamandos, J.; Rivero, A. Familial hepatitis E outbreak linked to wild boar meat consumption. Zoonoses Public Health 2017, 64, 561–565. [Google Scholar] [CrossRef]
  14. Tarantino, G.; Bagnarelli, P.; Marzioni, M.; Marinelli, K.; Surace, G.; Traini, S.; Baroni, G.S.; Menzo, S.; Benedetti, A. Hepatitis E in a region of Italy: An emerging autochthonous infection? Dig. Liver Dis. 2016, 48, 1340–1345. [Google Scholar] [CrossRef]
  15. Garbuglia, A.; Alessandrini, A.; Pavio, N.; Tesse, S.; Grignolo, S.; Viscoli, C.; Lapa, D.; Capobianchi, M. Male patient with acute hepatitis E in Genoa, Italy: Figatelli (pork liver sausage) as probable source of the infection. Clin. Microbiol. Infect. 2015, 21, e4–e6. [Google Scholar] [CrossRef] [Green Version]
  16. La Rosa, G.; Muscillo, M.; Vennarucci, V.S.; Garbuglia, A.R.; La Scala, P.; Capobianchi, M.R. Hepatitis E virus in Italy: Molecular analysis of travel-related and autochthonous cases. J. Gen. Virol. 2011, 92, 1617–1626. [Google Scholar] [CrossRef] [PubMed]
  17. Alfonsi, V.; Romanò, L.; Ciccaglione, A.R.; La Rosa, G.; Bruni, R.; Zanetti, A.; Della Libera, S.; Iaconelli, M.; Bagnarelli, P.; Capobianchi, M.R.; et al. Hepatitis E in Italy: 5 years of national epidemiological, virological and environmental surveillance, 2012 to 2016. Eurosurveillance 2018, 23, 1700517. [Google Scholar] [CrossRef] [PubMed]
  18. Terio, V.; Bottaro, M.; Pavoni, E.; Losio, M.; Serraino, A.; Giacometti, F.; Martella, V.; Mottola, A.; Di Pinto, A.; Tantillo, G. Occurrence of hepatitis A and E and norovirus GI and GII in ready-to-eat vegetables in Italy. Int. J. Food Microbiol. 2017, 249, 61–65. [Google Scholar] [CrossRef] [PubMed]
  19. Cacopardo, B.; Russo, R.; Preiser, W.; Benanti, F.; Brancati, G.; Nunnari, A. Acute hepatitis E in Catania (eastern Sicily) 1980–1994. The role of hepatitis E virus. Infection 1997, 25, 313–316. [Google Scholar] [CrossRef] [PubMed]
  20. De Schryver, A.; De Schrijver, K.; François, G.; Hambach, R.; van Sprundel, M.; Tabibi, R.; Colosio, C. Hepatitis E virus infection: An emerging occupational risk? Occup. Med. 2015, 65, 667–672. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Mughini-Gras, L.; Angeloni, G.; Salata, C.; Vonesch, N.; D’amico, W.; Campagna, G.; Natale, A.; Zuliani, F.; Ceglie, L.; Monne, I.; et al. Hepatitis E virus infection in North Italy: High seroprevalence in swine herds and increased risk for swine workers. Epidemiol. Infect. 2017, 145, 3375–3384. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Caruso, C.; Peletto, S.; Rosamilia, A.; Modesto, P.; Chiavacci, L.; Sona, B.; Balsamelli, F.; Ghisetti, V.; Acutis, P.; Pezzoni, G.; et al. Hepatitis E virus: A cross-sectional serological and virological study in pigs and humans at zoonotic risk within a high-density pig farming area. Transbound. Emerg. Dis. 2017, 64, 1443–1453. [Google Scholar] [CrossRef]
  23. Montagnaro, S.; De Martinis, C.; Sasso, S.; Ciarcia, R.; Damiano, S.; Auletta, L.; Iovane, V.; Zottola, T.; Pagnini, U. Viral and antibody prevalence of hepatitis E in European wild boars (Sus scrofa) and hunters at zoonotic risk in the Latium region. J. Comp. Pathol. 2015, 153, 1–8. [Google Scholar] [CrossRef]
  24. Di Bartolo, I.; Martelli, F.; Inglese, N.; Pourshaban, M.; Caprioli, A.; Ostanello, F.; Ruggeri, F.M. Widespread diffusion of genotype 3 hepatitis E virus among farming swine in Northern Italy. Vet. Microbiol. 2008, 132, 47–55. [Google Scholar] [CrossRef] [Green Version]
  25. Monini, M.; Di Bartolo, I.; Ianiro, G.; Angeloni, G.; Magistrali, C.F.; Ostanello, F.; Ruggeri, F.M. Detection and molecular characterization of zoonotic viruses in swine fecal samples in Italian pig herds. Arch. Virol. 2015, 160, 2547–2556. [Google Scholar] [CrossRef] [PubMed]
  26. Costanzo, N.; Sarno, E.; Peretti, V.; Ciambrone, L.; Casalinuovo, F.; Santoro, A. Serological and molecular investigation of swine hepatitis E virus in pigs raised in Southern Italy. J. Food Prot. 2015, 78, 2099–2102. [Google Scholar] [CrossRef] [PubMed]
  27. Ponterio, E.; Di Bartolo, I.; Orrù, G.; Liciardi, M.; Ostanello, F.; Ruggeri, F.M. Detection of serum antibodies to hepatitis E virus in domestic pigs in Italy using a recombinant swine HEV capsid protein. BMC Vet. Res. 2014, 10, 133. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Pavoni, E.; Barbieri, I.; Bertasi, B.; Lombardi, G.; Giangrosso, G.; Cordioli, P.; Losio, M.N. Detection and molecular characterisation of swine Hepatitis E virus in Brescia province, Italy. Ital. J. Food Saf. 2015, 4, 4587. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Di Bartolo, I.; Diez-Valcarce, M.; Vasickova, P.; Kralik, P.; Hernandez, M.; Angeloni, G.; Ostanello, F.; Bouwknegt, M.; Rodríguez-Lázaro, D.; Pavlik, I.; et al. Hepatitis E virus in pork production chain in Czech Republic, Italy, and Spain, 2010. Emerg. Infect. Dis. 2012, 18, 1282. [Google Scholar] [CrossRef] [PubMed]
  30. Di Bartolo, I.; Angeloni, G.; Ponterio, E.; Ostanello, F.; Ruggeri, F.M. Detection of hepatitis E virus in pork liver sausages. Int. J. Food Microbiol. 2015, 193, 29–33. [Google Scholar] [CrossRef] [PubMed]
  31. Chelli, E.; Suffredini, E.; De Santis, P.; De Medici, D.; Di Bella, S.; D’Amato, S.; Gucciardi, F.; Guercio, A.; Ostanello, F.; Perrone, V.; et al. Hepatitis E virus occurrence in pigs slaughtered in Italy. Animals 2021, 11, 277. [Google Scholar] [CrossRef]
  32. Suffredini, E.; Garofalo, F.; Salzano, C.; Cozzi, L.; Marco, G.d.; Romano, M.; Pesce, A. Evaluation of the presence of Norovirus, Hepatitis A, Hepatitis E, Astrovirus, Adenovirus, Aichivirus and Rotavirus in bivalve molluscs [Conference poster]. In Proceedings of the XVII Congresso Nazionale SI Di. LV, Pacengo di Lazise (VR), Italy, 28–30 September 2016; Società Italiana di Diagnostica di Laboratorio Veterinaria (SIDiLV): Pacengo di Lazise (VR), Italy, 2016; pp. 318–319. [Google Scholar]
  33. La Rosa, G.; Proroga, Y.; De Medici, D.; Capuano, F.; Iaconelli, M.; Della Libera, S.; Suffredini, E. First detection of hepatitis E virus in shellfish and in seawater from production areas in Southern Italy. Food Environ. Virol. 2018, 10, 127–131. [Google Scholar] [CrossRef] [PubMed]
  34. La Bella, G.; Basanisi, M.G.; Nobili, G.; Terio, V.; Suffredini, E.; La Salandra, G. First Report of Hepatitis E Virus in Shellfish in Southeast Italy. Appl. Sci. 2021, 11, 43. [Google Scholar] [CrossRef]
  35. Donia, D.; Dell’Amico, M.C.; Petrinca, A.R.; Martinucci, I.; Mazzei, M.; Tolari, F.; Divizia, M. Presence of hepatitis E RNA in mussels used as bio-monitors of viral marine pollution. J. Virol. Methods 2012, 186, 198–202. [Google Scholar] [CrossRef]
  36. Brassard, J.; Gagné, M.J.; Généreux, M.; Côté, C. Detection of human food-borne and zoonotic viruses on irrigated, field-grown strawberries. Appl. Environ. Microbiol. 2012, 78, 3763–3766. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Kokkinos, P.; Kozyra, I.; Lazic, S.; Bouwknegt, M.; Rutjes, S.; Willems, K.; Moloney, R.; de Roda Husman, A.M.; Kaupke, A.; Legaki, E.; et al. Harmonised investigation of the occurrence of human enteric viruses in the leafy green vegetable supply chain in three European countries. Food Environ. Virol. 2012, 4, 179–191. [Google Scholar] [CrossRef]
  38. Serracca, L.; Rossini, I.; Battistini, R.; Goria, M.; Sant, S.; Ercolini, C. Potential risk of norovirus infection due to the consumption of “ready to eat” food. Food Environ. Virol. 2012, 4, 89–92. [Google Scholar] [PubMed]
  39. La Rosa, G.; Pourshaban, M.; Iaconelli, M.; Vennarucci, V.S.; Muscillo, M. Molecular detection of hepatitis E virus in sewage samples. Appl. Environ. Microbiol. 2010, 76, 5870–5873. [Google Scholar] [CrossRef] [Green Version]
  40. Iaconelli, M.; Purpari, G.; Della Libera, S.; Petricca, S.; Guercio, A.; Ciccaglione, A.; Bruni, R.; Taffon, S.; Equestre, M.; Fratini, M.; et al. Hepatitis A and E viruses in wastewaters, in river waters, and in bivalve molluscs in Italy. Food Environ. Virol. 2015, 7, 316–324. [Google Scholar] [CrossRef]
  41. Backer, J.; Berto, A.; McCreary, C.; Martelli, F.; Van Der Poel, W. Transmission dynamics of hepatitis E virus in pigs: Estimation from field data and effect of vaccination. Epidemics 2012, 4, 86–92. [Google Scholar] [CrossRef]
  42. Müller, A.; Collineau, L.; Stephan, R.; Müller, A.; Stärk, K.D. Assessment of the risk of foodborne transmission and burden of hepatitis E in Switzerland. Int. J. Food Microbiol. 2017, 242, 107–115. [Google Scholar] [CrossRef] [Green Version]
  43. Salines, M.; Rose, N.; Andraud, M. Tackling hepatitis E virus spread and persistence on farrow-to-finish pig farms: Insights from a stochastic individual-based multi-pathogen model. Epidemics 2019, 30, 100369. [Google Scholar] [CrossRef]
  44. Crotta, M.; Lavazza, A.; Mateus, A.; Guitian, J. Quantitative risk assessment of hepatitis E virus: Modelling the occurrence of viraemic pigs and the presence of the virus in organs of food safety interest. Microb. Risk Anal. 2018, 9, 64–71. [Google Scholar] [CrossRef] [Green Version]
  45. Sarno, E.; Martin, A.; McFarland, S.; Johne, R.; Stephan, R.; Greiner, M. Estimated exposure to hepatitis E virus through consumption of swine liver and liver sausages. Food Control 2017, 73, 821–828. [Google Scholar] [CrossRef] [Green Version]
  46. R Core Team. R: A Language and Environment for Statistical Computing; R Foundation for Statistical Computing: Vienna, Austria, 2019. [Google Scholar]
  47. Riveiro-Barciela, M.; Mínguez, B.; Gironés, R.; Rodriguez-Frías, F.; Quer, J.; Buti, M. Phylogenetic demonstration of hepatitis E infection transmitted by pork meat ingestion. J. Clin. Gastroenterol. 2015, 49, 165–168. [Google Scholar] [CrossRef] [PubMed]
  48. Renou, C.; Afonso, A.M.R.; Pavio, N. Foodborne transmission of hepatitis E virus from raw pork liver sausage, France. Emerg. Infect. Dis. 2014, 20, 1945. [Google Scholar] [CrossRef] [Green Version]
  49. Tei, S.; Kitajima, N.; Takahashi, K.; Mishiro, S. Zoonotic transmission of hepatitis E virus from deer to human beings. Lancet 2003, 362, 371–373. [Google Scholar] [CrossRef]
  50. Spada, E.; Pupella, S.; Pisani, G.; Bruni, R.; Chionne, P.; Madonna, E.; Villano, U.; Simeoni, M.; Fabi, S.; Marano, G.; et al. A nationwide retrospective study on prevalence of hepatitis E virus infection in Italian blood donors. Blood Transfus. 2018, 16, 413. [Google Scholar]
  51. Marletta, L.; Camilli, E.; Catasta, G.; de Balzo, V.; Lucchini, L.; Marconi, S.; Martone, D.; Matter, M.; Piccinelli, R.; Scalfi, L.; et al. Linee Guida per una sana Alimentazione; Technical Report; Centro di Ricerca Alimenti e Nutrizione (CREA): Rome, Italy, 2017. [Google Scholar]
  52. Szabo, K.; Trojnar, E.; Anheyer-Behmenburg, H.; Binder, A.; Schotte, U.; Ellerbroek, L.; Klein, G.; Johne, R. Detection of hepatitis E virus RNA in raw sausages and liver sausages from retail in Germany using an optimized method. Int. J. Food Microbiol. 2015, 215, 149–156. [Google Scholar] [CrossRef] [PubMed]
  53. Di Pasquale, S.; De Santis, P.; La Rosa, G.; Di Domenico, K.; Iaconelli, M.; Micarelli, G.; Martini, E.; Bilei, S.; De Medici, D.; Suffredini, E. Quantification and genetic diversity of Hepatitis E virus in wild boar (Sus scrofa) hunted for domestic consumption in Central Italy. Food Microbiol. 2019, 82, 194–201. [Google Scholar] [CrossRef]
  54. Leclercq, C.; Arcella, D.; Piccinelli, R.; Sette, S.; Le Donne, C. The Italian National Food Consumption Survey INRAN-SCAI 2005–2006: Main results in terms of food consumption. Public Health Nutr. 2009, 12, 2504–2532. [Google Scholar] [CrossRef] [Green Version]
  55. Geffray, C.; Gerschenfeld, A.; Kudinov, P.; Mickus, I.; Jeltsov, M.; Kööp, K.; Grishchenko, D.; Pointer, D. 8—Verification and validation and uncertainty quantification. In Thermal Hydraulics Aspects of Liquid Metal Cooled Nuclear Reactors; Roelofs, F., Ed.; Woodhead Publishing: Cambridge, UK, 2019; pp. 383–405. [Google Scholar] [CrossRef]
  56. Saltelli, A.; Chan, K.; Scott, E. Sensitivity Analysis: Gauging the Worth of Scientific Models; Wiley Series in Probability and Statistics; Wiley: Hoboken, NJ, USA, 2000. [Google Scholar]
  57. Saltelli, A.; Ratto, M.; Andres, T.; Campolongo, F.; Cariboni, J.; Gatelli, D.; Saisana, M.; Tarantola, S. Global Sensitivity Analysis: The Primer; John Wiley & Sons: Hoboken, NJ, USA, 2008. [Google Scholar]
  58. Wasserman, L. All of Statistics: A Concise Course in Statistical Inference; Springer Science & Business Media: New York, NY, USA, 2013. [Google Scholar]
  59. Efron, B.; Tibshirani, R.J. An Introduction to the Bootstrap; CRC Press: Boca Raton, FL, USA, 1994. [Google Scholar]
  60. Tosti, M.; Longhi, S.; De Waure, C.; Mele, A.; Franco, E.; Ricciardi, W.; Filia, A. Assessment of timeliness, representativeness and quality of data reported to Italy’s national integrated surveillance system for acute viral hepatitis (SEIEVA). Public Health 2015, 129, 561–568. [Google Scholar] [CrossRef]
  61. Tosti, M.E.; Ferrigno, L.; Mele, A.; Romanò, L.; Fiacchini, D.; Bagnarelli, P.; Zotti, C.; Chironna, M.; Prato, R.; Giordani, M.T.; et al. Epidemiology and surveillance of hepatitis E in Italy: Data from the SEIEVA surveillance system 2007–2019. Epidemiol. E Prev. 2021, 45, 46–53. [Google Scholar]
  62. Lewis, H.; Wichmann, O.; Duizer, E. Transmission routes and risk factors for autochthonous hepatitis E virus infection in Europe: A systematic review. Epidemiol. Infect. 2010, 138, 145–166. [Google Scholar] [CrossRef] [Green Version]
  63. Deest, G.; Zehner, L.; Nicand, E.; Gaudy-Graffin, C.; Goudeau, A.; Bacq, Y. Autochthonous hepatitis E in France and consumption of raw pig meat. Gastroenterol. Clin. Biol. 2007, 31, 1095–1097. [Google Scholar] [CrossRef]
  64. Colson, P.; Kaba, M.; Bernit, E.; Motte, A.; Tamalet, C. Hepatitis E associated with surgical training on pigs. Lancet 2007, 370, 935. [Google Scholar] [CrossRef]
  65. Borgen, K.; Herremans, T.; Duizer, E.; Vennema, H.; Rutjes, S.; Bosman, A.; de Roda Husman, A.M.; Koopmans, M. Non-travel related Hepatitis E virus genotype 3 infections in the Netherlands; a case series 2004–2006. BMC Infect. Dis. 2008, 8, 61. [Google Scholar] [CrossRef] [Green Version]
  66. Huang, F.; Li, Y.; Yu, W.; Jing, S.; Wang, J.; Long, F.; He, Z.; Yang, C.; Bi, Y.; Cao, W.; et al. Excretion of infectious hepatitis E virus into milk in cows imposes high risks of zoonosis. Hepatology 2016, 64, 350–359. [Google Scholar] [CrossRef] [Green Version]
  67. Baechlein, C.; Bacher, P. No evidence for zoonotic hepatitis E virus infection through dairy milk in Germany. Hepatology 2017, 65, 394–395. [Google Scholar] [CrossRef] [PubMed]
  68. Vercouter, A.S.; Sayed, I.M.; Lipkens, Z.; De Bleecker, K.; De Vliegher, S.; Colman, R.; Koppelman, M.; Supré, K.; Meuleman, P. Absence of zoonotic hepatitis E virus infection in Flemish dairy cows. Int. J. Food Microbiol. 2018, 281, 54–59. [Google Scholar] [CrossRef] [PubMed]
  69. Geng, Y.; Zhao, C.; Huang, W.; Wang, X.; Xu, Y.; Wu, D.; Du, Y.; Liu, H.; Wang, Y. Hepatitis E virus was not detected in feces and milk of cows in Hebei province of China: No evidence for HEV prevalence in cows. Int. J. Food Microbiol. 2019, 291, 5–9. [Google Scholar] [CrossRef] [PubMed]
  70. Ross, S.M. Introduction to Probability and Statistics for Engineers and Scientists; Academic Press: Cambridge, MA, USA, 2020. [Google Scholar]
  71. Rausand, M.; Haugen, S. Risk Assessment: Theory, Methods, and Applications; John Wiley & Sons: Hoboken, NJ, USA, 2020; Volume 115. [Google Scholar]
Figure 1. The model sketch.
Figure 1. The model sketch.
Foods 11 00087 g001
Figure 2. They are named from (af) from the top left corner to bottom right. (a) Density distribution of new HEV infected individuals per year X P L . The green line indicates the mean value N i n f P L . (b) Density distribution of new HEV infected individuals per year X P N L . The green line indicates the mean value N i n f P N L . (c) Density distribution of new HEV infected individuals per year X S H . The green line indicates the mean value N i n f S H . (d) Cumulative distribution of X P L . (e) Cumulative distribution of X P N L . (f) Cumulative distribution of X S H .
Figure 2. They are named from (af) from the top left corner to bottom right. (a) Density distribution of new HEV infected individuals per year X P L . The green line indicates the mean value N i n f P L . (b) Density distribution of new HEV infected individuals per year X P N L . The green line indicates the mean value N i n f P N L . (c) Density distribution of new HEV infected individuals per year X S H . The green line indicates the mean value N i n f S H . (d) Cumulative distribution of X P L . (e) Cumulative distribution of X P N L . (f) Cumulative distribution of X S H .
Foods 11 00087 g002
Figure 3. (a) Histogram of p P L samples. (b) Sample cumulative distribution of p P L .
Figure 3. (a) Histogram of p P L samples. (b) Sample cumulative distribution of p P L .
Foods 11 00087 g003
Figure 4. (a) Histogram of p P N L samples. (b) Sample cumulative distribution of p P N L .
Figure 4. (a) Histogram of p P N L samples. (b) Sample cumulative distribution of p P N L .
Foods 11 00087 g004
Figure 5. (a) Histogram of p S H samples. (b) Sample cumulative distribution of p S H .
Figure 5. (a) Histogram of p S H samples. (b) Sample cumulative distribution of p S H .
Foods 11 00087 g005
Figure 6. Scatterplot of input parameters for category PL versus the output considered ( p P L ). (a) λ P L . (b) c o n s d a y P L (c) μ .
Figure 6. Scatterplot of input parameters for category PL versus the output considered ( p P L ). (a) λ P L . (b) c o n s d a y P L (c) μ .
Foods 11 00087 g006
Figure 7. Scatterplot of input parameters for category PNL versus the output considered ( p P N L ). (a) λ P N L . (b) c o n s d a y P N L (c) μ .
Figure 7. Scatterplot of input parameters for category PNL versus the output considered ( p P N L ). (a) λ P N L . (b) c o n s d a y P N L (c) μ .
Foods 11 00087 g007
Figure 8. Scatterplot of input parameters for category SH versus the output considered ( p S H ). (a) λ S H . (b) c o n s d a y S H (c) μ .
Figure 8. Scatterplot of input parameters for category SH versus the output considered ( p S H ). (a) λ S H . (b) c o n s d a y S H (c) μ .
Foods 11 00087 g008
Table 1. Model parameters.
Table 1. Model parameters.
ParameterDescription
i {PL, PNL, SH, GV, RM}food category as listed in the Introduction
α i = 1 β i contamination probability for food category i
C i α i exp ( λ i ) + β i δ 0 viral concentration per serving (g.e. HEV/serving)
λ i 1 average viral concentration per serving (g.e. HEV/serving)
s e r v i mean serving size for food category i (gr)
( c o n s d a y i ) 1 mean daily intake of food category i in a year per person (gr/day)
d i a = c o n s d a y i · 365 s e r v i total servings consumed per year per person (number serving/year)
S exp ( μ ) individual HEV infectious dose distribution (g.e.)
μ 1 mean individual infectious dose (g.e.) [13,47,48,49]
s e r v o u t mean serving size (gr) of food implicated in outbreaks [13,47,48,49]
NItalian population 18+ (1st January 2021, ISTAT)
hproportion of HEV seropositive population [50]
N ¯ = N · ( 1 h ) susceptible population
q i = P ( C i > S ) probability of infection after consumption of one single serving
T i Geom ( q i ) number of failures before first successful exposure to HEV
p i = P ( T i d i a ) probability of HEV infection per individual per year
X i B i n ( N ¯ , p i ) distribution of new HEV infected individuals per year
N i n f i = E ( X i ) expected number of HEV infected individuals per year ( n o . )
Table 2. Survey sample size.
Table 2. Survey sample size.
Food CategorySample Size
PNL104
PL92
RM142
SH204
GV108
Table 3. Parameter estimations per food category. A 95% CI is reported between brackets.
Table 3. Parameter estimations per food category. A 95% CI is reported between brackets.
CategoryParameterEstimation
PL—Liver pork products α P L 0.11 [ 0.06 –0.20]
λ P L 1.28 × 10 5 [ 6.4 × 10 6 2.14 × 10 5 ]
s e r v P L 100 g
c o n s d a y P L 0.73 g d a y [ 0.70 0.752 ]
PNL—No liver pork products α P N L 0.028 [ 0.006 0.082 ]
λ P N L 2.91 × 10 5 [ 6 × 10 6 7 × 10 5 ]
s e r v P N L 100 g
c o n s d a y P N L 20 g d a y [ 19.58 20.59 ]
SH—Shellfish α S H 0.0048 [ 0.00012 0.027 ]
λ S H 1.15 × 10 5 [ 2.91 × 10 7 4.24 × 10 5 ]
s e r v S H 150 g
c o n s d a y S H 10 g d a y [ 9.99 11.7 ]
GV—Leafy vegetables α G V 0 [ 0 0.033 ]
λ G V Inf
s e r v G V 100 g
c o n s d a y G V 29 g d a y [ 28.62 30.15 ]
RM—Raw milk α R M 0 [ 0 0.025 ]
λ R M Inf
s e r v R M 50 g
c o n s d a y R M 54.43 g d a y [ 52.77 56.16 ]
Table 4. Mean viral load per serving (g.e./gr) E ( C 1 i ) , meaning λ i 1 , the average number of serving consumed in one year d i a and the prevalence of HEV positive food samples for each category α i .
Table 4. Mean viral load per serving (g.e./gr) E ( C 1 i ) , meaning λ i 1 , the average number of serving consumed in one year d i a and the prevalence of HEV positive food samples for each category α i .
Category E ( C 1 i ) (g.e/serving) d i a (no.serving/year)Prevalence α i
PL 78,000 30.11
PNL 34,000 490.028
SH 87,000 260.0048
GV01320
RM01070
Table 5. General model parameters. A 95% CI is reported between brackets.
Table 5. General model parameters. A 95% CI is reported between brackets.
ParameterEstimation
μ 1.37 × 10 7 [ 5.51 × 10 8 2.55 × 10 7 ]
s e r v o u t 100 g
h0.087
N50,208,329
N ¯ 45,840,205
Table 6. Probability of infection following the consumption of a single serving ( q i ) and in one year ( p i ) and expected number of new infected individuals per year per food category in the Italian population ( N i n f ).
Table 6. Probability of infection following the consumption of a single serving ( q i ) and in one year ( p i ) and expected number of new infected individuals per year per food category in the Italian population ( N i n f ).
Category q i p i N inf i
PL 1.22 × 10 3 3.65 × 10 3 167,200
PNL 1.35 × 10 4 9.81 × 10 3 449,917
SH 5.67 × 10 5 1.47 × 10 3 67,473
GV000
RM000
Table 7. Summary statistics of output samples.
Table 7. Summary statistics of output samples.
CategoryParameterMean1st Qu.Median3rd Qu.
PL p P L 4.2 × 10 3 2.6 × 10 3 3.7 × 10 3 5.1 × 10 3
N i n f P L 190,000120,000170,000230,000
PNL p P N L 1.1 × 10 2 5.6 × 10 3 9.2 × 10 3 1.4 × 10 1
N i n f P L 520,000250,000420,000670,000
SH p S H 3.3 × 10 3 8.8 × 10 4 2.1 × 10 3 4.5 × 10 3
N i n f S H 150,00040,00099,000200,000
Table 8. Regression analysis coefficients result for pork products containing liver.
Table 8. Regression analysis coefficients result for pork products containing liver.
CoefficientEstimateStandardized EstimateStd. Errorp-Value
λ P L ^ 2.2 × 10 2 7.21 × 10 1 1.39 < 2 × 10 16
c o n s d a y P L ^ 5 × 10 3 8.13 × 10 1 3.27 × 10 5 < 2 × 10 16
μ ^ 2.26 × 10 4 8.47 × 10 1 8 × 10 < 2 × 10 16
Table 9. Regression analysis coefficients result for pork products without liver.
Table 9. Regression analysis coefficients result for pork products without liver.
CoefficientEstimateStandardized EstimateStd. Errorp-Value
λ P N L ^ 9.25 × 10 3.93 × 10 1 1.39 < 2 × 10 16
c o n s d a y P N L ^ 2 × 10 4 3 × 10 1 7.8 × 10 6 < 2 × 10 16
μ ^ 7.14 × 10 4 8.76 × 10 1 8.13 × 10 2 < 2 × 10 16
Table 10. Regression analysis coefficients result for shellfish.
Table 10. Regression analysis coefficients result for shellfish.
CoefficientEstimateStandardized EstimateStd. Errorp-Value
λ S H ^ 1.57 × 10 2 1.45 × 10 2 7.53 × 10 3 3.6 × 10 2
c o n s d a y S H ^ 1.18 × 10 5 4.92 × 10 2 3.96 × 10 6 3.51 × 10 3
μ ^ 1.99 × 10 4 6.76 × 10 1 4.98 × 10 2 < 2 × 10 16
Table 11. Information on food consumption among hepatitis E cases reported between 2016 and 2019 to the Italian surveillance system for acute viral hepatitis (SEIEVA).
Table 11. Information on food consumption among hepatitis E cases reported between 2016 and 2019 to the Italian surveillance system for acute viral hepatitis (SEIEVA).
FoodCases with Information
on Consumption Available
Cases Reporting
Consumption of the Food
NN% (of Cases with
Information Available)
pork meat906976
pork cured meat835870
pork liver meat511429
fruit361028
shellfish1864926
wild boar meat771722
vegetables34515
wild boar cured meat55814
offal53611
other game meat5347
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Moro, O.; Suffredini, E.; Isopi, M.; Tosti, M.E.; Schembri, P.; Scavia, G. Quantitative Methods for the Prioritization of Foods Implicated in the Transmission of Hepatititis E to Humans in Italy. Foods 2022, 11, 87. https://doi.org/10.3390/foods11010087

AMA Style

Moro O, Suffredini E, Isopi M, Tosti ME, Schembri P, Scavia G. Quantitative Methods for the Prioritization of Foods Implicated in the Transmission of Hepatititis E to Humans in Italy. Foods. 2022; 11(1):87. https://doi.org/10.3390/foods11010087

Chicago/Turabian Style

Moro, Ornella, Elisabetta Suffredini, Marco Isopi, Maria Elena Tosti, Pietro Schembri, and Gaia Scavia. 2022. "Quantitative Methods for the Prioritization of Foods Implicated in the Transmission of Hepatititis E to Humans in Italy" Foods 11, no. 1: 87. https://doi.org/10.3390/foods11010087

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop