Next Article in Journal
Maternal Protein Restriction Altered Insulin Resistance and Inflammation-Associated Gene Expression in Adipose Tissue of Young Adult Mouse Offspring in Response to a High-Fat Diet
Previous Article in Journal
Dietary Patterns Based on Estimated Glomerular Filtration Rate and Kidney Function Decline in the General Population: The Lifelines Cohort Study
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

An Enhanced Approach for Economic Evaluation of Long-Term Benefits of School-Based Health Promotion Programs

School of Public Health, University of Alberta, 3-50 University Terrace, 8303–112 St, Edmonton, AB T6G 2T4, Canada
*
Author to whom correspondence should be addressed.
Nutrients 2020, 12(4), 1101; https://doi.org/10.3390/nu12041101
Submission received: 31 March 2020 / Revised: 10 April 2020 / Accepted: 12 April 2020 / Published: 16 April 2020
(This article belongs to the Section Nutrition and Public Health)

Abstract

:
Chronic diseases constitute a tremendous public health burden globally. Poor nutrition, inactive lifestyles, and obesity are established independent risk factors for chronic diseases. Public health decision-makers are in desperate need of effective and cost-effective programs that prevent chronic diseases. To date, most economic evaluations consider the effect of these programs on body weight, without considering their effects on other risk factors (nutrition and physical activity). We propose an economic evaluation approach that considers program effects on multiple risk factors rather than on a single risk factor. For demonstration, we developed an enhanced model that incorporates health promotion program effects on four risk factors (weight status, physical activity, and fruit and vegetable consumption). Relative to this enhanced model, a model that considered only the effect on weight status produced incremental cost-effectiveness ratio (ICER) estimates for quality-adjusted life years that were 1% to 43% higher, and ICER estimates for years with chronic disease prevented that were 1% to 26% higher. The corresponding estimates for return on investment were 1% to 20% lower. To avoid an underestimation of the economic benefits of chronic disease prevention programs, we recommend economic evaluations consider program effects on multiple risk factors.

1. Introduction

Chronic diseases are the leading cause of death and disease burden in almost all countries worldwide, except in Africa. It is projected that chronic diseases will account for 7.63 million deaths (66.7% of all deaths) worldwide in 2020. In Canada, chronic diseases account for 89% of all deaths [1] and more than $93 billion in direct and indirect health care costs per year [2]. While there are a number of causes of chronic diseases, at least 80% of all cases of type 2 diabetes and cardiovascular disease (CVD), and 40% of all cases of cancer in Canada can be prevented through the adoption of healthy diets, regular physical activity, and avoidance of tobacco products [3]. Despite the issuing of public health recommendations for diet and active living to reduce the burden of chronic diseases, recent studies show that 74% of Canadians consume less than the recommended number of servings of vegetables and fruit [4], 85% of adults are not meeting recommendations for physical activity [5], and 62% have excess body weight [6]. Among 9–13-year-olds, only 32% of girls and 38% of boys meet recommended intake levels of vegetables and fruit [7], and only 7% of Canadian children meet recommended activity levels [8].
Because the foundation for the development of obesity and chronic diseases are laid early in life [9,10,11] and healthy behaviors developed in childhood are commonly maintained throughout the lifetime [12], promotion of healthy eating and active living (HEAL) is considered more effective when targeting children [13] and schools are the primary setting to reach nearly all children. Successful school-based HEAL promotion programs are therefore needed to address childhood obesity and consequent chronic diseases.
Though there is evidence on school-based programs that have been effective in improving HEAL behaviors and preventing obesity [13], it is essential for policy and decision-makers across the health and education sectors to justify the resources needed for the implementation of school-based health promotion programs. In addition to the effectiveness of these programs in improving HEAL behaviors, preventing obesity and adverse health outcomes, policy-makers and stakeholders have to consider program cost, feasibility, acceptability, and sustainability when making policy decisions. To allow for evidence-based decisions, decision-makers also need to know the short- and long-term costs, cost-effectiveness, and return on investments (ROI) of school-based health promotion programs. So far, the most commonly used models in the evaluation of long-term benefits of health promotion programs such as ACE-obesity [14], WHO CDP model [15], NICE-obesity [16] and other similar models [17,18,19,20], rely on simulating program effects through weight status. However, evaluations based on weight status alone may not capture the potential direct health effects of nutrition and activity levels that are not translated into body weight status, resulting in potential underestimation of the true benefits of these programs. There is, therefore, a need for models that can incorporate both the intervention benefits through weight status and any potential direct effects from targeted behavioral risk factors to chronic disease. Models such as the RIVM-CDM model [21], allow for the evaluation of multiple targeted risk factors but assume independence in the distribution of risk factors. The objectives of this manuscript were to (1) propose an approach that incorporates program effects on multiple risk factors while allowing for interdependencies between the risk factors, (2) apply the proposed approach to develop a model that incorporates program effects on four risk factor (i.e., weight status, physical activity, and fruit and vegetable consumption levels) that are commonly targeted by school-based health promotion programs, and (3) apply the developed model in a simulated hypothetical program.

2. Methods

2.1. Proposed Approach

The proposed approach involves developing a model that starts with the short-term effects of a given program on the joint distribution of risk factors observed at a chosen model starting age. Then, using transition probabilities of the joint distribution of the risk factors in the general population to propagate the observed short-term effects in a lifetime, while using the established effects of the risk factors on chronic diseases to incorporate the probabilities of developing chronic diseases. Lastly, use the established effects of the risk factors and chronic diseases on mortality to incorporate the probability of death.

2.2. A Model to Incorporate Program Effects on Weight Status, Physical Activity, and Fruit and Vegetables Consumption Levels

In this paper, we specifically developed a model that incorporates health promotion program effects on four risk factors (i.e., weight status, physical activity, and fruit and vegetable consumption levels). We chose these four risk factors because they are the targets of most school-based health promotion programs, in addition to the availability of longitudinal data to estimate their joint transition probabilities.
The model includes 793 Markov states based on; 3 weight status categories (normal weight, overweight, and obesity), 2 categories each (meeting and not meeting recommendations) for physical activity, fruit and vegetable consumption, and 33 chronic disease status (no chronic disease and 32 chronic diseases), plus an absorbing state (died). Only 32 chronic diseases for which the Global Burden of Disease Study (GBD) reported evidence on the relationship to the four risk factors were considered [22] (Table 1). Relative risk estimates linking the 32 chronic diseases to the four risk factors were obtained from the supplementary tables of the GBD Lancet publication [22]. We only included relationships for which the relative risks were statistically significant (Table 1).

2.3. Model Inputs

2.3.1. Program Effects

The joint probability, ϑ w p f v ( ) , of being in a given combined classification of the four risk factor levels at age 10 years, given a particular program’s effects on weight status ( α w ), physical activity level ( ψ p ), fruit ( λ f ) and vegetable ( τ v ) consumptions levels were incorporated in the model using the following composite function for any given number of risk factors, R.
ϑ k 1 k R ( ) = ( f R f R 1 f 2 f 1 ) ( ϑ k 1 k R ( 0 ) )
f r ( ϑ k 1 k R ) = ξ k r ϑ k 1 k R k r ϑ k 1 k R k r ξ k r ϑ k 1 k R   ,   r ϵ { 1 , 2 , , R }
where
ξ k r = Effect of the program on the odds of being in the k t h status of risk factor r
ϑ k 1 k R ( 0 ) = is the joint probability of being in a given combination of status levels ( k 1 k R ) of the R risk factors under no program effect (base case)
The following notations are used through the manuscript for the specific simulation example.
α w = Effect of the program on weight status, w ϵ { 0 , 1 , 2 } for normal weight, overweight and obese, respectively
ψ p = Effect of the program on physical activity level, p ϵ { 0 , 1 } for not meeting and meeting physical activity levels, respectively
λ f = Effect of the program on fruit consumption,   f ϵ { 0 , 1 } for not meeting and meeting fruit consumption levels, respectively
λ v = Effect of the program on vegetables consumption,   v ϵ { 0 , 1 } for not meeting and meeting vegetable consumption levels, respectively
ϑ w p f v ( 0 ) —The joint probability of being in a given combined classification of weight status ( w ), physical activity level ( p ), fruit ( f ) and vegetable ( v ) consumption levels at age 10 years, under no program effect (base case).
Table S1 presents the joint distribution of weight status, physical activity level, fruit and vegetable consumptions levels among under 14-year old’s in Canada that we used as the initial joint probability, ϑ w p f v ( 0 ) , at age 10 years, under no program effect. These estimates were obtained from the analysis of the Canadian Community Health Survey (CCHS) data for 2007 to 2014 annual cycles [23].

2.3.2. Joint Transition Probabilities of Weight Status, Physical Activity, and Fruit and Vegetable Consumption Levels

Estimates of the joint transition probabilities of the four risk factors were obtained from an analysis of longitudinal data from a Canadian cohort called the National Population Health Survey (NPHS), that follows participants 12 years of age or older and collected data every two years [24]. The NPHS target population includes household residents in all provinces and territories, except persons living on Indian Reserves, on Canadian Forces Bases, and in some remote areas [24].
A joint multivariate conditional logit model, using an approach proposed by Westfall et al. [25], was fitted to the NPHS data to estimate the joint transition probabilities of the four risk factors. In this joint model, the independent variables/covariates were; sex, age, weight status, physical activity, fruit and vegetable consumption levels at a given time point, and the joint outcomes were; weight status, physical activity, and fruit and vegetable consumption levels in the next assessment (two years later). The final parsimonious model was obtained using a stepwise model selection process, considering up to four-way interactions for both outcome and explanatory variables. Parameter estimates of the fitted joint model (Table S2) were then used in the Markov model to obtain sex and age-specific joint transition probabilities of the four risk factors at each stage. Reference values used to define meeting physical activity, fruit and vegetable consumption levels are presented in Table S7.

2.3.3. Conditional Probability of Dying Given Weight Status, Physical Activity Level, Fruit Consumption, Vegetable Consumption, and Chronic Disease Status

These probabilities were estimated based on the general Canadian population mortality hazards by sex and age, extracted from the Canadian life table [26] and the effects of chronic diseases, weight status, physical activity level, and fruit and vegetable consumption levels on all-cause mortality [27,28,29,30,31,32,33,34,35,36,37,38,39,40] (Tables S3 and S4). Because the published effects of chronic diseases and the four risk factors on all-cause mortality were not estimated relative to the general population, the prevalence of the various chronic diseases and distribution of the four risk factors were used to convert the reported mortality rate ratios into standardized mortality ratios (SMR).
For example, at any given age and sex, the SMR (mortality ratio relative to the general population) for weight status was estimated as,
S M R w = M R w w P w M R w
where
M R w —Mortality rate ratio for weight status w compared to normal weight.
P w —Proportion of individuals who are in weight status w .
This estimation approach was used for all rate ratios/relative risks for which the reference category was not the general population.
Assuming no synergistic or antagonistic effects of the four risk factors and chronic diseases on mortality, the mortality hazard at any given combination of age, sex, weight status, physical activity, fruit consumption, vegetable consumption, and chronic disease status was estimated using the following expression.
h = k ϵ { w , p , f , v , d } S M R k k P k S M R k × H
where
h —Conditional mortality hazard given sex, age, weight status ( w ), physical activity level ( p ), fruit ( f ) and vegetables ( v ) consumption levels and chronic disease status ( d ).
S M R k —Standardized mortality rate ratio for the k t h status of the respective risk factor/disease.
P k —Proportion of individuals who are in the k t h status of a given risk factor/disease.
H —Age and sex-specific mortality hazard, obtained from the Canadian life table.
w ϵ { 0 , 1 , 2 } —For normal weight, overweight and obese, respectively.
p ϵ { 0 , 1 } —For not meeting and meeting physical activity recommendations, respectively.
f ϵ { 0 , 1 } —For not meeting and meeting fruit consumption recommendations, respectively.
v ϵ { 0 , 1 } —For not meeting and meeting vegetable consumption recommendations, respectively.
d ϵ { 1 , 2 , ..32 } —For the 32 chronic diseases, respectively.
Probabilities of developing chronic diseases.
The probabilities of developing chronic diseases were estimated using published data on incidence rates of chronic diseases in Canada [41], the distributions of weight status, physical activity, and fruit and vegetable consumption in Canada and their established effects (relative risks) on chronic diseases [22]. Incidence rates estimates of the 32 chronic diseases were obtained from the Global Burden of Disease database using their online results tool [41]. Incidence rates for cataract and hypertensive heart disease that were not available in the GBD database were estimated from available age-specific prevalence and mortality rate values using a nonlinear equation proposed by Podgor and Leske [42]. This equation which is nonlinear in incidence was solved using the Newton-Raphson method [43].
For each combination of the four risk factors, we estimated the overall probability of developing a given chronic disease assuming no synergistic or antagonistic effects, i.e., combined effect being a product in the multiplicative scale (relative risks).
At each stage, the probability of developing a given chronic disease given, weight status ( w ), physical activity level ( p ), fruit ( f ) and vegetable ( v ) consumptions levels was estimated as
p = 1 e I w p f v × t
where,
I w p f v = k ϵ { w , p , f , v } R R k k P k R R k × I
I —Published age and sex-specific incidence of a given chronic disease.
I w p f v —Estimated age and sex-specific incidence of a given chronic disease for given weight status, physical activity level, fruit and vegetable consumption.
t —Markov cycle length in years.
R R k —Relative risk of developing a given chronic disease for the k t h status of each respective risk factor.
P k —Proportion of individuals who are in the k t h status of a given risk factor.

2.4. Outcomes

We estimated three outcome measures from the model i.e., person-years with chronic diseases, quality-adjusted life years (QALYs) lived, and chronic disease health care costs. For every year lived with excess weight or chronic disease, we assigned a decrement in health utility scores that are based on population preferences for health states on the scale 0 (death) and 1 (full health) producing QALYs lived in a given status. The estimated decrements in health utility scores were obtained from previously published estimates by Schultz et al. [44] and Jia et al. [45] (Table S5). Though the decrements estimated by Jia et al. were based on participants who were 18 years of age or older, we applied the same decrements for all over the age of 10 years. For each given combination of weight status and chronic disease Markov state, the higher of the two QALY decrement estimates was used (weight status or chronic disease).

2.5. Health Care Costs Attributable to Chronic Disease

A prevalence approach was used to estimate per-capita annual direct health care costs attributable to major chronic disease diagnosis categories. The total direct health care costs in Canada in 2016 were extracted from the available open data on National Health Expenditure Trends provided by the Canadian Institute for Health Information (CIHI) [46]. These costs were then proportionally allocated to the diagnosis categories based on the proportions obtained from the Economic Burden of Illness in Canada (EBIC 2008) online tool [47]. Estimates of the prevalence of chronic diseases [41] and the total population of Canada in 2016 [48] were used to estimate the number of prevalent cases and subsequently the attributable annual costs per case (Table S6).

2.6. Discounting

All future costs and health outcomes (up to 84 years) were discounted to their present values using an annual discount rate of 1.5% [49].

2.7. Simulated Hypothetical Program

To demonstrate the extent to which an evaluation based on only weight status would underestimate the economic benefits of a given program, we simulated a hypothetical program that is implemented for two years at an average annual cost of $50 per student and results in a 30% reduction in the odds of obesity (i.e., odds ratio = 0.7) in combination with various effects on physical activity, fruit and vegetable consumption. From this simulation, we generated estimates of lifetime incremental effects on QALYs, years with chronic disease, and return on investment, that is the ratio between the program benefits (savings) and program costs, for various combinations of program effects on weight status, physical activity, and fruit and vegetable consumption. The model only incorporates the program effects in changing the joint risk factor distributions the model starting point (age 10), thus assuming no additional effect on transition probabilities.

2.8. Sensitivity Analysis

We also performed probabilistic sensitivity analysis (PSA) to incorporate uncertainties in all model parameters simultaneously [50]. In PSA, the prevalence and incidence inputs were assumed to follow a beta distribution, relative risks and mortality rate ratios were assumed to follow log-normal distributions, and parameters of the multinomial model for risk transitions were assumed to follow a normal distribution. We carried out a total of 10,000 simulations, where model parameters were assigned random values drawn from their respective distributions. The 2.5th and 97.5th percentiles from these simulations were used to estimate the 95% confidence intervals.

2.9. Statistical Analysis

All statistical analyses of data from the Canadian Community Health Survey (CCHS) and the National Population Health Survey (NPHS) were carried out using SAS 9.4 [51]. The economic model was implemented in TreeAge Pro 2020, (Williamstown, MA, USA) [52].

3. Results

Parameter estimates of the fitted joint multivariate model of the four risk factors are presented in Table S2. The final parsimonious model included two-way and three-way interactions between the dependent variables, indicating interdependencies between weight status, physical activity, fruit consumption, and vegetable consumption.
To demonstrate the extent to which an evaluation based on only weight status would underestimate the economic benefits of a given program, we generated estimates of lifetime incremental effects on QALYs, years with chronic disease, and return on investment for various combinations of program effects on weight status, physical activity, and fruit and vegetable consumption. Table 2, Table 3 and Table 4 present partial results for a hypothetical program that is implemented for two years at an average annual cost of $50 per student and results in a 30% reduction in the odds of obesity (i.e., odds ratio = 0.7) in combination with various effects on physical activity, fruit and vegetable consumption. Table 2 shows that an evaluation that considers only a 30% reduction in the odds of obesity produces higher values of the incremental cost-effectiveness ratio (ICER) for QALYs gained relative to evaluations that also consider the effects on physical activity and fruit and vegetable consumption. Estimated ICERs based on obesity reduction alone ranged from 1% higher, if the program had a modest 1% increase in the odds of meeting recommendations for only vegetables, to 43% higher if the program doubled the odds of meeting recommendations for all the three behavior factors in addition to reducing the odds of obesity (Table 2).
Similarly, the ICER for years with chronic disease prevented would range from 1% higher if the program had a modest 1% increase in the odds of meeting the recommended vegetable consumption, to 26% higher if it doubled the odds of meeting all three behavioral risk factors in addition to reducing the odds of obesity (Table 3).
Underestimation of the return on investment ranges from 1% if the program had a modest 1% increase in the odds of meeting recommendations only for vegetable consumption to 20% if it doubled the odds of meeting recommendations for all three behavior factors in addition to reducing the odds of obesity (Table 4).

4. Discussion

We developed a comprehensive model to estimate the economic benefits of school-based health promotion that considers program effects on multiple targeted risk factors such as nutrition and physical activity in addition to the effects on body weight status. In our demonstration example, we show that such a comprehensive model provides substantially more favorable estimates of cost-effectiveness and return on investment than the commonly applied models [14,15,16,17,18,19,20] that only consider the program effects on only one risk factor like weight status. In other words, these commonly applied models result in underestimation of the true economic benefits. This is because these models essentially assume that all the targeted modifiable risk factors (nutrition and physical activity) affect chronic diseases only through their effects on body weight. Herewith they ignore the independent effects of nutrition and physical activity on chronic disease, over and above the effects of body weight, that have been shown to exist in meta-analyses of studies that adjusted for body mass index [53,54]. For this demonstration, we calculated ICERs using only the program costs, but the observed underestimation also applies to ICERs calculated after future health care cost savings are deducted from program costs.
The estimates presented in Table 2, Table 3 and Table 4, demonstrate that economic evaluations based on program effects on body weight alone, as commonly done [14,15,16,17,18,19,20], result in underestimation of long-term program benefits. We, therefore, recommend that future economic evaluations consider program effects on multiple outcomes and that those evaluations that considered a program effect on only a single outcome be considered an underestimation.
With 89% of all deaths being attributable to chronic diseases [1] and with more than $93 billion in annual direct and indirect health care costs (2), chronic diseases constitute a tremendous public health burden to Canada, as they are globally [3]. Public health decision-makers are therefore in desperate need of intervention programs that are effective and cost-effective. The present paper is essential to them in that it illustrates that many of the studies to date, have underestimated the true cost-effectiveness of the programs evaluated. One could even make the point that the comprehensive estimates of the economic benefits described in the present paper still represent underestimates because there may be more nutritional and other activity risk factors involved: In addition to vegetables and fruit, also whole grains, nuts and seeds, milk, processed meat, red meat, and sugar-sweetened beverages have been shown to be health care costs drivers, totaling $13.8 billion per year for Canada [55]. In addition to lack of physical activity, sedentary activity and inadequate sleep have also been shown to contribute to health care costs [56,57]. The unfortunate reality is that a full spectrum of nutritional and movement information is rarely collected. Instead, the information is typically limited to vegetables and fruit consumption, physical activity and body weight, which we had used in the present study. However, the models used in the present study can be extended to include those other nutritional and movement risk factors, as well as other behavioral risk factors that programs may target such as smoking and alcohol use.
In addition to the notion that estimates of economic benefits to date represent underestimates, the present study is also essential to public health decision-makers in that it shows that multi-component or comprehensive interventions are more likely to lead to economic benefits. As each component of nutrition, physical activity, and body weight have independent contributions for cost-effectiveness and return on investment, program designers and implementers are encouraged to target each of the three, rather than, for example, only nutrition or only physical activity. This applies as much to school programs as it does to community-based, occupational and clinical programs.
A strength of the present study is that we took a prospective incidence modeling approach and used the most reliable available input estimates. Incidence, prevalence and relative risk estimates were all obtained from the Global Burden of Disease Study, which provides a comprehensive assessment of risk factor exposure and attributable burden of disease using an extensive body of published literature and several updated data sources [22]. The joint transition probabilities were based on a comprehensive longitudinal survey that has been collecting data in all Canadian provinces and territories every two years since 1994 [24]. However, what applies to all economic models also applies to our models in that they represent a simplification of reality and rely on a number of assumptions and model inputs obtained from various sources [58]. We applied health utility score decrements due to weight status that were estimated for the 18+ years population to the 10–17 years age group. This may have underestimated the QALYs if the decrements are smaller for those under 18 years old. However, we do not expect this to change findings on the relative comparisons as the underestimation applies equally to the compared scenarios. As a limitation, we should also note that the transition probabilities were calculated based on self-reported rather than measured nutrition, physical activity and body weight which is prone to error. We are not aware of any better longitudinal data sets to derive the transition probabilities from. It is for this reason that we make our parameter estimates available (Table S2) for other researchers who may wish to use them. Though we used a cohort-based Markov model in our demonstration, the model can also be implemented using microsimulation which has more flexibility in incorporating aspects such as co-morbidities without increasing the model states substantially.

5. Conclusions

Economic evaluation of long-term benefits of health promotion programs, particularly comprehensive programs that target multiple risk factors, should be comprehensive and not based on only their effects on weight status. Current estimates of cost-effectiveness and return of investment, that may have been already considered in policy decisions, likely represent significant underestimations of the true economic benefits.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6643/12/4/1101/s1, Table S1: Joint distribution of weight status, physical activity, fruit and vegetable consumption among under 14-year old’s in Canada, Table S2: Multivariate model for the joint transition probabilities of weight status, physical activity, fruit and vegetable consumption, Table S3: Effect of chronic diseases on all-cause mortality, Table S4: Effect of weight status, physical activity, fruit and vegetable consumption on all-cause mortality, Table S5: Impact of chronic diseases and weight status on health-related quality of life, Table S6: Estimated attributable annual direct costs per person with chronic disease, Table S7: Reference values use for meeting physical activity, fruit and vegetable consumption.

Author Contributions

Conceptualization, J.P.E., A.O., and P.J.V.; methodology, J.P.E., A.O., and P.J.V.; formal analysis, J.P.E.; writing—original draft preparation, J.P.E., A.O., and P.J.V.; writing—review and editing, J.P.E., A.O., and P.J.V. All authors have read and agreed to the published version of the manuscript.

Funding

The present study was funded through the Collaborative Research and Innovation Opportunities (CRIO) Team program from Alberta Innovates Health Solutions awarded to Paul J Veugelers (P.J.V.) and Arto Ohinmaa (A.O.). All interpretations and opinions in the present study are those of the authors.

Acknowledgments

We thank Irene Wong of Statistics Canada for providing assistance and access to data from the CCHS and the NPHS surveys.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. World Health Organization. Preventing Chronic Diseases: A Vital Investment. 2005. Available online: http://www.who.int/chp/chronic_disease_report/media/CANADA.pdf (accessed on 23 April 2015).
  2. Mirolla, M. The Cost of Chronic Disease in Canada. 2004. Available online: http://www.gpiatlantic.org/pdf/health/chroniccanada.pdf (accessed on 1 May 2016).
  3. World Health Organization. Preventing Chronic Diseases: A Vital Investment. 2005. Available online: http://www.who.int/chp/chronic_disease_report/en/ (accessed on 23 April 2015).
  4. Black, J.L.; Billette, J.-M. Do Canadians meet Canada’s Food Guide’s recommendations for fruits and vegetables? Appl. Physiol. Nutr. Metab. 2013, 38, 234–242. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Colley, R.C.; Garriguet, D.; Janssen, I.; Craig, C.L.; Clarke, J.; Tremblay, M.S. Physical activity of Canadian adults: Accelerometer results from the 2007 to 2009 Canadian Health Measures Survey. Health Rep. 2011, 22, 7–14. [Google Scholar] [PubMed]
  6. Statistics Canada. Health Fact Sheets (82-625-X). 2016. Available online: http://www.statcan.gc.ca/pub/82-625-x/2014001/article/14104-eng.htm (accessed on 1 March 2016).
  7. Garriguet, D. Canadians’ eating habits. Health Rep. 2007, 18, 17–32. [Google Scholar] [PubMed]
  8. Colley, R.C.; Garriguet, D.; Janssen, I.; Craig, C.L.; Clarke, J.; Tremblay, M.S. Physical activity of Canadian children and youth: Accelerometer results from the 2007 to 2009 Canadian Health Measures Survey. Health Rep. 2011, 22, 15–23. [Google Scholar]
  9. Bayer, O.; Kruger, H.; von Kries, R.; Toschke, A.M. Factors associated with tracking of BMI: A meta-regression analysis on BMI tracking. Obesity (Silver Spring) 2011, 19, 1069–1076. [Google Scholar] [CrossRef]
  10. Juhola, J.; Magnussen, C.G.; Viikari, J.S.; Kahonen, M.; Hutri-Kahonen, N.; Jula, A.; Lehtimaki, T.; Akerblom, H.K.; Pietikainen, M.; Laitinen, T.; et al. Tracking of serum lipid levels, blood pressure, and body mass index from childhood to adulthood: The Cardiovascular Risk in Young Finns Study. J. Pediatr. 2011, 159, 584–590. [Google Scholar] [CrossRef]
  11. Must, A.; Strauss, R.S. Risks and consequences of childhood and adolescent obesity. Int. J. Obes. Relat. Metab. Disord. 1999, 23, S2–S11. [Google Scholar] [CrossRef]
  12. Craigie, A.M.; Lake, A.A.; Kelly, S.A.; Adamson, A.J.; Mathers, J.C. Tracking of obesity-related behaviours from childhood to adulthood: A systematic review. Maturitas 2011, 70, 266–284. [Google Scholar] [CrossRef] [Green Version]
  13. Fung, C.; Kuhle, S.; Lu, C.; Purcell, M.; Schwartz, M.; Storey, K.; Veugelers, P.J. From “best practice” to “next practice”: The effectiveness of school-based health promotion in improving healthy eating and physical activity and preventing childhood obesity. Int. J. Behav. Nutr. Phys. Act. 2012, 9, 27. [Google Scholar] [CrossRef] [Green Version]
  14. Haby, M.M.; Vos, T.; Carter, R.; Moodie, M.; Markwick, A.; Magnus, A.; Tay-Teo, K.S.; Swinburn, B. A new approach to assessing the health benefit from obesity interventions in children and adolescents: The assessing cost-effectiveness in obesity project. Int. J. Obes. (Lond.) 2006, 30, 1463–1475. [Google Scholar] [CrossRef] [Green Version]
  15. Cecchini, M.; Sassi, F.; Lauer, J.A.; Lee, Y.Y.; Guajardo-Barron, V.; Chisholm, D. Tackling of unhealthy diets, physical inactivity, and obesity: Health effects and cost-effectiveness. Lancet 2010, 376, 1775–1784. [Google Scholar] [CrossRef]
  16. Trueman, P.; Haynes, S.M.; Felicity Lyons, G.; Louise McCombie, E.; McQuigg, M.S.; Mongia, S.; Noble, P.A.; Quinn, M.F.; Ross, H.M.; Thompson, F.; et al. Long-term cost-effectiveness of weight management in primary care. Int. J. Clin. Pract. 2010, 64, 775–783. [Google Scholar] [CrossRef] [PubMed]
  17. Ekwaru, J.P.; Ohinmaa, A.; Tran, B.X.; Setayeshgar, S.; Johnson, J.A.; Veugelers, P.J. Cost-effectiveness of a school-based health promotion program in Canada: A life-course modeling approach. PLoS ONE 2017, 12, e0177848. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Brown, H.S.; Perez, A.; Li, Y.P.; Hoelscher, D.M.; Kelder, S.H.; Rivera, R. The cost-effectiveness of a school-based overweight program. Int. J. Behav. Nutr. Phys. Act. 2007, 4, 47. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Wang, L.Y.; Yang, Q.; Lowry, R.; Wechsler, H. Economic analysis of a school-based obesity prevention program. Obes. Res. 2003, 11, 1313–1324. [Google Scholar] [CrossRef] [PubMed]
  20. Roux, L.; Pratt, M.; Tengs, T.O.; Yore, M.M.; Yanagawa, T.L.; Van Den Bos, J.; Rutt, C.; Brownson, R.C.; Powell, K.E.; Health, G.; et al. Cost effectiveness of community-based physical activity interventions. Am. J. Prev. Med. 2008, 35, 578–588. [Google Scholar] [CrossRef]
  21. Bemelmans, W.; van Baal, P.; Wendel-Vos, W.; Schuit, J.; Feskens, E.; Ament, A.; Hoogenveen, R. The costs, effects and cost-effectiveness of counteracting overweight on a population level. A scientific base for policy targets for the Dutch national plan for action. Prev. Med. 2008, 46, 127–132. [Google Scholar] [CrossRef]
  22. Global Burden of Disease risk factors Collaborators. Global, regional, and national comparative risk assessment of 84 behavioural, environmental and occupational, and metabolic risks or clusters of risks, 1990–2016: A systematic analysis for the Global Burden of Disease Study 2016. Lancet 2017, 390, 1345–4422. [Google Scholar] [CrossRef] [Green Version]
  23. Statistics Canada. Canadian Community Health Survey 2014. Available online: http://www23.statcan.gc.ca/imdb/p2SV.pl?Function=getSurvey&Id=164081 (accessed on 1 March 2016).
  24. Tambay, J.L.; Catlin, G. Sample design of the national population health survey. Health Rep. 1995, 7, 29–38. [Google Scholar]
  25. Westfall, P.; Hoffman, J.J.; Jun, X. Joint Analysis of Multiple Categorical Dependent Variables in Organizational Research. Organ. Res. Methods 2007, 10, 673–688. [Google Scholar] [CrossRef]
  26. Statistics Canada. Table 053-0003—Elements of the Life Table, Canada, Provinces and Territories, Annual (2009/20011), CANSIM (Database). 2015. Available online: http://www5.statcan.gc.ca/cansim/a26?lang=eng&retrLang=eng&id=0530003&&pattern=&stByVal=1&p1=1&p2=1&tabMode=dataTable&csid= (accessed on 17 July 2015).
  27. Preis, S.R.; Hwang, S.J.; Coady, S.; Pencina, M.J.; D’Agostino, R.B.; Savage, P.J.; Levy, D.; Fox, C.S. Trends in all-cause and cardiovascular disease mortality among women and men with and without diabetes mellitus in the Framingham Heart Study, 1950 to 2005. Circulation 2009, 119, 1728–1735. [Google Scholar] [CrossRef] [Green Version]
  28. Robitaille, C.; Dai, S.; Waters, C.; Loukine, L.; Bancej, C.; Quach, S.; Ellison, J.; Campbell, N.; Tu, K.; Reimer, K.; et al. Diagnosed hypertension in Canada: Incidence, prevalence and associated mortality. CMAJ 2012, 184, E49–E56. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Vandentorren, S.; Baldi, I.; Annesi Maesano, I.; Charpin, D.; Neukirch, F.; Filleul, L.; Cantagrel, A.; Tessier, J.F. Long-term mortality among adults with or without asthma in the PAARC study. Eur. Respir. J. 2003, 21, 462–467. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Bronnum-Hansen, H.; Davidsen, M.; Thorvaldsen, P.; Danish, M.S.G. Long-term survival and causes of death after stroke. Stroke 2001, 32, 2131–2136. [Google Scholar] [CrossRef] [PubMed]
  31. Gibertoni, D.; Mandreoli, M.; Rucci, P.; Fantini, M.P.; Rigotti, A.; Scarpioni, R.; Santoro, A. Excess mortality attributable to chronic kidney disease. Results from the PIRP project. J. Nephrol. 2016, 29, 663–671. [Google Scholar] [CrossRef] [PubMed]
  32. Canadian Cancer Society’s Advisory Committee on Cancer Statistics. In Canadian Cancer Statistics 2015; Canadian Cancer Society: Toronto, ON, Canada, 2015.
  33. Nuesch, E.; Dieppe, P.; Reichenbach, S.; Williams, S.; Iff, S.; Juni, P. All cause and disease specific mortality in patients with knee or hip osteoarthritis: Population based cohort study. BMJ 2011, 342, d1165. [Google Scholar] [CrossRef] [Green Version]
  34. Choi, H.K.; Curhan, G. Independent impact of gout on mortality and risk for coronary heart disease. Circulation 2007, 116, 894–900. [Google Scholar] [CrossRef]
  35. Fernandez, M.; Boyle, E.; Hartvigsen, J.; Ferreira, M.L.; Refshauge, K.M.; Maher, C.G.; Christensen, K.; Hopper, J.L.; Ferreira, P.H. Is this back pain killing me? All-cause and cardiovascular-specific mortality in older Danish twins with spinal pain. Eur. J. Pain 2017, 21, 938–948. [Google Scholar] [CrossRef]
  36. Khanna, R.C.; Murthy, G.V.; Giridhar, P.; Krishnaiah, S.; Pant, H.B.; Palamaner Subash Shantha, G.; Charkabati, S.; Gilbert, C.; Rao, G.N. Cataract, visual impairment and long-term mortality in a rural cohort in India: The Andhra Pradesh Eye Disease Study. PLoS ONE 2013, 8, e78002. [Google Scholar] [CrossRef]
  37. Ruhl, C.E.; Everhart, J.E. Gallstone disease is associated with increased mortality in the United States. Gastroenterology 2011, 140, 508–516. [Google Scholar] [CrossRef] [Green Version]
  38. Andersson, T.; Magnuson, A.; Bryngelsson, I.L.; Frobert, O.; Henriksson, K.M.; Edvardsson, N.; Poçi, D. All-cause mortality in 272,186 patients hospitalized with incident atrial fibrillation 1995-2008: A Swedish nationwide long-term case-control study. Eur. Heart J. 2013, 34, 1061–1067. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Ganguli, M.; Dodge, H.H.; Shen, C.; Pandav, R.S.; DeKosky, S.T. Alzheimer disease and mortality: A 15-year epidemiological study. Arch. Neurol. 2005, 62, 779–784. [Google Scholar] [CrossRef] [PubMed]
  40. Statistics Canada. Cancer Survival Statistics 1992 to 2003. Catalogue No. 82-226-X 2012. Available online: https://www150.statcan.gc.ca/n1/en/catalogue/82-226-X2012001 (accessed on 1 March 2016).
  41. Global Burden of Disease Collaborative Network. Global Burden of Disease Study 2016 (GBD 2016) Results Seattle, United States: Institute for Health Metrics and Evaluation (IHME). 2017. Available online: http://ghdx.healthdata.org/gbd-results-tool (accessed on 28 September 2018).
  42. Podgor, M.J.; Leske, M.C. Estimating incidence from age-specific prevalence for irreversible diseases with differential mortality. Stat. Med. 1986, 5, 573–578. [Google Scholar] [CrossRef]
  43. Galantai, A. The theory of Newton’s method. J. Comput. Appl. Math. 2000, 124, 25–44. [Google Scholar] [CrossRef] [Green Version]
  44. Schultz, S.E.; Kopec, J.A. Impact of chronic conditions. Health Rep. 2003, 14, 41–53. [Google Scholar] [PubMed]
  45. Jia, H.; Lubetkin, E.I. The impact of obesity on health-related quality-of-life in the general adult US population. J. Public Health (Oxf.) 2005, 27, 156–164. [Google Scholar] [CrossRef] [Green Version]
  46. Canadian Institute for Health Information. National Health Expenditure Trends, 1975 to 2017: Open Data. 2018. Available online: https://www.cihi.ca/en/national-health-expenditure-trends-1975-to-2017-open-data (accessed on 1 October 2018).
  47. Public Health Agency of Canada. Economic Burden of Illness in Canada (EBIC) Online Tool. Available online: http://ebic-femc.phac-aspc.gc.ca/index.php (accessed on 28 September 2018).
  48. Statistics Canada. Table 17-10-0005-01 Population Estimates on July 1st, by Age and Sex. 2018. Available online: https://www150.statcan.gc.ca/t1/tbl1/en/tv.action?pid=1710000501 (accessed on 28 September 2018).
  49. Weinstein, M.C.; Siegel, J.E.; Gold, M.R.; Kamlet, M.S.; Russell, L.B. Recommendations of the Panel on Cost-effectiveness in Health and Medicine. JAMA 1996, 276, 1253–1258. [Google Scholar] [CrossRef]
  50. Doubilet, P.; Begg, C.B.; Weinstein, M.C.; Braun, P.; McNeil, B.J. Probabilistic sensitivity analysis using Monte Carlo simulation. A practical approach. Med. Decis. Mak. 1985, 5, 157–177. [Google Scholar] [CrossRef]
  51. SAS Institute Inc. Base SAS ® 9.4 Procedures Guide; SAS Institute Inc.: Cary, NC, USA, 2015. [Google Scholar]
  52. TreeAge Software. TreeAge Pro 2020. Williamstown, MA. 2020. Available online: https://www.treeage.com (accessed on 1 January 2020).
  53. Jeon, C.Y.; Lokken, R.P.; Hu, F.B.; van Dam, R.M. Physical activity of moderate intensity and risk of type 2 diabetes: A systematic review. Diabetes Care 2007, 30, 744–752. [Google Scholar] [CrossRef] [Green Version]
  54. Dauchet, L.; Amouyel, P.; Hercberg, S.; Dallongeville, J. Fruit and vegetable consumption and risk of coronary heart disease: A meta-analysis of cohort studies. J. Nutr. 2006, 136, 2588–2593. [Google Scholar] [CrossRef] [Green Version]
  55. Lieffers, J.R.L.; Ekwaru, J.P.; Ohinmaa, A.; Veugelers, P.J. The economic burden of not meeting food recommendations in Canada: The cost of doing nothing. PLoS ONE 2018, 13, e0196333. [Google Scholar] [CrossRef] [PubMed]
  56. Katzmarzyk, P.T.; Janssen, I. The economic costs associated with physical inactivity and obesity in Canada: An update. Can. J. Appl. Physiol. 2004, 29, 90–115. [Google Scholar] [CrossRef] [PubMed]
  57. Hillman, D.; Mitchell, S.; Streatfeild, J.; Burns, C.; Bruck, D.; Pezzullo, L. The economic cost of inadequate sleep. Sleep 2018, 41. [Google Scholar] [CrossRef] [PubMed]
  58. Rittenhouse, B. Uses of Models in Economic Evaluations of Medicines and Other Health Technologies; Office of Health Economics: London, UK, 1996. [Google Scholar]
Table 1. Chronic diseases and linked risk factors (X).
Table 1. Chronic diseases and linked risk factors (X).
Risk Factor
Chronic DiseaseWeight StatusPhysical ActivityFruit ConsumptionVegetable Consumption
DiabetesXXX
Hypertensive heart diseaseX
AsthmaX
Ischemic heart diseaseXXXX
Ischemic strokeXXXX
Hemorrhagic strokeX XX
Chronic kidney diseaseX
LeukemiaX
OsteoarthritisX
GoutX
Low back painX
CataractX
Gallbladder and biliary diseasesX
Atrial fibrillation and flutterX
Alzheimer’s disease and other dementiasX
Breast cancerXX
Colon and rectum cancerXX
Esophageal cancerX X
Gallbladder and biliary tract cancerX
Kidney cancerX
Larynx cancer X
Lip and oral cavity cancer X
Liver cancerX
Multiple myelomaX
Nasopharynx cancer X
Other pharynx cancer X
Non-Hodgkin’s lymphomaX
Ovarian cancerX
Pancreatic cancerX
Thyroid cancerX
Tracheal bronchus and lung cancer X
Uterine cancerX
Table 2. Estimated incremental cost-effectiveness ratio (ICER) for Quality Adjusted Life Years (QALYs) gained, considering effects on all four risk factors compared to the effect on weight status alone.
Table 2. Estimated incremental cost-effectiveness ratio (ICER) for Quality Adjusted Life Years (QALYs) gained, considering effects on all four risk factors compared to the effect on weight status alone.
Program Effect on Considering only Weight StatusConsidering All 4 Risk FactorsRatio (ICER1/ICER2)
Overweight (α1)Obesity (α2)Physical Activity (ψ1)Fruit (λ1)Vegetables (τ1)CostIncremental EffectICER195% CIIncremental EffectICER295% CIRatio95% CI
1.00.71.01.01.099.260.006615,04014,174–15,9190.006615,04014,174–15,9191.0001.000–1.000
1.00.71.01.01.199.260.006615,04014,174–15,9190.006714,91514,054–15,7851.0081.007–1.010
1.00.71.01.11.099.260.006615,04014,174–15,9190.006714,86014,001–15,7261.0121.010–1.015
1.00.71.01.11.199.260.006615,04014,174–15,9190.006714,73813,882–15,6001.0211.017–1.025
1.00.71.11.01.099.260.006615,04014,174–15,9190.006914,48313,655–15,3201.0381.037–1.040
1.00.71.11.01.199.260.006615,04014,174–15,9190.006914,36713,543–15,1921.0471.045–1.050
1.00.71.11.11.099.260.006615,04014,174–15,9190.006914,31613,492–15,1411.0511.048–1.055
1.00.71.11.11.199.260.006615,04014,174–15,9190.007014,20213,386–15,0221.0591.055–1.065
1.00.71.91.91.999.260.006615,04014,174–15,9190.009210,76810,115–11,4001.3971.368–1.434
1.00.71.91.92.099.260.006615,04014,174–15,9190.009310,71910,066–11,3501.4031.374–1.441
1.00.71.92.01.999.260.006615,04014,174–15,9190.009310,71610,059–11,3481.4031.374–1.442
1.00.71.92.02.099.260.006615,04014,174–15,9190.009310,66810,012–11,2981.4101.380–1.450
1.00.72.01.91.999.260.006615,04014,174–15,9190.009310,6329988–11,2551.4151.386–1.453
1.00.72.01.92.099.260.006615,04014,174–15,9190.009410,5859942–11,2061.4211.391–1.460
1.00.72.02.01.999.260.006615,04014,174–15,9190.009410,5829935–11,2041.4211.391–1.461
1.00.72.02.02.099.260.006615,04014,174-15,9190.009410,5359888–11,1561.4281.397–1.468
Note: All estimates are based on a 1.5% discounting rate. α 1 —Odds ratio for overweight. α 2 —Odds ratio for obesity. ψ 1 —Odds ratio for meeting the recommended physical activity level. λ 1 —Odds ratio for meeting the recommended fruit consumption. τ 1 —Odds ratio for meeting the recommended vegetable consumption. CI—Confidence interval.
Table 3. Estimated incremental cost-effectiveness ratio (ICER) for years with chronic disease prevented, considering effects on all four risk factors compared to the effect on weight status alone.
Table 3. Estimated incremental cost-effectiveness ratio (ICER) for years with chronic disease prevented, considering effects on all four risk factors compared to the effect on weight status alone.
Program Effect on Considering only Weight StatusConsidering all 4 Risk FactorsRatio (ICER1/ICER2)
Overweight (α1)Obesity (α2)Physical Activity (ψ1)Fruit (λ1)Vegetables (τ1)CostIncremental EffectICER195% CIIncremental EffectICER295% CIRatio95% CI
1.00.71.01.01.099.26−0.0264237573169–4328−0.0264237573169–43281.0001.000–1.000
1.00.71.01.01.199.26−0.0264237573169–4328−0.0265537383154–43031.0051.004–1.007
1.00.71.01.11.099.26−0.0264237573169–4328−0.0265937333152–42961.0061.005–1.009
1.00.71.01.11.199.26−0.0264237573169–4328−0.0267237143138–42751.0121.009–1.015
1.00.71.11.01.099.26−0.0264237573169–4328−0.0270536703101–42231.0241.021–1.026
1.00.71.11.01.199.26−0.0264237573169–4328−0.0271836523087–42031.0291.025–1.033
1.00.71.11.11.099.26−0.0264237573169–4328−0.0272136473085–41951.0301.026–1.034
1.00.71.11.11.199.26−0.0264237573169–4328−0.0273536293072–41751.0351.030–1.041
1.00.71.91.91.999.26−0.0264237573169–4328−0.0327030352598–34741.2381.200–1.275
1.00.71.91.92.099.26−0.0264237573169–4328−0.0328030262590–34611.2421.203–1.280
1.00.71.92.01.999.26−0.0264237573169–4328−0.0328030272591–34631.2411.203–1.280
1.00.71.92.02.099.26−0.0264237573169–4328−0.0329030172583–34511.2451.206–1.284
1.00.72.01.91.999.26−0.0264237573169–4328−0.0330030082576–34401.2491.210–1.287
1.00.72.01.92.099.26−0.0264237573169–4328−0.0331029992569–34291.2531.213–1.292
1.00.72.02.01.999.26−0.0264237573169–4328−0.0330930002569–34301.2531.212–1.292
1.00.72.02.02.099.26−0.0264237573169–4328−0.0331929902562–34191.2561.215–1.297
Note: All estimates are based on a 1.5% discounting rate. α 1 —Odds ratio for overweight. α 2 —Odds ratio for obesity. ψ 1 —Odds ratio for meeting the recommended physical activity level. λ 1 —Odds ratio for meeting the recommended fruit consumption. τ 1 —Odds ratio for meeting the recommended vegetable consumption.
Table 4. Estimated return on investment, considering effects on all four risk factors compared to weight status alone.
Table 4. Estimated return on investment, considering effects on all four risk factors compared to weight status alone.
Program Effect on Considering only Weight StatusConsidering All 4 Risk FactorsRatio (ROI1/ROI2)
Overweight (α1)Obesity (α2)Physical Activity (ψ1)Fruit (λ1)Vegetables (τ1)CostCost Savings †ROI1 (%)95% CICost Savings †ROI2 (%)95% CIRatio95% CI
1.00.71.01.01.099.26321.615324%281–384%321.615324%281–384%1.0001.000–1.000
1.00.71.01.01.199.26321.615324%281–384%323.273326%283–386%0.9950.993–0.996
1.00.71.01.11.099.26321.615324%281–384%323.668326%283–386%0.9940.991–0.995
1.00.71.01.11.199.26321.615324%281–384%325.326328%285–388%0.9890.985–0.991
1.00.71.11.01.099.26321.615324%281–384%329.250332%288–393%0.9770.974–0.980
1.00.71.11.01.199.26321.615324%281–384%330.911333%290–394%0.9720.968–0.976
1.00.71.11.11.099.26321.615324%281–384%331.304334%290–395%0.9710.967–0.975
1.00.71.11.11.199.26321.615324%281–384%332.965335%292–396%0.9660.961–0.971
1.00.71.91.91.999.26321.615324%281–384%398.108401%350–469%0.8080.784–0.833
1.00.71.91.92.099.26321.615324%281–384%399.362402%352–470%0.8050.781–0.831
1.00.71.92.01.999.26321.615324%281–384%399.254402%352–470%0.8060.781–0.832
1.00.71.92.02.099.26321.615324%281–384%400.510403%353–471%0.8030.779–0.829
1.00.72.01.91.999.26321.615324%281–384%401.698405%354–473%0.8010.777–0.827
1.00.72.01.92.099.26321.615324%281–384%402.954406%355–474%0.7980.774–0.825
1.00.72.02.01.999.26321.615324%281–384%402.845406%355–474%0.7980.774–0.825
1.00.72.02.02.099.26321.615324%281–384%404.101407%356–475%0.7960.771–0.823
Note: All estimates are based on a 1.5% discounting rate. †—Based on $12,174 as annual health care costs attributable to chronic disease (Table S6). α 1 —Odds ratio for overweight. α 2 —Odds ratio for obesity. ψ 1 —Odds ratio for meeting the recommended physical activity level. λ 1 —Odds ratio for meeting the recommended fruit consumption. τ 1 —Odds ratio for meeting the recommended vegetable consumption. ROI—Return on investment.

Share and Cite

MDPI and ACS Style

Ekwaru, J.P.; Ohinmaa, A.; Veugelers, P.J. An Enhanced Approach for Economic Evaluation of Long-Term Benefits of School-Based Health Promotion Programs. Nutrients 2020, 12, 1101. https://doi.org/10.3390/nu12041101

AMA Style

Ekwaru JP, Ohinmaa A, Veugelers PJ. An Enhanced Approach for Economic Evaluation of Long-Term Benefits of School-Based Health Promotion Programs. Nutrients. 2020; 12(4):1101. https://doi.org/10.3390/nu12041101

Chicago/Turabian Style

Ekwaru, John Paul, Arto Ohinmaa, and Paul J. Veugelers. 2020. "An Enhanced Approach for Economic Evaluation of Long-Term Benefits of School-Based Health Promotion Programs" Nutrients 12, no. 4: 1101. https://doi.org/10.3390/nu12041101

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop