Abstract
Our objective in this comment is to highlight several limitations in an ecological research study that was published in Nutrients by Murphy and Westmark (2020) in January 2020. The study used data from the Food Fortification Initiative (FFI) website, and applying an ecological study design, made an error of “ecologic fallacy” in concluding that “national fortification with folic acid is not associated with a significant decrease in the prevalence of neural tube defects (NTDs) at the population level”. We list study limitations that led to their erroneous conclusions, stemming from incorrect considerations regarding NTD prevalence, the average grain availability for a country, the fortification coverage in a country, the population reach of fortified foods within a country, and the absence of the consideration of fortification type (voluntary vs. mandatory), country-specific policies on elective terminations for NTD-affected pregnancies, stillbirth proportions among those with NTDs, and fortification implementation. FFI data are derived from many sources and intended for fortification advocacy, not for hypothesis testing. The flawed study by Murphy & Westmark (2020) in Nutrients promotes a confusing and incorrect message to stakeholders, misguides policy makers, and hinders progress in global NTD prevention through a cost-effective, safe, and effective intervention: the mandatory large-scale folic acid fortification of staple foods.
Murphy & Westmark (2020) [1], published in Nutrients in January this year, using data from the Food Fortification Initiative (FFI) website (www.ffinetwork.org) and an ecological study design, have made an error in their study conclusion. Their study conclusion contradicts several systematic reviews and meta-analyses published earlier [2,3,4,5]. Ecologic fallacy is an inherent error in ecological study designs that lack individual-level data and rely on aggregate information pooled nationally or sub-nationally, collected by non-standardized sources.
We list below major limitations in Murphy & Westmark’s study that have led to their erroneous conclusion:
- The modeled prevalence estimates for neural tube defects (NTDs) [6] used in their analysis have inherent biases and limitations, and they underestimate the true prevalence of NTDs for many developing countries that lack birth defect surveillance. They are mainly intended to provide policy makers with a crude burden of NTDs and not for scientific hypothesis-oriented research.
- The FFI’s individual country profiles that contain grain fortification-related information are intended for stakeholders in the flour and rice milling industry, and organizations and policy-makers invested in grain fortification. Their variable “Folic acid fortification measured in ppm” is an incomplete measure of fortification reach and impact. The average fortification levels are meaningless without integrating data regarding the average grain availability for a country [7]. A low fortification level in a country with high grain availability would have a very different fortification impact compared to a low fortification level in a country with low grain availability.
- Fortification compliance in a country was not considered, which is available online at https://fortificationdata.org/map-proportion-of-food-vehicle-that-is-fortified/. Several countries have a mandatory fortification policy, but where less than 100% of the food is fortified.
- The population reach of fortified foods, which indicates the actual consumption of fortified foods, was not considered. Analyzing the population average fortification levels (ppm), without considering the reach and coverage of the fortified product [7], masks the differences found between consumers and non-consumers.
- Other review studies [3,5] showing the effectiveness of fortification on NTD prevention were not cited.
- Several supporting factors, including fortification type (voluntary vs. mandatory), country-specific policies on elective terminations for NTD-affected pregnancies, stillbirth proportions among those with NTDs, and fortification implementation were not considered.
According to the Centers for Evidence-Based Medicine, in the hierarchy of scientific evidence, evidence generated by ecological studies provides the lowest level of significance in establishing causality [8]. The FFI data are derived from many sources and intended for fortification advocacy, not for hypothesis testing. The flawed study by Murphy & Westmark (2020) in Nutrients promotes a confusing and incorrect message to stakeholders, misguides policy makers, and hinders progress in global NTD prevention through a cost-effective [9], safe [10] and effective [2,3,4,5] intervention: the mandatory large-scale folic acid fortification of staple foods.
Author Contributions
All authors contributed equally to this work. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Murphy, M.E.; Westmark, C.J. Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247. [Google Scholar] [CrossRef] [PubMed]
- Castillo-Lancellotti, C.; Tur, J.A.; Uauy, R. Impact of folic acid fortification of flour on neural tube defects: A systematic review. Public Health Nutr. 2013, 16, 901–911. [Google Scholar] [CrossRef] [PubMed]
- Rosenthal, J.; Casas, J.; Taren, D.; Alverson, C.J.; Flores, A.; Frias, J. Neural tube defects in Latin America and the impact of fortification: A literature review. Public Health Nutr. 2014, 17, 537–550. [Google Scholar] [CrossRef] [PubMed]
- Atta, C.A.; Fiest, K.M.; Frolkis, A.D.; Jette, N.; Pringsheim, T.; St Germaine-Smith, C.; Rajapakse, T.; Kaplan, G.G.; Metcalfe, A. Global Birth Prevalence of Spina Bifida by Folic Acid Fortification Status: A Systematic Review and Meta-Analysis. Am. J. Public Health 2016, 106, e24–e34. [Google Scholar] [CrossRef] [PubMed]
- Keats, E.C.; Neufeld, L.M.; Garrett, G.S.; Mbuya, M.N.N.; Bhutta, Z.A. Improved micronutrient status and health outcomes in low- and middle-income countries following large-scale fortification: Evidence from a systematic review and meta-analysis. Am. J. Clin. Nutr. 2019, 109, 1696–1708. [Google Scholar] [CrossRef] [PubMed]
- Blencowe, H.; Kancherla, V.; Moorthie, S.; Darlison, M.W.; Modell, B. Estimates of global and regional prevalence of neural tube defects for 2015: A systematic analysis. Ann. N. Y. Acad. Sci. 2018, 1414, 31–46. [Google Scholar] [CrossRef]
- Kancherla, V.; Wagh, K.; Johnson, Q.; Oakley, G.P., Jr. A 2017 global update on folic acid-preventable spina bifida and anencephaly. Birth Defects Res. 2018, 110, 1139–1147. [Google Scholar] [CrossRef] [PubMed]
- Burns, P.B.; Rohrich, R.J.; Chung, K.C. The Levels of Evidence and their role in Evidence-Based Medicine. Plast. Reconstr. Surg. 2011, 128, 305–310. [Google Scholar] [CrossRef] [PubMed]
- Hoddinott, J. The investment case for folic acid fortification in developing countries. Ann. N. Y. Acad. Sci. 2018, 1414, 72–81. [Google Scholar] [CrossRef] [PubMed]
- Field, M.S.; Stover, P.J. Safety of folic acid. Ann. N. Y. Acad. Sci. 2018, 1414, 59–71. [Google Scholar] [CrossRef] [PubMed]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).