Open Access This article is
- freely available
Nutrients 2019, 11(5), 1138; https://doi.org/10.3390/nu11051138
Reply to “Comment on Comprehensive Nutritional and Dietary Intervention for Autism Spectrum Disorder—A Randomized, Controlled 12-Month Trial, Nutrients 2018, 10, 369”
School for Engineering of Matter, Transport & Energy, Arizona State University, Tempe, AZ 85287, USA
Health Diagnostics, South Amboy, NJ 08879, USA
Southwest College of Naturopathic Medicine, Tempe, AZ 85282, USA
Arizona Allergy Associates, Phoenix, AZ 85004, USA
Dana Laake Nutrition, Kensington, MD 20895, USA
Nourishing Hope, San Francisco, CA 94117, USA
The Mitochondrial and Metabolic Disease Center, University of California, San Diego, CA 92093, USA
Doctor’s Data, St. Charles, IL 60174, USA
Author to whom correspondence should be addressed.
Received: 16 May 2019 / Accepted: 16 May 2019 / Published: 22 May 2019
We thank Vorland et al.  for their interest in our research and their critique of our paper . Here are our responses to the specific points that they raised.
We confirm that we previously responded to their inquiries about our study.
First (regarding randomization): We confirm that the participants were enrolled on a rolling basis, matched with participants of similar ages and a similar level of behavioral/Applied Behavioral Analysis (ABA) therapy, and then randomly assigned to one of the two groups. ABA is an important therapy, and we hypothesized that it might affect outcomes in our 12-month study, which is why we attempted to include it as part of the randomization procedure.
Second (regarding siblings): We confirm that siblings were randomized together. The reason is that this was a single-blind study, so the participants knew if they were taking supplements or improving their diet. We felt that it would place an undue burden on the family to provide a different diet and supplements to each sibling, compromising study compliance.
Third (regarding block randomization): There were three sibling pairs who completed the treatment arm, and two sibling pairs who completed the non-treatment arm, out of a total of 28 participants in the treatment arm and 27 participants in the non-treatment arm. Thus, only 21% and 15% of the participants were siblings, respectively.
We investigated whether removing all siblings affected our results, focusing on the Childhood Autism Rating Scale (CARS) test as a typical and important test. We used the Anderson–Darling test to determine if the treatment groups (with or without siblings) and the non-treatment group (with or without siblings) involved normal distributions, and confirmed that all were drawn from normal distributions (see Table 1). Next, we used the F test to determine if the samples with siblings had equal variance (they did) and if the samples without siblings had equal variance (they did). This means that the assumptions required to apply a t-test were met and the analysis was reasonable for the study design.
Next, we used a one-sided t-test to determine if the treatment group improved more than the non-treatment group. The p-value for the comparison with siblings was 0.033, and the p-value for the comparison without siblings was 0.025. So, the treatment group improved more than the non-treatment group, regardless of whether or not siblings were included.
Registration on clinicaltrials.gov: there was an unfortunate delay in completing the submission to clinicaltrials.gov, and the dates are stated in the original paper.
One-tailed and two-tailed tests: For behavioral tests, our hypothesis was that there was an improvement in ASD-related symptoms, so a one-tailed test was appropriate. For laboratory tests, we instead used two-tailed tests because we did not always have a hypothesis as to which way biomarkers would change.
Additional analyses: Vorland et al. suggest some interesting additional analyses and sub-analyses that could be conducted, but our sample size is too small, so those analyses would be under-powered. Those suggestions can be considered in future studies.
In closing, we thank Vorland et al. for their comments and the opportunity to provide more detail on our study.
The authors thank Uwe Kruge of Rensselaer Polytechnic Institute for conducting the statistical analysis described in this letter.
Conflicts of Interest
J.B.A. is the president of the Autism Nutrition Research Center (ANRC), a non-profit which provides information to autism families and which produces an improved version of the vitamin/mineral supplement used in this study. He serves as an unpaid volunteer, and does not receive any royalties from the sale of the vitamin/mineral supplement. T.A. consults for Health Diagnostics, a commercial testing lab. D.W.Q. works at Doctor’s Data, a commercial testing lab. The other authors do not have any competing interests.
- Vorland, C.J.; Brown, A.W.; Dickinson, S.L.; Gelman, A.; Allison, D.B. The Implementation of Randomization Requires Corrected Analyses. Comment on “Comprehensive Nutritional and Dietary Intervention for Autism Spectrum Disorder—A Randomized, Controlled 12-Month Trial, Nutrients 2018, 10, 369”. Nutrients 2019, 11, 1126. [Google Scholar] [CrossRef]
- Adams, J.B.; Audhya, T.; Geis, E.; Gehn, E.; Fimbres, V.; Pollard, E.L.; Mitchell, J.; Ingram, J.; Hellmers, R.; Laake, D.; et al. Comprehensive Nutritional and Dietary Intervention for Autism Spectrum Disorder—A Randomized, Controlled 12-Month Trial. Nutrients 2018, 10, 369. [Google Scholar] [CrossRef] [PubMed]
Table 1. Summary of Anderson–Darling test for normality, F test for equal variance, and t-test for equal variance.
|Siblings Included||Anderson–Darling Test for Normality||Equal Variance (F test)|
t-test for equal variance: (accept)
|Siblings Excluded||Anderson-Darling Test for Normality||Equal Variance (F test)|
t-test for equal variance: (accept)
© 2019 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).