Next Article in Journal
Modifiable Risk Factors for Cardiovascular Disease among Women with and without a History of Hypertensive Disorders of Pregnancy
Next Article in Special Issue
Carotenoid Markers of Dietary Exposure and Nutritional Status
Previous Article in Journal
Development and Implementation of a Nutritional Education Program Aimed at Improving the Integration Process of Young Orphan Refugees Newly Arrived in Portugal
Previous Article in Special Issue
Status and Dietary Intake of Phytoene and Phytofluene in Spanish Adults and the Effect of a Four-Week Dietary Intervention with Lutein-Rich Fruits or Vegetables
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of Diet ID™ in Predicting Nutrient Intake Compared to Dietary Recalls, Skin Carotenoid Scores, and Plasma Carotenoids in University Students

by
Marcela D. Radtke
1,2,
Gwen M. Chodur
1,3,
Michael C. S. Bissell
4,
Leslie C. Kemp
3,
Valentina Medici
5,
Francene M. Steinberg
1 and
Rachel E. Scherr
1,2,*,†,‡
1
Department of Nutrition, University of California, Davis, CA 95616, USA
2
Center for Nutrition in Schools, University of California, Davis, CA 95616, USA
3
Aggie Compass, Office of Student Affairs, University of California, Davis, CA 95616, USA
4
Division of Biostatistics, Department of Public Health Sciences, University of California Davis School of Medicine, Davis, CA 95616, USA
5
Department of Internal Medicine, Division of Gastroenterology and Hepatology, University of California, Davis, CA 95616, USA
*
Author to whom correspondence should be addressed.
At the time the research was conducted: 3149 Meyer Hall, One Shields Drive, Davis, CA 95616, USA; 530-752-3817.
Current Affiliation: Family, Interiors, Nutrition & Apparel Department, San Francisco State University, 1600 Holloway Avenue, San Francisco, CA 94132, USA.
Nutrients 2023, 15(2), 409; https://doi.org/10.3390/nu15020409
Submission received: 9 December 2022 / Revised: 5 January 2023 / Accepted: 11 January 2023 / Published: 13 January 2023
(This article belongs to the Special Issue Carotenoid Biomarkers of Dietary Exposure and Nutritional Status)

Abstract

:
Background and Aim: Collecting accurate dietary information in the research setting is challenging due to the inherent biases, duration, and resource-intensive nature of traditional data collection methods. Diet ID™ is a novel, rapid assessment method that uses an image-based algorithm to identify dietary patterns and estimate nutrient intake. The purpose of this analysis was to explore the criterion validity between Diet ID™ and additional measures of dietary intake. Methods: This prospective cohort study (n = 42) collected dietary information using Diet ID™, the Nutrition Data System for Research (NDSR), plasma carotenoid concentrations, and the Veggie Meter® to estimate carotenoid levels in the skin. Results: There were significant correlations between Diet ID™ and NDSR for diet quality, calories, carbohydrates, protein, fiber, and cholesterol. Vitamin A and carotenoid intake were significantly correlated, with the exception of α-carotene and lycopene. Significant correlations were observed for calcium, folate, iron, sodium, potassium, Vitamins B2, B3, B6, C, and E. Skin carotenoid scores and plasma carotenoids were correlated with carotenoid intake from Diet ID™. Conclusions: Diet ID™ may be a useful tool in nutrition research as a less time-intensive and minimally burdensome dietary data collection method for both participants and researchers.

1. Introduction

Collecting accurate information on dietary intake is an essential component of understanding the physiological relationship between food and health [1,2]. In particular, the habitual consumption of fruits and vegetables is associated with improved biomarkers for health and the reduction of chronic disease risk across the lifespan due to the vitamins, minerals, phytonutrients, fiber, and other bioactive compounds [3,4]. Commonly used measures of fruit and vegetable intake include 24 h dietary recalls, food frequency questionnaires (FFQs), and food records [5,6]. These subjective assessment tools often introduce unintended reporting errors or response biases that may impact the accuracy of dietary data [7]. Objective measures may also be implemented to determine nutrient consumption, such as blood or urinary biomarkers, and tissue or dermal biopsies [6]. However, such assessments are inherently resource-intensive and subject to participant and researcher burden [8]. Therefore, innovative techniques for rigorously assessing dietary intake, emphasizing fruit and vegetable consumption, are warranted in the research setting [9].
Carotenoids are a class of phytochemicals found in many fruits and vegetables and therefore are a useful marker for dietary assessment. Carotenoids are fat-soluble compounds that are transported in lipoproteins, making them detectable and quantifiable in the blood and skin [10]. In addition to identifying dietary carotenoids through traditional dietary assessments, carotenoid levels may also be identified through innovative techniques, such as spectroscopy-based skin carotenoid measurements and technology-based or image-based dietary assessment methods [11,12,13]. The Veggie Meter® is a device that utilizes pressure-mediated reflection spectroscopy to quantify the density of carotenoids in the skin [14]. Skin carotenoid scores (SCS) are reflective of long-term dietary changes, approximately one month of intake, due to the longer half-life and slower degradation of carotenoids in the skin compared to plasma or serum, which is evident of approximately two weeks of dietary intake [15,16]. Technology-based or image-based dietary assessment methods may have the capacity to evaluate both short- and long-term dietary intake of carotenoid compounds.
Photo navigation technology is an emerging approach used to estimate dietary patterns and nutrient intake in the research setting. The transition from static images of dietary intake using cameras or handheld devices to dynamic, real-time image-assisted or image-based dietary technologies provides additional improvements for mitigating common errors and biases in traditional dietary assessments [17]. Validation studies comparing image-based technologies to other forms of dietary assessments, including 24 h dietary recalls, weighed food records, and double-labeled water, found inconsistencies between the methods of reporting dietary intake, further highlighting the need for the development of more accurate and reliable image-based dietary assessment tools [18]. In addition to the limited number of validated image-based dietary assessment techniques, most studies have yet to include micronutrients, phytonutrients, or other bioactive compounds, making it challenging to definitively quantify the prominent components of fruit and vegetable intake using such methods [18].
Diet ID™ is a novel application that assesses dietary patterns through Diet Quality Photo Navigation (DQPN®), a patented image-based algorithm that provides estimates of nutrient intake, based on a series of food images [19,20]. Diet ID™ was developed using dietary data extracted from the National Health and Nutrition Examination Survey (NHANES), as well as a comprehensive review of food intake surveys and epidemiological research to determine estimates of dietary patterns, portion sizes, and eating frequencies of adults in the United States (US) [19,20]. Diet ID™ provides nutrient estimations for energy intake, macronutrients, and micronutrients, including phytonutrients and other bioactive compounds, such as carotenoids based on the NDSR food database. Diet ID™ not only estimates total carotenoid intake but quantifies the nutrient output for the following carotenoid compounds: α-carotene, β-carotene, lycopene, lutein, and zeaxanthin. Research exploring the relationship between individual carotenoid compounds and total carotenoid intake estimated by Diet ID™ with other measures of fruit and vegetable intake has yet to be conducted.
The present analysis aimed to explore the criterion validity of Diet ID™ against other methods of dietary assessments, including plasma carotenoid concentrations, skin carotenoid scores, and 24 h dietary recalls in a population of university students. This validation study was derived from a larger study that seeks to investigate various biomarkers found in blood and skin, and to measure dietary intake through repeated 24 h NDSR recalls and Diet ID™ to determine if food access programs at the University of California, Davis improve biomarkers for health and fruit and vegetable consumption among students who use these services.

2. Materials and Methods

The protocol and procedures for this study were approved by the University of California, Davis Institutional Review Board. Participants provided informed written consent prior to study commencement (1476178-4).

2.1. Study Design

A prospective cohort (n = 42) consisting of college students from the University of California, Davis was recruited in January 2020 to participate in an effectiveness evaluation of campus food access programs. The study timeline was selected to minimize excessive sun exposure, reduce the variation from seasonal, high carotenoid-containing foods, such as squash, tomatoes, and berries [21,22], and for winter break to serve as a washout period for students who had used campus food access programs prior to enrolling in the study. The study duration was conducted in accordance with the 10-week academic quarter (January–March 2020), with the first data collection period occurring during weeks 1–3 and the second data collection period occurring in weeks 8–10 of the term. Specific to the larger evaluation study, an eight-week duration between timepoints was allotted to ensure biomarkers of interest had an adequate acclimation period to respond to changes in dietary intake.
Participants were recruited prospectively through fliers, social media, and other means of communication, such as verbal or email contact. Participants were healthy, biological males and females above the age of 18 currently enrolled as undergraduate or graduate students at the University of California, Davis, and within a BMI range of 18.5–34.9 kg/m2 [23,24]. Exclusion criteria included smoking or living in a household with an indoor smoker (including cigarettes, electronic cigarettes, vaping, marijuana), consuming edible products containing tetrahydrocannabinol (THC), the psychoactive component in marijuana, and excessive drinking (consuming >5 alcoholic drinks per week), as the metabolism and absorption of carotenoid compounds under these conditions is unknown [10]. Additionally, individuals participating in artificial tanning methods, such as UV light exposure, or consuming oral or topical high-dose Vitamin A medication (i.e., Accutane, retinol cream) were ineligible to participate due to the potential for elevated carotenoid detection in the blood or skin from non-dietary sources [25]. Prospective study subjects completed a short screening by telephone and those who met the inclusion criteria were invited to schedule an in-person study visit. Study visits were conducted at the Ragle Human Nutrition Research Center at the University of California, Davis.

2.2. Anthropometric Data

Anthropometric data were collected at each timepoint to capture any changes during the study period. Height and weight were measured twice to ensure values were within 0.3 cm and 0.1 kg, respectively, and the mean value was reported. Height was measured using a stadiometer and weight was measured using a digital scale; subsequently, BMI was calculated as weight in kilograms divided by height in meters squared (kg/m2). Blood pressure was measured twice with a sphygmomanometer for an average reading, to ensure participants were normotensive.

2.3. Sociodemographic Data

Sociodemographic information including age, sex, race/ethnicity, food security status, and physical activity was acquired for inclusion as potential covariates. Participants self-reported use of food access resources. Food security status was measured at both study timepoints using the United States Department of Agriculture (USDA) 10-item Adult Food Security Survey Module [26]. The following classifications were used in accordance with the USDA to indicate food security status over the last 30 days: 0: high food security; 1–2: marginal food security; 3–5: low food security; and 6–10: very low food security [27].

2.4. Dietary Intake Data

2.4.1. Diet ID™

Participants completed the Diet ID™ assessment in person at each clinic visit. As the application is designed to measure habitual dietary patterns over the last 30 days of intake, only one assessment per timepoint was required. Participants received detailed instructions provided by the manufacturer for standardization among users.
Diet ID™ initially provided a set of screening questions to identify select food group consumption, such as a vegan, vegetarian, gluten-free, or alcohol-free dietary patterns. The application then displayed two images containing a variety of food items to identify the general types of foods that may be consumed. As the users selected the food items most similar to those they consume regularly, the algorithm provided more specific images by incorporating varying types of the same foods, such as low-fat versus full-fat dairy products, and asked individuals to choose the food images that may be present in their eating pattern on a day-to-day basis. Once the application identified an individual’s typical eating pattern, foods from the final image were quantified for nutrient analysis by the Diet ID™ algorithm in accordance with the Nutrition Data System for Research (NDSR) database (Version 2017). In addition to specific nutrient output, diet quality was computed by Diet ID™ software using criteria from the Healthy Eating Index 2015 (HEI-2015) [28]. When participants completed multiple Diet ID™ assessments at the same study visit, the nutrient values from first assessment were used.

2.4.2. NDSR 24 h Dietary Recalls

Three 24 h dietary recalls using NDSR Software (Version 2019) were conducted by phone within one week of each in-person clinic visit, for a total of six recalls per participant. Each recall (n = 252) was unannounced and consisted of two non-consecutive weekdays (n = 180) and one weekend day (n = 72), when possible, to capture potential variations in dietary intake and to minimize observer bias. Participants who did not respond to researcher inquiries over the weekend had all recalls recorded on weekdays to ensure three days of intake were collected within a week of the in-person clinic visit. Dietary recalls were conducted by trained researchers under the guidance of a registered dietitian. Participants were asked to report all intake starting from midnight the previous day, inclusive of food, beverages, and supplements. As quality control, the supervising registered dietitian compared the intake as entered in the initial “Quick List” to the “Food Record.” Due to the racial and ethnic diversity of the sample population, some of the culturally diverse foods consumed were not matched to records in the NDSR database. Missing food items were reviewed independently by two researchers for consistency with other records in the database. Examples of food classified as “missing” from the NDSR database included boba or bubble tea, international snacks (i.e., shrimp chips, fish jerky) and brand-specific items (i.e., Kirkland protein bars, Dave’s Killer Bread). Food labels were reviewed for nutrient analysis if no best fit in the NDSR system was identified. Diet quality, measured using the HEI-2015, was calculated based on the nine components of nutrient adequacy and the four components of nutrient moderation from the foods consumed in the NDSR dietary recalls [29]. Total carotenoids were calculated through summation of individual carotenoid output from NDSR in micrograms (mcg).

2.5. Skin Carotenoid Scores

Skin carotenoid scores were measured using the Veggie Meter®. The Veggie Meter® is a validated, research-grade instrument that utilizes pressure-mediated reflection spectroscopy to estimate carotenoid concentration in the skin [11]. The protocol for collecting data using the Veggie Meter®, including triplicate measures and the use of the non-dominant ring finger, was followed to ensure that inter- and intra-individual variability, as well as environmental interferences, were minimized [30].

2.6. Plasma Carotenoids

Participants were asked to abstain from food and beverages, excluding water, for a minimum of 10 h prior to the study visit. Blood samples were collected through venipuncture by a trained phlebotomist at the Ragle Human Nutrition Research Center using EDTA vacutainer blood collection tubes. Whole blood was centrifuged at 1500 rpm for 15 min at 4 °C and the plasma was extracted, aliquoted, and stored at −80 °C prior to carotenoid analysis performed by Eurofins Craft Technologies.
Individual carotenoids were measured by HPLC in plasma using a modification of the procedures described by Craft [31,32]. Briefly, after thawing, 150 μL aliquots of plasma were diluted with 150 μL of water containing 0.01% ascorbic acid and 0.001% EDTA then deproteinated by vortexing with 300 μL of ethanol containing tocol as an internal standard and butylated hydroxytoluene (250 ppm) as an antioxidant. The samples were extracted by vortex mixing for 2 min with 2 mL of hexane. Samples were centrifuged to separate phases and the upper hexane was transferred to a borosilicate tube. The extraction was repeated. The combined supernatant was evaporated using a centrifugal evaporator. The residue was dissolved with vortex mixing in 30 μL of ethyl acetate then diluted with 100 μL of acetonitrile:isopropanol (9:1) and vortex mixed 15 s prior to placement in the autosampler. A 20 μL volume was injected.
The HPLC system consisted of a Chromeleon data system, a solvent degasser, an autosampler maintaining samples at 20 °C, a Polaris C18 Ether (3 μm, 4.0 mm × 250 mm), a guard column containing similar stationary phase, a column heater at 31 °C, a diode array detector to measure carotenoids at 450 nm, 325 nm, and at 295 nm to measure tocol. The separation was performed isocratically using a mobile phase of 83% acetonitrile/13% dioxane/4% methanol containing 150 mM ammonium acetate and 0.1% triethylamine at a flow rate of 1.0 mL for 21 min. The method is calibrated with neat standards within the physiological range which are assigned concentrations using absorption coefficients (E1% cm) and corrected for HPLC purity [33]. The calibration method is based on external standards using peak areas and corrected for tocol as the internal standard.

2.7. Statistical Analysis

Data were inspected for normality using Shapiro–Wilk test and transformed as necessary. Descriptive data on participant characteristics are expressed as mean ± SD or percentage. Nutrient analysis from each set of three 24 h NDSR dietary recalls were averaged for a single mean output. Healthy Eating Index 2015 scores were computed from NDSR output using SAS code provided by the NDSR manufacturers. The SAS version 9.4 statistical software was used (SAS Institute Inc.) [34]. Paired t-tests were used to determine if dietary intake was independent at each of the timepoints. Considering dietary intake was not independent by timepoint, data from both study timepoints were averaged to determine the relationship between Diet ID™ and NDSR 24 h dietary recalls. Pearson’s correlations were computed to explore associations between the nutrients estimated by the dietary assessment instruments. Kendall’s tau was computed for variables with a non-linear relationship (HEI-2015) and those with distributions that did not conform to normality after transformation (cholesterol, Vitamin B12, α-carotene, β-carotene, and lycopene). Bland–Altman Plot Analysis was also performed to characterize the agreement between Diet ID™ and NDSR [35]. Nutrients of interest for this analysis were selected based on existing literature from dietary intake studies with the objective of comparing nutrient consumption to other biomarkers of dietary intake [36,37,38,39]. Also included were nutrients of concern for underconsumption (calcium, potassium, fiber, and vitamin D) as defined by the 2020–2025 USDA Dietary Guidelines for Americans [40]. Linear regression models were used to estimate the association between Diet ID™, skin carotenoid scores, and plasma carotenoids controlling for BMI, as previous research has demonstrated inverse correlations between BMI and carotenoid concentrations [41,42,43]. The vce(robust) command was used to obtain the robust estimator of variance in linear regression models that did not conform to assumptions of homoscedasticity. Statistical significance was established at p < 0.05. All other statistical analyses were performed using STATA Version 16 [44].
As this criterion-related validation study is a subset from a larger study, the sample size was initially computed a priori with the primary objective of comparing plasma carotenoids to skin carotenoid scores [12]. A post-hoc analysis for a minimal detectable difference was calculated to determine the number of participants needed to compare Diet ID™ against 24 h NDSR dietary recalls based on α = 0.05 and 80% power, in which a minimum of 30 participants were required [36]. As Diet ID™ is a novel assessment tool, additional studies comparing NDSR with other innovative dietary assessment methods were used as comparisons to determine the minimal detectable difference, confirming that the number of participants in this analysis surpasses the number of participants in previous studies that were sufficiently powered [45,46].

3. Results

3.1. Participant Characteristics

A total of 48 participants completed the baseline visit of the study, with six participants unable or unwilling to complete the second timepoint; therefore, 42 participants completed timepoint two and are included in the present analysis. Baseline characteristics of the study population are presented in Table 1. The cohort was 75% female, with a mean age of 22.09 ± 2.36 years and BMI of 24.58 ± 5.04 kg/m2. Of the total participants, 40% were categorized as having high food security, 31% had marginal food security, 17% had low food security, and 12% had very low food security. Results from a paired t-test found no significant changes in skin carotenoid scores from timepoint one to timepoint two, with average scores of 322.98 ± 114.42 and 341.35 ± 113.98, respectively (p = 0.38). Participants completed Diet ID™ in 3.68 ± 2.04 min.

3.2. Diet ID™ and 24 h NDSR Dietary Recalls

The average nutrient intakes from three 24 h NDSR recalls were significantly correlated with the findings from Diet ID™ for nearly all nutrients evaluated (Table 2). Diet quality was assessed in accordance with HEI-2015, using the nutrient criteria for adequacy and moderation from both dietary intake assessment methods. A significant correlation was observed for diet quality using HEI-2015 as estimated by 24 h NDSR dietary recalls and Diet ID™ (τ = 0.55, p < 0.0001). Total calories (kcals), protein intake, and carbohydrate intake were significantly correlated between the two instruments (ρ = 0.36, p = 0.02; ρ = 0.55, p = 0.002; ρ = 0.31, p = 0.05 respectively); however, there was not a significant correlation between the two instruments’ measurement of fat intake. To further explore the relationship between different nutrient subtypes for carbohydrates and fat intake as estimated by Diet ID™ and 24 h NDSR dietary recalls, dietary fiber and cholesterol were independently assessed. Significant associations were observed in measurements of dietary fiber (ρ = 0.64, p < 0.0001, as well as cholesterol (τ = 0.32, p = 0.003).
Of specific interest to the study was the consumption of Vitamin A, carotenoids, and carotenoid derivatives. There was a significant correlation of both Vitamin A (ρ = 0.39, p = 0.01) and total dietary carotenoid intake (ρ = 0.44, p = 0.003) between Diet ID™ and 24 h NDSR dietary recalls (Table 2). Significant associations were observed regarding the intake of individual carotenoids, including β-carotene (τ = 0.39, p = 0.0003), zeaxanthin, and lutein (ρ = 0.58, p = 0.0001), apart from lycopene (τ = −0.09, p = 0.40) and α-carotene, which was approaching significance (τ = 0.14, p = 0.19). Additionally, calcium, potassium, folate, iron, sodium, Vitamins B2, B3, B6, C, and E were significantly correlated, with the exception of Vitamins D, B1, and B12.
Bland–Altman Plots were generated to characterize the agreement between Diet ID™ and 24 h NDSR dietary recalls for all nutrients of interest. For all nutrients of interest, a majority with the data points fell within the 95% CI, with a maximum of three individuals out of the 42 participants in the sample not within the limits of agreement, with the exception of sodium (n = 5) (Supplemental File S1).

3.3. Diet ID™, Skin Carotenoid Scores, and Plasma Carotenoids

Diet ID™, skin carotenoid scores, and plasma carotenoids were compared to determine if objective concentration biomarkers of dietary intake were associated with nutrient estimations from Diet ID™ (Table 3). Total carotenoid intake measured by Diet ID™ was significantly correlated with skin carotenoid scores from the Veggie Meter® after controlling for BMI (Adjusted R2 = 0.41, p < 0.0001). Significant positive associations were observed between total plasma carotenoids and total carotenoids estimated by Diet ID™, when controlling for BMI (Adjusted R2 = 0.37, p = 0.0001). To directly compare the objective measures of dietary intake, skin carotenoid scores and plasma carotenoids were assessed, and a strong positive correlation was observed after controlling for BMI (Adjusted R2 = 0.68; p < 0.0001).

4. Discussion

Diet ID™ was designed to assess dietary patterns and estimate nutrient intake values by means of a unique pattern recognition image-based algorithm to ultimately identify chronic disease risk [20]. This analysis demonstrates that nutrient intake from Diet ID™ was comparable to both short-term nutrient consumption from NDSR dietary recalls and plasma carotenoids, in addition to more long-term dietary intake determined by skin carotenoid scores. Diet ID™ was effective in estimating diet quality, as well as nutrients and bioactive compounds associated with fruit and vegetable consumption.

4.1. Total Calories and Macronutrients

Total calorie intake is an important nutritional marker used to estimate energy balance and is often pertinent in guiding nutrient recommendations and in nutrition research studies assessing weight gain or weight loss [47]. Total calorie, protein, and carbohydrate intake from Diet ID™ was associated with NDSR output. Although the measurement of total fat was not significantly correlated between Diet ID™ and NDSR, dietary fiber and cholesterol were both found to have significant associations between instruments. As measurements of fat intake approaches significance (ρ = 0.29, p = 0.06), the sample may have been limited in power to detect the criterion validity between devices for this macronutrient. It is important to note that the Diet ID™ software asks participants to report any dietary restrictions prior to the assessment. Thirteen participants indicated that they did not consume one or more of the following: eggs, nuts, dairy, or meat, which may provide insight into the discrepancies in fat consumption, as the images from Diet ID™ may have not accurately captured additional dietary sources of this macronutrient. Research looking at the dietary intake in the college student population has confirmed the challenges in self-reporting macronutrient intake using innovative technology [48]; further exploration into assessing the discordance in consumption is warranted.
Previous research on dietary intake data collection has indicated inconsistencies between subjective reporting of macronutrient consumption compared to objective measures of macronutrient intake [7,49,50]. It has been observed that individuals often underestimate the portion sizes of foods containing both protein and fat, as these are often measured in dietary data collection using weight estimations, which can be challenging to infer [51]. Additional demographic factors have been observed to introduce a higher risk of bias into the reporting of macronutrient intake, with females, individuals who are overweight or obese, individuals of low socioeconomic status, and individuals actively seeking to lose weight often underreporting macronutrients, whereas younger individuals and individuals with lower BMIs overestimating macronutrient consumption [52,53]. With the racial and ethnic diversity of the study population, including differences in socioeconomic status indicated by food insecurity, BMI, and a majority of the participants being biologically female, the increased likelihood of reporting bias with macronutrient intake may provide further insight to the non-significant finding for fat intake.

4.2. Micronutrients and Phytonutrients

Measurements of Vitamin A, Vitamin C, Vitamin E, Vitamin B2 (riboflavin), Vitamin B3 (niacin), Vitamin B6 (pyridoxine), folate, iron, sodium, potassium, carotenoids, and carotenoid derivative intakes as predicted by Diet ID™ were significantly correlated with NDSR output, whereas lycopene, α-carotene, Vitamin D, Vitamin B1 (thiamin), and Vitamin B12 (cobalamin) were not. Lycopene has been reported to be a challenging carotenoid to measure using traditional dietary assessment tools due to the considerable variability in degradation kinetics, dependent on processing and competing nutrient interactions within the food matrix [54,55]. It has been observed that lycopene bioavailability is higher in its cooked form compared to raw form, and therefore concentrations may differ depending on the preparation of lycopene-containing foods [56]. Lycopene metabolism and absorption has been shown to be highly correlated and contingent on macronutrient intake, specifically dietary fat and oil consumption [57]. Dietary sources of lycopene are in the all-trans configuration, which differs from the lycopene found in human tissue, which is in the cis-isomer configuration [58]. Due to the bulkiness of the all-trans lycopene, there is a lower affinity and efficiency for micelle incorporation, and therefore higher amounts of dietary fat may inhibit the absorption of lycopene [58]. This contradicts the physiological uptake of other carotenoid compounds, in which absorption and bioavailability increases with dietary fat consumption [59]. It is unknown whether correcting for the processing of lycopene-containing foods would alter the estimated nutrient values from Diet ID™ and 24 h NDSR dietary recalls. Additionally, lycopene is predominantly present in tomatoes and tomato-based products, limiting the availability of lycopene intake from food sources, whereas other carotenoids, such as β-carotene, are found more ubiquitously in red, orange, yellow, purple, and dark green foods [60].
Skin carotenoid scores and plasma carotenoids were used as objective measures of fruit and vegetable consumption. As overweight and obesity impacts the storage capacity of carotenoids in circulation, as well as those deposited in the skin, BMI was added as a covariate into the statistical model. Significant associations were observed between plasma carotenoids, skin carotenoid scores as measured by the Veggie Meter®, and dietary intake of total carotenoids as predicted by Diet ID™. The relationship between dietary intake and skin carotenoid scores is to be expected, as skin carotenoids represent a longer-term dietary intake of carotenoid-containing fruits and vegetables and therefore may be influenced by accretion [15]. Previous research using objective measures of dietary intake, such as plasma carotenoids or spectroscopy-based skin carotenoid measurements have also demonstrated similar moderate or weak associations due to discrepancies between subjective assessment tools for fruit and vegetable consumption and objective skin carotenoid scores [21,61]. The observed association highlights the use of Diet ID™ as an estimate for fruit and vegetable consumption and provides the capability to extrapolate nutrient values that are comparable to carotenoid concentrations detected in plasma and skin; however, it should be acknowledged that Diet ID™ may have limited utility as a dietary assessment tool as this comparison has only been demonstrated for carotenoid consumption in a US population.
Vitamin D intake was not significantly correlated between dietary assessment instruments. As an identified 2020–2025 DGA Nutrient of Concern, Vitamin D is only found in a small number of dietary sources, making nutrient adequacy challenging to achieve. The variation in the database from the 2017 version of NDSR and the 2019 version may explain the non-significant correlation, which likely was a result of Diet ID™ not including any fortified food items into the DQPN algorithm, such as Vitamin D found in fortified dairy products, cereals, and juices [62,63]. Similarly, enriched and fortified grain products are a main dietary source of thiamin and therefore may have not been accurately captured by the DQPN algorithm [64,65]. When participants were asked about fortified food products during the repeated NDSR dietary recalls, fortification status was often unknown and thus NDSR defaults were used for computation. The difficulty accounting for nutrients naturally found in a limited number of food items and intake of fortified foods may explain the deviation between instruments for Vitamin D and thiamin intake [66].
Due to the dietary restrictions reported by participants, specifically relating to the lack animal-based food products such as eggs, meat, and lactose intolerance, consumption of overall Vitamin B12 intake may have been inaccurately captured. It has been previously observed that individuals following a vegetarian or vegan dietary pattern are at an increased risk for developing a Vitamin B12 deficiency, which is often mitigated through a form of Vitamin B12 supplementation [67]. As dietary supplements were not incorporated into the final nutrient analysis, B12 intake from non-food sources may provide further insight into the deviance in estimates of Vitamin B12 intake from Diet ID™ and NDSR.
The findings from this analysis support and expand upon the results from a previous study comparing Diet ID™ to Automated Self-Administered 24 h (ASA24) dietary recalls [36]. The Nutritious Eating with Soul (NEW Soul) study was a 2-year randomized nutrition intervention aimed at comparing the impact of two dietary patterns on the risk of cardiovascular disease among African American adults [36]. Although study populations differed in population size (NEW Soul n = 68), age (NEW Soul = 50 ± 9.6 years), and race/ethnicity (NEW Soul = 100% African American), the findings for diet quality, as measured by HEI-2015, as well as cholesterol, potassium, Vitamin C, and Vitamin E were significant between Diet ID™ and both ASA24 and NDSR dietary recalls in their respective study populations. Findings from the NEW Soul study observed significant associations in carbohydrate and protein intake, as well as copper, Vitamin B1, and Vitamin B12, some of which were not observed in the present analysis [36]; however, it should be noted that the NEW Soul study analyzed mean nutrient intake by aggregating values across all participants, whereas data analysis was performed comparing individual output from both devices in this study. Thus, comparing the magnitude of significance between studies may not be feasible as the statistical approaches were not in congruence.
Furthermore, interviewer-administered dietary recalls are considered a higher quality assessment tool for capturing dietary intake data compared to self-administered dietary recalls due to the methodical probing to acquire exact dietary details [68]. While ASA24 dietary recalls are less participant and researcher burdensome, NDSR dietary recalls are considered to be a more rigorous dietary assessment tool [69]. However, ASA24 and NDSR dietary assessments have limitations in both time and resources; therefore, Diet ID™ may be an alternative tool that can capture similar nutrient output rapidly and with vastly reduced participant and researcher burden. In addition to the more rigorous dietary collection method used in this study, the inclusion of objective measures of skin carotenoid scores measured via the Veggie Meter® and plasma carotenoids further promotes the use of Diet ID™ to measure nutrient intake, specifically those associated with fruit and vegetable consumption. The advantages of Diet ID™ have the ability to advance dietary intake assessment methodology, though it should be noted that Diet ID™ was designed to measure overall dietary patterns and alternative assessments may be recommended to calculate exact nutrient amounts, kinetics, or degradation of dietary compounds.
Innovative techniques to successfully capture the intricacies of dietary intake are needed to reduce participant and researcher burden in the research setting, as well as extend beyond research to improve dietary monitoring for public health benefit [70,71]. Dietary intake is closely associated with chronic disease risk, and dietary habits are often established prior to adulthood [72]. College students are a unique category of emerging adults, as many individuals in this life stage are making food choices independently for the first time, drastically altering their eating behaviors [73]. Most recently, the average HEI-2015 score for US adults was 58 out of a maximum score of 100 [74], and it has been observed that diet quality further decreases in the college student population due to financial limitations in affording healthy foods and environmental barriers to access [75]. Diet ID™ and NDSR were strongly correlated for predicting HEI-2015 scores (τ = 0.55, p < 0.0001); however, it should be noted that the level of agreement between the two measurements becomes less strong at HEI-2015 scores above 80 with a deviation of 7.14%. For this reason, assessing dietary intake in this population presents challenges that are often difficult to capture using traditional dietary assessment methods.
Despite these challenges, Diet ID™ was able to quickly estimate diet quality, consumption of total calories, protein, carbohydrates, and a majority of micronutrients, phytonutrients, and nutrients of concern with substantially less participant and researcher burden than other established methodologies, which signals potential for Diet ID™ to be utilized in clinical and outpatient settings as a dietary assessment method. Additionally, as the image-based technology allows for universal visual recognition, Diet ID™ may be able to be implemented in populations of low or limited literacy, and non-native English speakers. This study assessed the use of Diet ID™ in a population of college students, including individuals experiencing acute and chronic food insecurity.

4.3. Strengths and Limitations

It is imperative to recognize both the strengths and limitations of the present study. This study is the first to compare the innovative Diet ID™ technology to subjective and objective measures of dietary intake in a population of emerging adults. As this is a secondary validation from the previously mentioned study disrupted due to the COVID-19 pandemic, the total sample size was intended to be larger; however, the observed sample size in the data collected was sufficiently powered to analyze plasma carotenoids as the primary outcome. Thus, it is possible that the present study is underpowered to detect associations in certain nutrients of interest with high interindividual variability.
Due to the racial and ethnic diversity of the college student population at the University of California Davis, foods commonly consumed by participants may have not been present in the NDSR database nor in the images displayed in Diet ID™. To account for this, the Diet ID™ algorithm is currently expanding their patented algorithm to include a larger database of culturally diverse foods to better encompass the diversity of the eating patterns among people living in the US and to identify dietary patterns in other parts of the world. As Diet ID™ does not account for dietary supplements, all reported supplements were excluded from the NDSR nutrient output; therefore, intake of some nutrients may be higher than recorded as a result of supplementation. For the purpose of this analysis, dietary intake data without supplements was used for uniformity between outputs. While NDSR dietary recalls were unannounced and Diet ID™ was utilized as a self-assessment with limited supervision, it is possible that there was desirability or response bias among the participants. College students generally consume a lower quality diet than other adult populations; therefore, these findings may not be generalizable to all adult populations [76,77,78].

5. Conclusions

The findings from this study support the use of Diet ID™ as a rapid, non-invasive dietary assessment tool that may provide comparable estimates of nutrient consumption against repeated 24 h NDSR dietary recalls, skin carotenoid scores, and plasma carotenoids. Innovative diet capture technology, such as Diet ID™, has the potential to be implemented in both clinical and community settings to increase habitual dietary monitoring, with the goal of developing awareness around food choices to initiate health-promoting behaviors across the lifespan and in racially and ethnically diverse populations.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/nu15020409/s1, File S1: Bland–Altman’s Plot Analysis.

Author Contributions

The author contributions were as follows: M.D.R., G.M.C. and R.E.S. conceptualized and designed the research study, R.E.S., L.C.K., V.M. and F.M.S. provided the study oversight; M.D.R. and G.M.C. collected the data; M.D.R., G.M.C. and M.C.S.B. performed the statistical analysis; M.D.R. drafted the manuscript with support from R.E.S. and F.M.S. All authors have read and agreed to the published version of the manuscript.

Funding

The Diet ID™ software was provided by the manufacturers. Funding was provided in part by USDA CRIS number CA-D-NTR-6316-H, the Aggie Compass Basic Needs Resource Center at the University of California, Davis, and the University of California Office of the President Global Food Initiative. The study design, implementation, statistical analysis, interpretation of the data, and manuscript preparation were completed independent of Diet ID™ and funding agencies.

Informed Consent Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board of the University of California, Davis (1476178) on 26 November 2019.

Data Availability Statement

Data, analytical code, and research materials described in this study will be made available from the corresponding author upon request, pending application and approval.

Acknowledgments

The authors would like to acknowledge the on-going research support from Britt Loofbourrow and assistance in data collection efforts from the following undergraduate interns from the University of California, Davis: Emily Sklar, Clara Matsumoto, Hoang-Vi (HV) Vu, Tonya Xie, Rebecca Lin, Ramneek Kaur, and Avery Poling.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Pico, C.; Serra, F.; Rodriquez, A.M.; Keijer, J.; Palou, A. Biomarkers of Nutrition and Health: New Tools for New Approaches. Nutrients 2019, 11, 1092. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Roark, R.A.; Niederhauser, V.P. Fruit and vegetable intake: Issues with definition and measurement. Public Health Nutr. 2013, 16, 2–7. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Slavin, J.L.; Lloyd, B. Health benefits of fruits and vegetables. Adv. Nutr. 2012, 3, 506–516. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Liu, R.H. Health-promoting components of fruits and vegetables in the diet. Adv. Nutr. 2013, 4, 384S–392S. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Shim, J.S.; Oh, K.; Kim, H.C. Dietary assessment methods in epidemiologic studies. Epidemiol. Health 2014, 36, e2014009. [Google Scholar] [CrossRef] [Green Version]
  6. Penn, L.; Boeing, H.; Boushey, C.J.; Dragsted, L.O.; Kaput, J.; Scalbert, A.; Welch, A.A.; Mathers, J.C. Assessment of dietary intake: NuGO symposium report. Genes Nutr. 2010, 5, 205–213. [Google Scholar] [CrossRef] [Green Version]
  7. Macdiarmid, J.; Blundell, J. Assessing dietary intake: Who, what and why of under-reporting. Nutr. Res. Rev. 1998, 11, 231–253. [Google Scholar] [CrossRef] [Green Version]
  8. McClung, H.L.; Ptomey, L.T.; Shook, R.P.; Aggarwal, A.; Gorczyca, A.M.; Sazonov, E.S.; Becofsky, K.; Weiss, R.; Das, S.K. Dietary Intake and Physical Activity Assessment: Current Tools, Techniques, and Technologies for Use in Adult Populations. Am. J. Prev. Med. 2018, 55, e93–e104. [Google Scholar] [CrossRef] [Green Version]
  9. Thompson, F.E.; Subar, A.F.; Loria, C.M.; Reedy, J.L.; Baranowski, T. Need for technological innovation in dietary assessment. J. Am. Diet. Assoc. 2010, 110, 48–51. [Google Scholar] [CrossRef] [Green Version]
  10. Moran, N.E.; Mohn, E.S.; Hason, N.; Erdman, J.W., Jr.; Johnson, E.J. Intrinsic and Extrinsic Factors Impacting Absorption, Metabolism, and Health Effects of Dietary Carotenoids. Adv. Nutr. 2018, 9, 465–492. [Google Scholar] [CrossRef]
  11. Radtke, M.D.; Jilcott, P.S.; Jahns, L.; Firnhaber, G.C.; Loofbourrow, B.M.; Zeng, A.; Scherr, R.E. Criterion-Related Validity of Spectroscopy-Based Skin Carotenoid Measurements as a Proxy for Fruit and Vegetable Intake: A Systematic Review. Adv. Nutr. 2020, 11, 1282–1299. [Google Scholar] [CrossRef]
  12. Ermakov, I.V.; Ermakova, M.; Sharifzadeh, M.; Gorusupudi, F.K.; Bernstein, P.S.; Stookey, J.; Evans, J.; Arana, T.; Tao-Lew, L.; Isman, C. Optical assessment of skin carotenoid status as a biomarker of vegetable and fruit intake. Arch. Biochem. Biophys. 2018, 646, 46–54. [Google Scholar] [CrossRef]
  13. Burrows, T.L.; Rollo, M.E.; Williams, R.; Wood, L.G.; Garg, M.L.; Jensen, M.; Collins, C.E. A Systematic Review of Technology-Based Dietary Intake Assessment Validation Studies That Include Carotenoid Biomarkers. Nutrients 2017, 9, 140. [Google Scholar] [CrossRef] [Green Version]
  14. Longevity Link Corporation. The Veggie Meter—Skin Carotenoids as Indicator of Fruit and Vegetable Intake and Biomarker Associated with Better Health [Internet]. 2016. Available online: Longevitylinkcorporation.com/home.html (accessed on 11 April 2022).
  15. Jahns, L.; Johnson, L.K.; Mayne, S.T.; Cartmel, B.; Picklo Sr, M.J.; Ermakov, I.V.; Gellermann, W.; Whigham, L.D. Skin and plasma carotenoid response to a provided intervention diet high in vegetables and fruit: Uptake and depletion kinetics. Am. J. Clin. Nutr. 2014, 100, 930–937. [Google Scholar] [CrossRef] [Green Version]
  16. Ermakov, I.V.; Gellermann, W. Dermal carotenoid measurements via pressure mediated reflection spectroscopy. J. Biophotonics 2012, 5, 559–570. [Google Scholar] [CrossRef]
  17. Boushey, C.J.; Spoden, M.; Zhu, F.M.; Delp, E.J.; Kerr, D.A. New mobile methods for dietary assessment: Review of image-assisted and image-based dietary assessment methods. Proc. Nutr. Soc. 2017, 76, 283–294. [Google Scholar] [CrossRef] [Green Version]
  18. Ho, D.K.N.; Tseng, S.; Wu, M.; Shih, C.; Atika, A.P.; Chen, Y.; Chang, J. Validity of image-based dietary assessment methods: A systematic review and meta-analysis. Clin. Nutr. 2020, 39, 2945–2959. [Google Scholar] [CrossRef]
  19. Diet ID—Diet Is a Vital Sign. Available online: https://www.dietid.com (accessed on 11 April 2022).
  20. Katz, D.L.; Rhee, L.Q.; Katz, C.S.; Aronson, D.L.; Frank, G.C.; Gardner, C.D.; Willett, W.C.; Dansinger, M.L. Dietary assessment can be based on pattern recognition rather than recall. Med. Hypotheses 2020, 140, 109644. [Google Scholar] [CrossRef]
  21. Jahns, L.; Johnson, L.K.; Conrad, Z.; Bukowski, M.; Raatz, S.K.; Jilcott Pitts, S.; Wang, Y.; Ermakov, I.V.; Gellermann, W. Concurrent validity of skin carotenoid status as a concentration biomarker of vegetable and fruit intake compared to multiple 24-h recalls and plasma carotenoid concentrations across one year: A cohort study. Nutr. J. 2019, 18, 78. [Google Scholar] [CrossRef] [Green Version]
  22. Jahns, L.; Johnson, L.K.; Scheett, A.J.; Stote, K.S.; Raatz, S.K.; Subar, A.F.; Tande, D. Measures of Diet Quality across Calendar and Winter Holiday Seasons among Midlife Women: A 1-Year Longitudinal Study Using the Automated Self-Administered 24-Hour Recall. J. Acad. Nutr. Diet 2016, 116, 1961–1969. [Google Scholar] [CrossRef]
  23. Mounien, L.; Tourniaire, F.; Landrier, J.F. Anti-Obesity Effect of Carotenoids: Direct Impact on Adipose Tissue and Adipose Tissue-Driven Indirect Effects. Nutrients 2019, 11, 1562. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Holt, E.W.; Wei, E.K.; Bennett, N.; Zhang, L.M. Low skin carotenoid concentration measured by resonance Raman spectroscopy is associated with metabolic syndrome in adults. Nutr. Res. 2014, 34, 821–826. [Google Scholar] [CrossRef] [PubMed]
  25. Melendez-Martinez, A.J.; Stinco, C.M.; Mapelli-Brahm, P. Skin Carotenoids in Public Health and Nutricosmetics: The Emerging Roles and Applications of the UV Radiation-Absorbing Colourless Carotenoids Phytoene and Phytofluene. Nutrients 2019, 11, 1093. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. United States Department of Agriculture (USDA), E.R.S. Food Security in the U.S.: Measurement. Available online: https://www.ers.usda.gov/topics/food-nutrition-assistance/food-security-in-the-u-s/measurement/#measurement (accessed on 28 September 2022).
  27. United States Department of Agriculture (USDA) E.R.S. Food Security in the U.S.: Definitions of Food Security 2021. Available online: https://www.ers.usda.gov/topics/food-nutrition-assistance/food-security-in-the-us/definitions-of-food-security/ (accessed on 28 September 2022).
  28. National Center for Health Statistics. What We Eat in America/National Health and Nutrition Examination Survey, 2013–2014; Healthy Eating Index-2015. Available online: https://www.fns.usda.gov/healthy-eating-index-hei#1 (accessed on 29 November 2022).
  29. Reedy, J.; Lerman, J.L.; Krebs-Smith, S.M.; Kirkpatrick, S.I.; Pannucci, T.E.; Wilson, M.M.; Subar, A.F.; Kahle, L.L.; Tooze, J.A. Evaluation of the Healthy Eating Index-2015. J. Acad. Nutr. Diet 2018, 118, 1622–1633. [Google Scholar] [CrossRef] [PubMed]
  30. Radtke, M.D.; Poe, M.; Stookey, J.; Jilcott Pitts, S.; Moran, N.E.; Landry, M.J.; Rubin, L.P.; Stage, V.C.; Scherr, R.E. Recommendations for the Use of the Veggie Meter® for Spectroscopy-Based Skin Carotenoid Measurements in the Research Setting. Curr. Dev. Nutr. 2021, 5, nzab104. [Google Scholar] [CrossRef]
  31. Craft, N.E. High resolution HPLC method for the simultaneous analysis of carotenoids, retinoids, and tocopherols. FASEB 1996, 10, A527. [Google Scholar]
  32. Craft, N.E. Chromatographic Techniques for Carotenoid Separation. Curr. Protoc. Food Anal. Chem. 2001, 1, F2.3.1–F2.3.15. [Google Scholar] [CrossRef]
  33. Centers for Disease Control and Prevention. Laboratory Manual: Analysis of Vitamin A/Vitamin E/Carotenoids for NHANES. Available online: https://www.cdc.gov/nchs/data/nhanes/nhanes_03_04/l45vit_c_met_vitAE_carotenoids.pdf (accessed on 12 October 2022).
  34. SAS Institute Inc. SAS/ACCESS® 9.4 Interface to ADABASL: Reference; SAS Institute Inc.: Cary, NC, USA, 2013. [Google Scholar]
  35. Bland, M.J.; Altman, D. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1996, 327, 307–310. [Google Scholar] [CrossRef]
  36. Turner-McGrievy, G.; Hutto, B.; Bernhart, J.A.; Wilson, M.J. Comparison of the Diet ID Platform to the Automated Self-administered 24-hour (ASA24) Dietary Assessment Tool for Assessment of Dietary Intake. J. Am. Coll. Nutr. 2021, 41, 1–23. [Google Scholar] [CrossRef]
  37. Baldrick, F.R.; Woodside, J.V.; Elborn, J.S.; Young, I.S.; McKinley, M.C. Biomarkers of fruit and vegetable intake in human intervention studies: A systematic review. Crit. Rev. Food Sci. Nutr. 2011, 51, 795–815. [Google Scholar] [CrossRef]
  38. Woodside, J.V.; Draper, J.; Llyod, A.; McKinley, M.C. Use of biomarkers to assess fruit and vegetable intake. Proc. Nutr. Soc. 2017, 76, 308–315. [Google Scholar] [CrossRef]
  39. Block, G.; Norkus, E.; Hudes, M.; Mandel, S.; Helzlsouer, K. Which Plasma Antioxidants Are Most Related to Fruit and Vegetable Consumption? Am. J. Epidemiol. 2001, 154, 1113–1118. [Google Scholar] [CrossRef]
  40. US Department of Health and Human Services and US Department of Agriculture. 2020–2025 Dietary Guidelines for Americans. 2020. Available online: https://www.dietaryguidelines.gov (accessed on 28 September 2022).
  41. Rush, E.; Amoah, I.; Diep, T. Jalili-Moghaddam Determinants and Suitability of Carotenoid Reflection Score as a Measure of Carotenoid Status. Nutrients 2020, 12, 13. [Google Scholar] [CrossRef] [Green Version]
  42. Tobias, T.A.M.; Wood, L.G.; Rastogi, D. Carotenoids, fatty acids and disease burden in obese minority adolescents with asthma. Clin. Exp. Allergy 2019, 49, 838–846. [Google Scholar] [CrossRef]
  43. Vioque, J.; Weinbrenner, T.; Asensio, L.; Castelló, A.; Young, I.S.; Fletcher, A. Plasma concentrations of carotenoids and vitamin C are better correlated with dietary intake in normal weight than overweight and obese elderly subjects. Br. J. Nutr. 2007, 97, 977–986. [Google Scholar] [CrossRef] [Green Version]
  44. StataCorp LP. Stata 13 Base Reference Manual V13; Stata Press. StataCorp: College Station, TX, USA, 2013. [Google Scholar]
  45. Fontana, J.M.; Pan, Z.; Sazonov, E.S.; McCrory, M.A.; Graham Thomas, J.; McGrane, K.S.; Marden, T.; Higgins, J.A. Reproducibility of Dietary Intake Measurement From Diet Diaries, Photographic Food Records, and a Novel Sensor Method. Front. Nutr. 2020, 7, 99. [Google Scholar] [CrossRef]
  46. Beasley, J.; Riley, W.T.; Jean-Mary, J. Accuracy of a PDA-based dietary assessment program. Nutrition 2005, 21, 672–677. [Google Scholar] [CrossRef]
  47. Mozaffarian, D.; Forouhi, N.G. Dietary guidelines and health-is nutrition science up to the task? BMJ 2018, 360, k822. [Google Scholar] [CrossRef] [Green Version]
  48. Slavin, M.; Polasky, A.; Vieyra, K.; Best, A.; Durant, L.; Frankenfeld, C. Single-Meal Nutrient Assessment by a Self-Administered, Electronic Exit Survey Compared with a Multipass Dietary Interview in University Undergraduates in an All-You-Care-to-Eat Campus Dining Hall. J. Acad. Nutr. Diet 2019, 119, 739–749. [Google Scholar] [CrossRef] [Green Version]
  49. Glanz, K.; Brug, J.; van Assema, P. Are awareness of dietary fat intake and actual fat consumption associated?—a Dutch-American comparison. Eur. J. Clin. Nutr. 1997, 51, 542–547. [Google Scholar] [CrossRef] [Green Version]
  50. Patel, K.A.; Schlundt, D.G. Impact of moods and social context on eating behavior. Appetite 2001, 36, 111–118. [Google Scholar] [CrossRef] [PubMed]
  51. Rumpler, W.V.; Kramer, M.; Rhodes, D.G.; Moshfegh, A.J.; Paul, D.R. Identifying sources of reporting error using measured food intake. Eur. J. Clin. Nutr. 2008, 62, 544–552. [Google Scholar] [CrossRef] [PubMed]
  52. Johansson LSolvoll, K.; Bjørneboe, G.E.; Drevon, C.A. Under- and overreporting of energy intake related to weight status and lifestyle in a nationwide sample. Am. J. Clin. Nutr. 1998, 68, 266–274. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. McKenzie Bl Coyle, D.H.; Santos, J.A.; Burrows, T.; Rosewarne, E.; Peter, S.A.E.; Carcel, C.; Jaacks, L.M.; Norton, R.; Collins, C.E.; Woodward, M.; et al. Investigating sex differences in the accuracy of dietary assessment methods to measure energy intake in adults: A systematic review and meta-analysis. Am. J Clin. Nutr. 2021, 113, 1241–1255. [Google Scholar] [CrossRef] [PubMed]
  54. Porrini, M.; Riso, P. What are typical lycopene intakes? J. Nutr. 2005, 135, 2042S–2045S. [Google Scholar] [CrossRef] [Green Version]
  55. Mayeaux, M.; Xu, A.; King, J.M.; Prinyawiwatkul, W. Effects of Cooking Conditions on the Lycopene Content in Tomatoes. J. Food Sci. 2006, 71, C461–C464. [Google Scholar] [CrossRef]
  56. Fielding, J.M.; Rowley, K.G.; Cooper, P.; O’ Dea, K. Increases in plasma lycopene concentration after consumption of tomatoes cooked with olive oil. Asia Pac. J. Clin. Nutr. 2005, 14, 131–136. [Google Scholar]
  57. Garcia, A.L.; Koebnick, C.; Dagnelie, P.C.; Strassner Carola Elmadfa, I.; Katz, N.; Leitzmann Hoffman, I. Long-term strict raw food diet is associated with favourable plasma beta-carotene and low plasma lycopene concentrations in Germans. Br. J. Nutr. 2008, 99, 1293–1300. [Google Scholar] [CrossRef] [Green Version]
  58. Erdman, J.W., Jr. How do nutritional and hormonal status modify the bioavailability, uptake, and distribution of different isomers of lycopene? J. Nutr. 2005, 135, 2046S–2047S. [Google Scholar] [CrossRef] [Green Version]
  59. Donhowe, E.G.; Kong, F. Beta-carotene: Digestion, Microencapsulation, and In Vitro Bioavailability. Food Bioproc. Tech. 2014, 7, 338–354. [Google Scholar] [CrossRef]
  60. Britton, G.; Liaaen-Jensen, S.; Pfander, H. Carotenoids Handbook; Birkhäuser Verlag: Basel, Switzerland; Boston, MA, USA; Belrin, Germany, 2004; Volume 1. [Google Scholar]
  61. Beccarelli, L.M.; Scherr, R.E.; Dharmar, M.; Ermakov, I.V.; Gellermann, W.; Jahns, L.; Linnell, J.D.; Keen, C.L.; Steinberg, F.M.; Young, H.M.; et al. Using Skin Carotenoids to Assess Dietary Changes in Students After 1 Academic Year of Participating in the Shaping Healthy Choices Program. J. Nutr. Educ. Behav. 2017, 49, 73–78.e1. [Google Scholar] [CrossRef] [Green Version]
  62. Calvo, M.S.; Whiting, S.J.; Barton, C.N. Vitamin D fortification in the United States and Canada: Current status and data needs. Am. J. Clin. Nutr. 2004, 80 (Suppl. 6), 1710S–1716S. [Google Scholar] [CrossRef]
  63. Moore, C.E.; Murphy, M.M.; Keast, D.R.; Holick, M.F. Vitamin D intake in the United States. J. Am. Diet Assoc. 2004, 104, 980–983. [Google Scholar] [CrossRef]
  64. Mielgo-Ayuso, J.; Aparico-Ugarriza, R.; Olza, J.; Aranceta-Bartrina, J.; Gil, A.; Ortega, R.M.; Serra-Majem, L.; Varela-Moreiras, G.; González-Gross, M. Dietary Intake and Food Sources of Niacin, Riboflavin, Thiamin and Vitamin B(6) in a Representative Sample of the Spanish Population. The Anthropometry, Intake, and Energy Balance in Spain (ANIBES) Study dagger. Nutrients 2018, 10, 846. [Google Scholar] [CrossRef] [Green Version]
  65. Subar, A.F.; Krebs-Smith, S.M.; Cook, A.; Kahle, L.L. Dietary Sources of Nutrients among US Adults, 1989 to 1991. J. Am. Diet Assoc. 1998, 98, 537–547. [Google Scholar] [CrossRef]
  66. Byrdwell, W.C.; Devries, J.; Exler, J.; Harnly, J.M.; Holden, J.M.; Holick, M.F.; Hollis, B.W.; Horst, R.L.; Lada, M.; Lemar, L.E.; et al. Analyzing vitamin D in foods and supplements: Methodologic challenges. Am. J. Clin. Nutr. 2008, 88, 554S–557S. [Google Scholar] [CrossRef] [Green Version]
  67. Pawlak, R.; Parrott, S.J.; Raj, S.; Cullum-Dugan, D.; Lucus, D. How prevalent is vitamin B(12) deficiency among vegetarians? Nutr. Rev. 2013, 71, 110–117. [Google Scholar] [CrossRef]
  68. Thompson, F.W.; Dixit-Joshi, S.; Potischman, N.; Dodd, K.W.; Kirkpatrick, S.I.; Kushi, L.H.; Alexander, G.L.; Coleman, L.A.; Zimmerman, T.P.; Sundaram, M.E.; et al. Comparison of Interviewer-Administered and Automated Self-Administered 24-Hour Dietary Recalls in 3 Diverse Integrated Health Systems. Am. J. Epidemiol. 2015, 181, 970–978. [Google Scholar] [CrossRef] [Green Version]
  69. Timon, C.M.; van den Barg, R.; Blain, R.J.; Kehoe, L.; Evans, K.; Walton, J.; Flynn, A.; Gibney, E.R. A review of the design and validation of web—and computer-based 24-h dietary recall tools. Nutr. Res. Rev. 2016, 29, 268–280. [Google Scholar] [CrossRef]
  70. Lupton, D. Self-tracking, health and medicine. Health Sociol. Rev. 2016, 26, 1–5. [Google Scholar] [CrossRef] [Green Version]
  71. Lucassen, D.A.; Brouwer-Brolsma, E.M.; Slotegraaf, A.I.; Kok, E.; Feskens, E.J.M. DIetary ASSessment (DIASS) Study: Design of an Evaluation Study to Assess Validity, Usability and Perceived Burden of an Innovative Dietary Assessment Methodology. Nutrients 2022, 14, 1156. [Google Scholar] [CrossRef] [PubMed]
  72. Mennella, J.A.; Ventura, A.K. Early feeding: Setting the stage for healthy eating habits. Nestle Nutr. Workshop Ser. Pediatr. Program 2011, 68, 153–163, discussion 164–168. [Google Scholar] [PubMed]
  73. Abraham, S.; Noriega, B.R.; Shin, J.Y. College students eating habits and knowledge of nutritional requirements. J. Nutr. Human Health 2018, 2, 13–17. [Google Scholar] [CrossRef]
  74. US Department of Agriculture: Healthy Eating Index-2015 Scores. Available online: https://www.fns.usda.gov/resource/healthy-eating-index-hei (accessed on 29 November 2022).
  75. Merhout, F.; Doyle, J. Socioeconomic Status and Diet Quality in College Students. J. Nutr. Educ. Behav. 2019, 51, 1107–1112. [Google Scholar] [CrossRef] [PubMed]
  76. Sogari, G.; Velez-Argumedo, C.; Gómez, M.I.; Mora, C. College Students and Eating Habits: A Study Using An Ecological Model for Healthy Behavior. Nutrients 2018, 10, 1823. [Google Scholar] [CrossRef] [Green Version]
  77. Martinez, S.M.; Grandner, M.A.; Nazmi, A.; Ruben Canedo, E.; Ritchie, L.D. Pathways from Food Insecurity to Health Outcomes among California University Students. Nutrients 2019, 11, 1419. [Google Scholar] [CrossRef] [Green Version]
  78. Nelson, M.C.; Larson, N.I.; Barr-Anderson, D.; Neumark-Sztainer, D.; Story, M. Disparities in dietary intake, meal patterning, and home food environments among young adult nonstudents and 2- and 4-year college students. Am. J. Public Health 2009, 99, 1216–1219. [Google Scholar] [CrossRef]
Table 1. Baseline participant characteristics expressed as mean ± standard deviations for age, BMI, SCS, and nutrition knowledge, and the number and percentage of participants in subgroup by sex, race/ethnicity, and food security status (n = 48).
Table 1. Baseline participant characteristics expressed as mean ± standard deviations for age, BMI, SCS, and nutrition knowledge, and the number and percentage of participants in subgroup by sex, race/ethnicity, and food security status (n = 48).
Age, Years (Mean ± SD)22.09 ± 2.36
Biological Sex
Male12 (25%)
Female36 (75%)
Race/Ethnicity
African American/Black, not of Hispanic origin1 (2%)
American Indian/Alaska native0
Asian/Pacific Islander23 (48%)
White, not of Hispanic origin9 (19%)
Latin/Hispanic (Mexican-American, Puerto Rican, Cuban)10 (21%)
Other1 (2%)
Unknown/Prefer not to answer4 (8%)
Food Security Status
High19 (40%)
Marginal15 (31%)
Low8 (17%)
Very Low6 (12%)
BMI (mean ± SD; kg/m2)
Total24.58 ± 5.04
Male25.79 ± 4.47
Female24.18 ± 5.22
Timepoint 1: SCS (mean ± SD)322.98 ± 114.42
Timepoint 2: SCS (mean ± SD)341.35 ± 113.98
Table 2. Correlation coefficients between nutrient values predicted by Diet ID™ and 24 h dietary recalls (n = 42) by Pearson’s correlationa or Kendall’s tau correlation b.
Table 2. Correlation coefficients between nutrient values predicted by Diet ID™ and 24 h dietary recalls (n = 42) by Pearson’s correlationa or Kendall’s tau correlation b.
NutrientCorrelation Coefficientp-Value
HEI-2015 Score b0.55<0.001
Calories (kcals) a0.360.02
Protein (g) a0.550.0002
Carbohydrates (g) a0.31<0.05
Fat (g) a0.29NS (p = 0.06)
Cholesterol (mg) b0.320.003
Vitamin A (mcg) a0.390.01
Total Carotenoids (mcg) a0.440.003
α-carotene (mcg) b0.14NS (p = 0.19)
β-carotene (mcg) b0.390.0003
Lycopene (mcg) b−0.09NS (p = 0.40)
Lutein and Zeaxanthin (mcg) a0.580.0001
Dietary Fiber (g) a0.64<0.0001
Calcium (mg) a0.360.02
Vitamin C (mg) a0.440.003
Vitamin D (mcg) a0.13NS (p = 0.41)
Vitamin E (mg) a0.350.02
Sodium (mg) a0.360.02
Potassium (mg) a0.580.0001
Folate (mcg) a0.370.02
Iron (mg) a0.310.04
Vitamin B1 (Thiamin) (mg) a0.13NS (p = 0.40)
Vitamin B2 (Riboflavin) (mg) a0.340.03
Vitamin B3 (Niacin) (mg) a0.420.005
Vitamin B6 (Pyridoxine) (mg) a0.570.0001
Vitamin B12 (Cobalamin) (mcg) b0.18NS (p = 0.09)
a Calculated using Pearson’s correlation coefficient (ρ). b Calculated using Kendall’s tau (τ).
Table 3. Relationship between skin carotenoid scores (SCS) measured using the Veggie Meter® and plasma carotenoids measured using Diet ID™ controlling for BMI (n = 42).
Table 3. Relationship between skin carotenoid scores (SCS) measured using the Veggie Meter® and plasma carotenoids measured using Diet ID™ controlling for BMI (n = 42).
VariablesLinear Regression
(Adjusted R2)
p-Value
SCS and total carotenoids from Diet ID™; controlling for BMI0.41<0.0001
Total plasma carotenoids and Total Carotenoids from Diet ID™; controlling for BMI0.370.0001
SCS and total plasma carotenoids, controlling for BMI0.68<0.0001
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Radtke, M.D.; Chodur, G.M.; Bissell, M.C.S.; Kemp, L.C.; Medici, V.; Steinberg, F.M.; Scherr, R.E. Validation of Diet ID™ in Predicting Nutrient Intake Compared to Dietary Recalls, Skin Carotenoid Scores, and Plasma Carotenoids in University Students. Nutrients 2023, 15, 409. https://doi.org/10.3390/nu15020409

AMA Style

Radtke MD, Chodur GM, Bissell MCS, Kemp LC, Medici V, Steinberg FM, Scherr RE. Validation of Diet ID™ in Predicting Nutrient Intake Compared to Dietary Recalls, Skin Carotenoid Scores, and Plasma Carotenoids in University Students. Nutrients. 2023; 15(2):409. https://doi.org/10.3390/nu15020409

Chicago/Turabian Style

Radtke, Marcela D., Gwen M. Chodur, Michael C. S. Bissell, Leslie C. Kemp, Valentina Medici, Francene M. Steinberg, and Rachel E. Scherr. 2023. "Validation of Diet ID™ in Predicting Nutrient Intake Compared to Dietary Recalls, Skin Carotenoid Scores, and Plasma Carotenoids in University Students" Nutrients 15, no. 2: 409. https://doi.org/10.3390/nu15020409

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop