Next Article in Journal
Higher Intake of Dairy Is Associated with Lower Cardiometabolic Risks and Metabolic Syndrome in Asian Indians
Next Article in Special Issue
Intermittent Fasting—Short- and Long-Term Quality of Life, Fatigue, and Safety in Healthy Volunteers: A Prospective, Clinical Trial
Previous Article in Journal
Mucosal Healing in Celiac Disease: Villous Architecture and Immunohistochemical Features in Children on a Long-Term Gluten Free Diet
Previous Article in Special Issue
A Randomized Controlled Trial of Fasting and Lifestyle Modification in Patients with Metabolic Syndrome: Effects on Patient-Reported Outcomes
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Validation of a Smartphone Application for the Assessment of Dietary Compliance in an Intermittent Fasting Trial

by
Isabella Baum Martinez
1,2,†,
Beeke Peters
1,3,†,
Julia Schwarz
1,4,
Bettina Schuppelius
1,2,5,
Nico Steckhan
6,
Daniela A. Koppold-Liebscher
7,8,9,
Andreas Michalsen
7,8 and
Olga Pivovarova-Ramich
1,5,10,*
1
Research Group Molecular Nutritional Medicine, Department of Molecular Toxicology, German Institute of Human Nutrition Potsdam-Rehbruecke, 14558 Nuthetal, Germany
2
Institute of Nutritional Science, University of Potsdam, 14558 Nuthetal, Germany
3
Institute of Human Nutrition and Food Science, Faculty of Agriculture and Food Sciences, Christian-Albrecht-University Kiel, 24118 Kiel, Germany
4
Institute of Agricultural and Nutritional Sciences, Martin Luther University Halle-Wittenberg, 06120 Halle (Saale), Germany
5
Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, Department of Endocrinology, Diabetes and Nutrition, Campus Benjamin Franklin, 12203 Berlin, Germany
6
Digital Health—Connected Healthcare, Hasso Plattner Institute, University of Potsdam, 14482 Potsdam, Germany
7
Institute of Social Medicine, Epidemiology and Health Economics, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, 10117 Berlin, Germany
8
Department of Internal and Integrative Medicine, Immanuel Hospital Berlin, 14109 Berlin, Germany
9
Department of Pediatrics, Division of Oncology and Hematology, Charité-Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health, 13353 Berlin, Germany
10
German Center for Diabetes Research (DZD), 85764 Neuherberg, Germany
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Nutrients 2022, 14(18), 3697; https://doi.org/10.3390/nu14183697
Submission received: 2 August 2022 / Revised: 2 September 2022 / Accepted: 4 September 2022 / Published: 7 September 2022
(This article belongs to the Special Issue Mechanisms and Health Effects of Periodic and Intermittent Fasting)

Abstract

:
Accurate dietary analysis of energy, nutrient intake, and meal timing in human studies using traditional dietary assessment methods (e.g., food records) is challenging and time-consuming. The widespread use of smartphones, tablets, and nutrition applications (apps) can overcome some of these problems. The objective of this study was to evaluate the validity of an FDDB smartphone app and food database compared with PRODI®—a professional platform for nutritional counselling using the German Nutrient Database. Dietary records were collected from 10 subjects participating in the crossover intermittent fasting trial for 2 weeks at baseline and during the eating timeframe of 8 h (early or late in the course of the day). The FDDB app and database enabled a quicker and less sophisticated analysis of food composition and timing than the PRODI® software. Good agreement between the methods was found for energy and macronutrient intakes, while the FDDB data on most micronutrients and saturated/unsaturated fat intake were unreliable. In contrast to PRODI®, FDDB provided effective assessment of timely compliance, making it a promising tool for chrononutritional studies. Thus, the FDDB app is comparable to the traditional PRODI® dietary assessment method, and can be effectively used in human dietary trials and medical practice for specific goals.

1. Introduction

The accurate and detailed dietary assessment in human studies using traditional dietary assessment methods (such as handwritten food records) is labor-intensive and time-consuming both for investigators and study participants. Analysis of dietary compliance—including energy and macro/micronutrient intakes, as well as meal timing—in dietary intervention trials represents an additional challenge. Furthermore, conducting chrononutritional trials investigating the effects of specific meal timings requires the assessment of timely compliance. Recent technological developments—in particular, the wide use of smartphones, tablets, and nutrition applications (apps)—can overcome some of these problems.
Smartphone apps to promote healthier lifestyles and improve health—e.g., dietary assessment apps—have developed drastically. Smartphone technology for dietary assessments demonstrating high acceptability and convenience [1,2,3] is widely used by private individuals, and is of great interest for nutritional and metabolic research. Indeed, in high-income countries, smartphone ownership rates are high. The number of smartphone users in Germany has only grown in recent years, amounting to 66.15 million smartphone owners in 2021 [4]. Statistical analysis estimated that smartphone ownership was 94.2% in the age group 14–19 years, 95.5% in the age group 20–29 years, 96% in the age group 30–39 years, and 68.2% in the age group 70+ years [5]. According to the data of the German Obesity Society (DAG), 67% of male and 53% of female Germans are overweight, and one-quarter of these people are obese. Therefore, the potential for using smartphone apps to improve the quality of dietary assessments and support weight management needs to be investigated. An app-based food diary may be more convenient and easier to use than a paper-based diary. In particular, it allows user to complete records at the instant of food intake (e.g., by a scanning a food item’s barcode, or by taking a picture). In this way, errors that may occur due to delayed recording, which is often the case when using a paper-based diary, can be avoided. Smartphone apps also enable rapid transfer of digital data from research participant to researcher. Furthermore, digital solutions allow real-time communication for monitoring the participants’ progress, resulting in an improvement in data quality and dietary compliance in nutritional research.
Further, app-based food tracking might be particularly useful in studies investigating the effects of specific meal timings (often combined with a specific food composition) on study outcomes—so-called chrononutritional studies. In particular, time-restricted eating (TRE)—an approach requiring a shortening of the daily eating window and an adherence to certain meal timings—is of great interest in the scientific community. TRE has been shown to be effective for the prevention and treatment of obesity, diabetes, and other metabolic and non-metabolic disturbances [6,7]. Currently, over 200 TRE trials are ongoing according to the ClinicalTrials.gov database (https://clinicaltrials.gov/ (accessed on 4 July 2022)). Detailed diet compliance assessment is highly important to establish a direct interrelation between trial outcomes and TRE. The potential of smartphone apps to record mealtimes has already been demonstrated by Gill and Panda [8], who developed a smartphone app to record food-intake events in real-time to analyze food patterns. The results showed that more than half of the study cohort had recording durations of approximately 15 h. Furthermore, the restriction to 10–11 h food intake was associated with weight loss [8]. However, apart from the uploading of food pictures and notes by the study participants, there was no integrated database for the detection of food composition [8]. It is becoming clear that real-time recording of food events, combined with accurate recording of food components, could provide a benefit under study conditions. In this regard, dietary apps using a food database appear to be an effective tool to simultaneously track meal timing and food composition in TRE trials. However, despite all of the abovementioned benefits, there are also some limitations when using dietary apps. One important limitation is the questionable accuracy of app-based dietary assessment tools in providing accurate information on the energy and macro/micronutrient intakes, which needs to be investigated further [3,9].
The FDDB Extender app (FDDB Internetportale GmbH, Bremen, Germany) is a smartphone dietary assessment app that is widely used by private users trying to reduce or maintain their body weight. By recording all consumed food items using barcodes or manual search in the database, along with their amounts and the timing of meals, the app provides users with information on their energy as well as macronutrient and micronutrient intakes based on the associated FDDB database. The app indicates daily required calories, which are calculated constantly based on the personal body weight goals. Additionally, the FDDB Extender app allows registration of exercise and calories burned while exercising, which are automatically included in the total summary of energy requirements. This aims at leading users to consciously follow and adapt their eating pattern to achieve their goals in a pleasant and motivating way. In addition to timely records of meal-intake events, the FDDB app also categorizes the meal type (i.e., breakfast, snack, lunch, or dinner), making it a potentially helpful tool for chrononutritional studies. However, it is currently unknown whether the FDDB app is appropriate for use in research, i.e., whether it provides accurate information on the energy and macro/micronutrient intakes comparable with professional dietary assessment software. To the best of our knowledge, to date, only one paper published in 2017 has addressed this question for the FDDB app, comparing the energy contents of 13 selected foods in the FDDB database with the German Food Database (Bundeslebensmittelschlüssel, BLS) [9]. However, no studies conducted on the FDDB validation thus far have been based on the analysis of long-term food records and addressed macro- and micronutrient intakes.
Therefore, the objective of this study was to evaluate the validity of the FDDB smartphone app and food database compared with PRODI® version 6.5 (Nutri-Science GmbH, Freiburg, Germany)—a professional software platform widely used in medical practice and nutritional research in Germany. The study was conducted in the context of a trial on intermittent fasting comparing the effects of early versus late daily timeframes of food restriction.

2. Materials and Methods

2.1. Study Design

The research was conducted in the context of the ChronoFast trial in the outpatient department at the German Institute of Human Nutrition between July 2020 and December 2021. A detailed description of subject screening, inclusion and exclusion criteria, and the study design was published previously [10]. In brief, the ChronoFast trial was a 10-week randomized, controlled, crossover clinical trial performed in female subjects with overweight or obesity. The study included a four-week run-in (baseline) phase and two two-week time-restricted eating (TRE) interventions—(1) early TRE (eTRE) and (2) late TRE (lTRE), which were separated by a two-week washout period. During the intervention periods, the study subjects were instructed to consume their habitual food (and their habitual daily amounts of food) but to reduce their daily eating time window to 8 h. During eTRE, subjects were asked to consume their food between 8 a.m. and 4 p.m.; during lTRE, they were asked to eat between 1 p.m. and 9 p.m. Within the 8-hour eating window, subjects were free to divide their food intake into as many meals or snacks as they desired. Outside the eating window, participants were allowed to consume water and noncaloric drinks—e.g., tea and black coffee without sugar and milk—and limited amounts of very low-caloric diet sodas, mints, or chewing gum with sweeteners to increase compliance. During the run-in and the washout phase, participants were asked to follow their habitual eating window from before the beginning of the study. Throughout the whole study, participants were asked to avoid alcohol consumption and maintain their usual lifestyles, including physical activity and sleep timing. Taken together, the challenge of the trial was to ensure timely compliance, unchanged dietary composition, and the least possible caloric deficit.
The trial was conducted in accordance with the Helsinki Declaration of 1975. The study protocol was reviewed and approved by the Ethical Committee of the University of Potsdam, Germany (EA No. 8/2019). Written informed consent was obtained from all study subjects prior to participation. The study was registered at www.clinicaltrials.gov under the identifier NCT04351672 on 17 April 2020.

2.2. Study Participants and Anthropometric Measurements

The study was conducted on 10 overweight or obese non-diabetic female individuals enrolled in the ChronoFast trial. Inclusion criteria were BMI 25–35 kg/m² and age 18–70 years. All study participants were non-vegetarians and non-vegans, consumed no other special diets, and did not practice any kinds of intermittent fasting at baseline. The study subjects also did not have any eating disorders, severe intestinal diseases, history of bariatric surgery, food allergies, other diseases, or surgeries, nor did they take any medications affecting appetite, as described elsewhere [10].
The anthropometric measurements included height, weight, and body fat percentage. Body weight and height were measured using a digital scale and a wall-mounted stadiometer, respectively. Waist and hip circumferences were measured using a measuring tape. Body composition was measured using bioelectrical impedance analysis (BIA) (Akern), while fat and lean mass (kg and percentage, respectively) were calculated using the BodygramTM software version 1.3 (Akern Srl, Florence, Italy).

2.3. Food Intake Documentation and Nutrient Analysis

The subjects were asked to document all caloric intakes (food selection, amount, and time of each meal) for 14 consecutive days during the run-in period and during both TRE intervention phases (a total of 42 days for every individual). During the screening visit, all study subjects met a dietician, who gave them oral instructions on food documentation and usage of the app, as well as written instructions for reference during the recording period. Participants were instructed to weigh all food whenever possible and supply information on food details (e.g., brand names) and mealtimes. When weighing was not possible (e.g., when dining out), they were instructed to record the food in household measures (cups, glasses, teaspoon, etc.). Participants were explicitly asked to consistently document the meals before they sat down to eat, so that the accuracy of the registered time could be as high as possible. Study participants were able to contact the dietician if they had any questions concerning the diet or food records. Six participants documented their food intakes using paper-based handwritten dietary records, whereas four participants kept an electronic food diary using the aforementioned FDDB Extender app [9].
After collection of the food records, the study investigators analyzed them using both (i) the free FDDB food database (FDDB Internetportale GmbH, https://fddb.info/ (accessed on 4 July 2022)) and (ii) the PRODI 6.5 software (Nutri-Science GmbH, Freiburg, Germany). For analysis, the collected food intake data were incorporated in the FDDB electronic diary or PRODI® software. Food records were analyzed using both FDDB and PRODI® tools for total energy intake, macronutrient composition, and micronutrient composition. Additionally, the FDDB tool was used to assess meal timings and daily eating window durations to monitor participants’ adherence to their designated eating windows. To determine the daily eating window, the time interval between the first and last caloric intake of the day was calculated. In PRODI®, the meal timing analysis was not feasible.

2.4. FDDB Extender App and Food Database

The FDDB Extender app functions as a food diary. Participants log into assigned pseudonymized accounts to keep their information encrypted. By scanning the barcodes of products or by searching for them on their database, subjects can select food items and register the amounts consumed (as a self-defined portion or preset portion size), recording the time it was ingested. The application summarizes a daily food protocol stating the names of the consumed food items along with the specific time of consumption and all of the nutrients according the platform’s database. Visiting the participant’s account, the dietician is able to monitor the food intake amount, composition, and timing at any time.
The nutrient analysis in FDDB is based on the FDDB database. The FDDB platform’s database is derived from FoodData Central of the U.S. Department of Agriculture for most foods (USDA, https://fdc.nal.usda.gov/ (accessed on 4 July 2022)). In the case of German products, the nutritional item information is usually based on the Souci–Fachmann–Kraut database (available online at https://info.sfk.online/ (accessed on 4 July 2022)). For processed foods, public information from manufacturers (e.g., websites) is used as a data source, or app users are responsible for uploading the nutritional information of the products they register by scanning their barcodes. For this, app users often use the nutritional information provided in the table of nutrients on the product packaging. Although newly registered products undergo a detailed examination of macronutrients before being approved for use by other application members, micronutrients are sometimes not listed accurately. Notably, there is no requirement to state other nutrients in food labels in addition to the mandatory energy, total fat, saturated fat, total carbohydrates, sugars, protein, and salt in 100 g or 100 mL. Currently (as of July 2022), the FDDB database includes over 500,000 food items (https://fddb.info/ (accessed on 4 July 2022)).

2.5. PRODI® Software

In parallel, all nutritional protocols were analyzed using PRODI®, which is a professional software platform widely used for nutritional counselling by dieticians in medical practice and nutritional research (https://www.nutri-science.de/software/prodi.php (accessed on 10 May 2021)). The database that this software utilizes is the Federal Victuals Key (BLS: Bundeslebensmittelschlüssel v. 3.02, https://blsdb.de/ (accessed on 10 May 2021)). The BLS is the standard tool used for analyzing consumption surveys in Germany. In total, 100,038 nutrients are enumerated for each of the 15,000 food items indexed. Expert literature, national and international dietary tables, and analytical values from food processing companies were used to gather the nutritional data. National nutritional tables that include approximately 1100 basic victuals were prioritized.

2.6. Statistical Analysis

Statistical analysis was performed using SPSS 25.0 software (SPSS, Chicago, IL, USA). Sampling distribution was analyzed using the Shapiro–Wilk test. Abnormally distributed data were log-transformed before analysis. For the comparison of two groups, the paired Student’s t-test or Wilcoxon test was used, depending on the distribution of the data. For the correlation analysis, Pearson’s or Spearman’s test was used, depending on the distribution of the data. A repeated-measures Bland–Altman analysis [11,12] was used to assess the relative bias (mean difference) and random error (1.96 standard deviation (SD) of the difference) between the FDDB and PRODI® methods. Data are shown as means ± SD. A p-value < 0.05 was considered to be statistically significant.

3. Results

3.1. Participant Characteristics

The participants’ demographics and anthropometric measurements are summarized in Table 1. In total, 10 overweight non-diabetic Caucasian women participated in the study. The mean age of the participants was 61.4 ± 7.1 years, with a mean BMI of 31.4 ± 2.7 kg/m2, a mean waist circumference of 98.1 ± 10.6 cm, and a mean body fat percentage of 40.2 ± 7.9%. All of the study’s subjects consumed no special diets and did not practice any kinds of intermittent fasting at baseline.

3.2. Energy and Macronutrient Intakes at Baseline and during the TRE Periods

To verify dietary compliance, energy and macronutrient intakes at baseline and during both time-restricted eating phases (eTRE and lTRE) were assessed using the FDDB and PRODI databases. Both analyses showed that, despite extensive dietary advice, mean daily caloric intake was slightly lower during both interventions compared to the baseline period (FDDB: eTRE: −215 kcal/day, p = 0.023; lTRE: −263 kcal/day, p = 0.002; PRODI: eTRE: −252 kcal/day, p = 0.015; lTRE: −278 kcal/day, p = 0.005,) (Figure 1A,B. Daily macronutrient distribution remained unchanged, and was 37.4/45.1/15.8/1.8 EN% (fat/carbs/protein/fibers, respectively) at baseline, 39.4/43.7/15.9/2.0 EN% during eTRE, and 40.4/41.8/16.5/1.9 EN% during lTRE in the FDDB analysis. PRODI® analysis resulted in very similar data on macronutrient distribution: 42.7/42.9/15.2/2.2 EN% (fat/carbs/protein/fiber, respectively) at baseline, 40.7/44.2/15.4/2.6 EN% during eTRE, and 43.1/41.3/16.4/2.1 EN% during lTRE (Figure 1C,D).
Analysis of the meal timing by FDDB showed that all participants successfully reduced their eating windows to under 8 h per day during both intervention phases (baseline: 12.15 ± 1.65 h; eTRE: 7.20 ± 0.44 h; lTRE: 6.84 ± 0.70 h) (Figure 1E). Timely compliance with TRE, calculated as the percentage of days when participants ate within the targeted 8 h eating window, was 95.2 ± 6.6% for eTRE and 98.5 ± 3.3% for lTRE. Analysis of the ingestion timing by FDDB is easy to perform and time-saving, because the mealtime is recorded automatically during barcode scanning or while entering consumed food items, and can later be exported in the form of an Excel document for statistical analysis. In the PRODI® analysis, the automatic mealtime recording and export are not feasible, and can be performed only via the time-intensive manual processing of daily food records.

3.3. Comparison of the FDDB Tool with PRODI® Software

To perform inter-method comparisons, differences between the FDDB and PRODI® results were calculated, and correlation analysis was conducted using the combined data of all three trial phases. There were highly significant correlations between the FDDB and PRODI® tools for daily energy and macronutrient intakes (correlations ranging from 0.849 to 0.929; p ≤ 10−8) (Table 2). Macronutrients showed only minor differences for the mean percentage intakes of protein (2.3%, p = 0.033) and fat (7.3%, p = 1.07 × 10−4), as well as intakes in grams of protein (3.9%, p = 0.014), carbohydrates (3.3%, p = 0.031), and fat (7.3%, p = 1.07 × 10−4). In agreement with this, the Bland–Altman graphs indicated that individual differences between the two tools were within acceptable ranges (i.e., limits of agreement) for energy, carbohydrate, fat, and protein intakes, with few outliers (Figure 2).
Saturated fat and cholesterol intakes were strongly underreported with the FDDB database (−40.3%, p = 5.04 × 10−10 and −61.1%, p = 3.87 × 10−15, respectively), showing correspondingly low correlation coefficients (r = 0.532 and r = 0.625, respectively) (Table 2). For fiber, sugar, and salt, the intake differences were 10–14% between the two tools. Data on vitamins D, E, B1, B2, B6, and B12 were markedly different between the FDDB and PRODI® tools (p < 0.05), and their correlations were lower (ranging from 0.378 to 0.745; p ≤ 0.05) or not significant, as shown for vitamin A. Only for vitamin C was the difference between the two tools below 10% (−8.6%, p = 0.017). For minerals (i.e., potassium, magnesium, calcium, iron, phosphorus, copper, zinc, chloride, iodide, manganese, sulfur), the intake was mostly underreported in the FDDB analysis, and the correlations ranged from 0.414 to 0.835 (p ≤ 0.05). Alcohol intake showed the highest discrepancy between the two analysis tools, being approximately 4.5-fold higher in the FDDB tool (p = 0.014).

4. Discussion

Our results showed that the FDDB app and database enabled an automatic recording of the timing and duration of the daily eating window, providing an effective assessment of timely compliance in our chrononutritional trial, whereas the meal timing analysis using the PRODI® software required time-intensive manual processing of daily food records. Furthermore, FDDB showed a good agreement with the PRODI® software in energy and macronutrient intake data. On the other hand, the FDDB data on most micronutrients and saturated/unsaturated fat intake were inaccurate. In sum, the FDDB app and database seem to allow a more accurate, quicker, and less sophisticated analysis of food timing than conventional approaches, with energy intake and macronutrient composition seeming reliable, making it a potentially attractive tool for nutritional and especially chrononutritional research.
In the present work, we found a good agreement between these two methods for energy intake during the run-in phase and during the eTRE and lTRE interventions, and the total energy intake values obtained in both analyses showed a high correlation coefficient. The mean individual difference was good, with −31.5 kcal (LOA −277 kcal, 214 kcal) and only one outlier. This finding is in contrast to the data of Holzmann et al. [9], who showed a large discrepancy of up to 30.6% in the energy contents of several food items between FDDB and BLS data. This discrepancy might be explained by the fact that only 13 food items were assessed in [7], whereas our research investigated long-term dietary records (for a total of 42 days) in terms of the dietary intervention study.
Furthermore, our analysis showed a high correlation of macronutrient intakes for carbohydrates, protein, and fat, with only minor differences between the two tools, as a percentage of daily energy intake and in grams (2.3–7.3%). In agreement with this, the Bland–Altman graphs indicated that individual differences between the two methods were within acceptable ranges, in compliance with the 95% level of agreement, with a 1.96 standard deviation and few outliers. Thus, our data provided a clear statement that both dietary software platforms show almost identical data for macronutrients and energy levels when long-term nutritional diaries are analyzed. Thus, for energy content and macronutrients, FDDB provides data comparable to the established professional software platform PRODI®, and could be used effectively in nutritional research. In particular, the FDDB app and database were used in a recently published trial to compare energy and macronutrient intakes during 8 weeks of TRE vs. continuous energy restriction intervention and 6 weeks of follow-up in 42 overweight subjects [13]. Notably, in this study, most of the study participants stated that the documentation was not an additional stress factor in their everyday life [13]. Two dietary intervention trials—one TRE trial (NCT04351672) [10] and one plant-based nutrition trial (NCT03901183)—using the FDDB app to monitor energy and macronutrient intakes as well as meal timings, are currently ongoing.
Fiber, salt, and sugar exhibited high correlation coefficients and moderate differences of 10–14% between the two tools, showing that, for these nutrients, FDDB also provides data comparable to the professional software platform PRODI®. However, saturated fat and cholesterol intakes were strongly underreported with the FDDB database (−40.3% and −61.1%, respectively), showing low correlation coefficients. Moreover, alcohol intake showed 4.5-fold higher values with FDDB than with PRODI®. However, the subjects were asked not to drink alcohol for the whole study duration, so that the amounts of alcohol detected by FDDB (but not by PRODI®) would mainly come from the food (such as apple juice or similar), which might explain the high discrepancy. Furthermore, data on vitamins A, D, E, B1, B2, B6, and B12 were markedly different between the FDDB and PRODI® tools. Only vitamin C demonstrated a difference between the two tools below 10%, and showed the highest correlation coefficient for the software comparison (r = 0.697). A possible reason for is that the information on vitamin C content is often explicitly listed on products, giving FDDB app users the ability to enter detailed information about the contents of ascorbic acid present in industrialized products. In contrast, listing the contents of other vitamins in processed foods is not considered to be as relevant. The same applies to minerals. Indeed, for minerals (i.e., potassium, magnesium, calcium, iron, phosphorus, copper, zinc, chloride, iodide, manganese, sulfur), the intakes were mostly underreported in FDDB compared to PRODI® data. As mentioned previously, disclosure of micronutrient contents on the nutrient tables of processed foods is not mandatory. Therefore, it is likely that no registration of the correct amounts of minerals and vitamins is present on the FDDB extender smartphone application. A lot of the presented data in the FDDB database are collected by users or from other databases, making them broad but at the same time imprecise, as not all food products available on the market are labeled with complete nutritional information. In contrast, all food products registered on PRODI® have been analyzed with regard to all micronutrients, and present precise data on them. Taken together, our data suggest that the FDDB app does not present reliable data on saturated fat, cholesterol, vitamin, and mineral contents; thus, the application would not be suitable for dietary assessment in trials focused on the influence of these nutrients.
In recent last years, a range of studies have evaluated the feasibility and accuracy of smartphone apps for dietary assessment, demonstrating significant interest of the scientific community in this topic. One of the first studies in this field, conducted in the UK, evaluated a smartphone app named My Meal Mate (MMM), initially developed to facilitate weight loss, by comparing a digital 7-day food diary to 24-hour dietary recalls [1]. The study showed a good agreement in energy intake between the methods (a difference of 218 kJ/d, with LOAs ranging from −2434 kJ to 2022 kJ), and found the app to be useful for the assessment of group means of carbohydrate, fat, and protein intakes. Two other studies comparing smartphone apps for dietary assessment in epidemiological research with 24-hour dietary recalls also showed reliable results on the energy and macronutrient intakes at the group level [14,15]. Similarly, two clinical trials that compared mean macronutrient data between professional software platforms for the evaluation of dietary records and electronic diet recording showed no significant deviations of the macronutrients, and high correlations between both methods [16,17]. Another study compared a tablet app for assessing dietary intakes with the measured food intake/food waste method in military personnel, and provided satisfactory results in the assessment of energy, macronutrient, and selected micronutrient intakes, whereas some micronutrients showed large deviations [18]. Notably, a smartphone image-based dietary assessment app tested among Canadian adults showed large deviations from 3-day food diaries in a range of nutrients, including total energy, protein, carbohydrates, fat, saturated fatty acids, and iron [19], suggesting that the accuracy of smartphone app data has to be validated before utilization in dietary trials.
Common advantages and limitations in using dietary apps for research purposes in general, and the FDDB app in particular, must be discussed. In nutritional and chrononutritional trials, the accurate analysis of caloric intake, food composition, and timing plays an essential role in the assessment of dietary compliance and of the physiological and metabolic changes in response to the modification of nutritional patterns. To this end, using digital food records in food-tracking apps might be more advantageous compared to traditional methods, such as paper-based diaries or 24-hour recalls. Indeed, the usage of smartphone apps such as the FDDB app helps to avoid a time-intensive transfer of handwritten protocol data into food database software by a dietician, and allows records to be completed directly during the meal. Obstacles such as poor readability of handwritten food diaries or adding food to the diary afterwards could be avoided through documentation via smartphone apps.
Furthermore, the number of food items in the database must be considered to decide on the method of dietary analysis in the clinical trial. Notably, the FDDB database contains about 531,350 food items (as of 19 July 2022), with a daily increase of hundreds of new foods, and is therefore more extensive than the PRODI® database. This makes food searches easier for both the recording by study participants and the further analysis by researchers. Another advantage of using the FDDB Extender app is the opportunity to create recipes for subjects to cook at home, and of a simple down-calculation to one portion with proportional listing of the individual food items.
Even though FDDB can be used as an application for smartphones, it is also possible to log in to user accounts via computer, which makes it easy for the study staff to monitor and evaluate the nutritional data. By visiting the participant’s account, the dietician can check the amount of food intake, its composition, and its timing, and in this way monitor dietary compliance almost in “real time”. A monitoring system that runs parallel to the study helps to avoid protocol errors. If needed, participants can be contacted immediately to receive support, thereby maintaining the compliance. Notably, analysis of dietary records using the PRODI® software is not possible in “real time”, but only after the collection of records, excluding the possibility of rapid feedback and food behavior correction of study participants. Moreover, the meal timing analysis in the PRODI® software can be performed only via the time-intensive manual processing of daily food records. Furthermore, using the FDDB smartphone app also allows study staff to monitor possible weight fluctuations and rapidly detect possible causes, e.g., deviations in eating patterns or usual calorie intake. This is essential for both isocaloric and weight loss trials. Therefore, our findings show that the FDDB app can potentially be used for such specific aims as research monitoring and, if needed, for the quick correction of timely compliance, caloric intake, and macronutrient intake.
Using dietary apps for research purposes also has several limitations. In particular, some smartphone-app-based dietary assessment tools are based on photographic images of meals, where the manual interpretation and decoding of images remain labor-intensive, and might provide an imprecise information on the caloric intake and nutrient composition [3]. For this reason, most of the currently available dietary assessment apps are similar to conventional tools, i.e., food diaries and 24-hour recalls, representing a form of self-reporting. A well-known limitation in all self-reported dietary assessments is conscious or unconscious under-reporting, which can result in serious observation and interpretation bias [20]. Nevertheless, using smartphone apps directly during the meal might markedly reduce the under-reporting and associated misinterpretation [1,21]. Moreover, the usage of apps—especially those that show an individual overview of optimal caloric and macronutrient intake—may lead to changes in eating behavior and weight loss even at baseline, resulting in data bias. This effect has already been discussed by Gill and Panda [8], who used the app “myCircadianClock” (mCC) with photo documentation to record eating times and patterns. To avoid changes in eating behavior, uploaded food images and their timestamps were immediately deleted from the participants’ smartphones after being transmitted to a server [8]. Wilkinson et al. [22] highlighted the possible problem of changes in behavioral patterns, and referred to the difficulty of tracking consistent use of the mCC app in a chrononutritional study.
Finally, using a smartphone app for food recording could be challenging, especially for the older generation, while younger generations might benefit from it. For this reason, using an app correctly could be more difficult to learn than handwritten logging, as already reported in a previous randomized controlled trial [23]. Therefore, alternatives—e.g., handwritten documentation—should be provided. Furthermore, detailed instruction in the use of the app by a dietician must be given to each participant. In this respect, the development of instructions in the form of an online presentation might be a promising tool to train subjects in advance, which could also be effectively used under the present conditions of the COVID-19 pandemic.
We also have to mention a possible limitation of our research concerning the methodology of the meal recording. Indeed, six subjects used a paper-based protocol that was transferred in parallel into FDDB and into PRODI® for subsequent analysis. In contrast, four subjects entered their diets directly into the FDDB app, which means that, for these individuals, meal records were first exported from FDDB in the form of an Excel table, and then transferred to PRODI® for analysis. Notably, the main aim of our study was to compare the results of the dietary record analysis using the FDDB vs. PRODI® databases; therefore, inconsistency in the meal recording would not have a strong effect on these data. The flexibility in methods of dietary recording allowed us to achieve higher compliance with the study protocols in our trial, because older subjects mostly preferred handwritten protocols. Nevertheless, as mentioned above, the use of digital protocols via app can affect the quality of food recording. Therefore, in future studies, it could be feasible to collect a paper-based diary simultaneously with a digital FDDB diary in the same subjects, and to verify in this way whether the different methods of recording meals affect the results.
Finally, due to the relatively small number of subjects and the high number of tests in this study, we must acknowledge that chance findings cannot be ruled out. From this reason, and to confirm the generalizability of our results, larger studies and replication studies in other populations are needed.

5. Conclusions

In this study, the FDDB smartphone app demonstrated a good agreement in the obtained energy and macronutrient intake data with values generated by the traditional PRODI® dietary assessment method. Furthermore, the FDDB smartphone app allows a simultaneous monitoring of meal timing and dietary composition, representing a practical and effective tool for the rapid (or even real-time) assessment of timely caloric and macronutrient compliance in chrononutritional studies. Although FDDB data on intakes of most micronutrients and saturated/unsaturated fat were unreliable, the addition and revision of these data in the FDDB database could possibly further increase its potential for usage in human dietary trials and medical practice.
In summary, the FDDB app and database enabled a quicker and less sophisticated diet recording for study participants, as well as a more effective dietary analysis for dieticians than the PRODI® software, and could be beneficially used for the assessment of energy and macronutrient intakes as well as meal timing in nutritional research.

Author Contributions

Conceptualization, O.P.-R.; methodology, I.B.M., N.S. and O.P.-R.; formal analysis, I.B.M., B.P., J.S. and B.S.; investigation, I.B.M.; resources, O.P.-R.; data curation, I.B.M., B.P., J.S. and B.S.; writing—original draft preparation, I.B.M., B.P. and O.P.-R.; writing—review and editing, O.P.-R., N.S., D.A.K.-L., B.S. and A.M.; visualization, O.P.-R.; supervision, O.P.-R.; project administration, O.P.-R.; funding acquisition, O.P.-R. All authors have read and agreed to the published version of the manuscript.

Funding

The study is funded by the German Science Foundation (DFG RA 3340/3-1, O.P.-R.), by the German Diabetic Association (DDG, Allgemeine Projektförderung, 2020, O.P.-R.; Adam Heller Funding provided by DDG/Abbott, 2021, O.P.-R.), and by the European Association for the Study of Diabetes (EASD, Morgagni Prize, 2020, O.P.-R.). The authors assure that neither sponsors nor the providers of the tested software had any influence on the trial at any stage.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Ethics Committee of the University of Potsdam (application No. 8/2019, approved on 25 October 2019).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Acknowledgments

We acknowledge all study participants for their cooperation. We gratefully thank Manuela Bergmann for support in the conduction of the clinical trial, Juliane Roeder, Melanie Hannemann, and Lothar Napieralski for their work with the study subjects, as well as Katja Treu and Christiana Gerbracht for their help in the preparation of nutritional counselling and dietary record analysis.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Carter, M.C.; Burley, V.J.; Nykjaer, C.; Cade, J.E. ‘My Meal Mate’ (MMM): Validation of the diet measures captured on a smartphone application to facilitate weight loss. Br. J. Nutr. 2013, 109, 539–546. [Google Scholar] [CrossRef]
  2. Hutchesson, M.J.; Rollo, M.E.; Callister, R.; Collins, C.E. Self-monitoring of dietary intake by young women: Online food records completed on computer or smartphone are as accurate as paper-based food records but more acceptable. J. Acad. Nutr. Diet. 2015, 115, 87–94. [Google Scholar] [CrossRef]
  3. Sharp, D.B.; Allman-Farinelli, M. Feasibility and validity of mobile phones to assess dietary intake. Nutrition 2014, 30, 1257–1266. [Google Scholar] [CrossRef] [PubMed]
  4. Smartphone Users by Country Worldwide 2021. Published by Statista Research Department. 11 August 2022. Available online: https://www.statista.com/statistics/748053/worldwide-top-countries-smartphone-users/ (accessed on 4 July 2022).
  5. Share of Smartphone Users in Germany 2021, by Age Group. Published by Evgenia Koptyug, 14 December 2021. Available online: https://www.statista.com/statistics/469969/share-of-smartphone-users-in-germany-by-age-group/ (accessed on 4 July 2022).
  6. Schuppelius, B.; Peters, B.; Ottawa, A.; Pivovarova-Ramich, O. Time Restricted Eating: A Dietary Strategy to Prevent and Treat Metabolic Disturbances. Front. Endocrinol. 2021, 12, 683140. [Google Scholar] [CrossRef]
  7. Varady, K.A.; Cienfuegos, S.; Ezpeleta, M.; Gabel, K. Clinical application of intermittent fasting for weight loss: Progress and future directions. Nat. Rev. Endocrinol. 2022, 18, 309–321. [Google Scholar] [CrossRef]
  8. Gill, S.; Panda, S. A Smartphone App Reveals Erratic Diurnal Eating Patterns in Humans that Can Be Modulated for Health Benefits. Cell Metab. 2015, 22, 789–798. [Google Scholar] [CrossRef]
  9. Holzmann, S.L.; Pröll, K.; Hauner, H.; Holzapfel, C. Nutrition apps: Quality and limitations. An explorative investigation on the basis of selected apps. Ernährungs Umsch. 2017, 64, 80–89. [Google Scholar]
  10. Peters, B.; Koppold-Liebscher, D.A.; Schuppelius, B.; Steckhan, N.; Pfeiffer, A.F.H.; Kramer, A.; Michalsen, A.; Pivovarova-Ramich, O. Effects of Early vs. Late Time-Restricted Eating on Cardiometabolic Health, Inflammation, and Sleep in Overweight and Obese Women: A Study Protocol for the ChronoFast Trial. Front. Nutr. 2021, 8, 765543. [Google Scholar] [CrossRef]
  11. Bland, J.M.; Altman, D.G. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1986, 1, 307–310. [Google Scholar] [CrossRef]
  12. Bland, J.M.; Altman, D.G. Agreement between methods of measurement with multiple observations per individual. J. Biopharm. Stat. 2007, 17, 571–582. [Google Scholar] [CrossRef]
  13. Isenmann, E.; Dissemond, J.; Geisler, S. The Effects of a Macronutrient-Based Diet and Time-Restricted Feeding (16:8) on Body Composition in Physically Active Individuals-A 14-Week Randomised Controlled Trial. Nutrients 2021, 13, 3122. [Google Scholar] [CrossRef]
  14. Rangan, A.M.; O’Connor, S.; Giannelli, V.; Yap, M.L.; Tang, L.M.; Roy, R.; Louie, J.C.; Hebden, L.; Kay, J.; Allman-Farinelli, M. Electronic Dietary Intake Assessment (e-DIA): Comparison of a Mobile Phone Digital Entry App for Dietary Data Collection With 24-Hour Dietary Recalls. JMIR Mhealth Uhealth 2015, 3, e98. [Google Scholar] [CrossRef]
  15. Ambrosini, G.L.; Hurworth, M.; Giglia, R.; Trapp, G.; Strauss, P. Feasibility of a commercial smartphone application for dietary assessment in epidemiological research and comparison with 24-h dietary recalls. Nutr. J. 2018, 17, 5. [Google Scholar] [CrossRef]
  16. Benedik, E.; Korousic Seljak, B.; Hribar, M.; Rogelj, I.; Bratanic, B.; Orel, R.; Fidler Mis, N. Comparison of a Web-Based Dietary Assessment Tool with Software for the Evaluation of Dietary Records. Zdr. Varst. 2015, 54, 91–97. [Google Scholar] [CrossRef]
  17. Raatz, S.K.; Scheett, A.J.; Johnson, L.K.; Jahns, L. Validity of electronic diet recording nutrient estimates compared to dietitian analysis of diet records: Randomized controlled trial. J. Med. Internet Res. 2015, 17, e21. [Google Scholar] [CrossRef]
  18. Ahmed, M.; Mandic, I.; Lou, W.; Goodman, L.; Jacobs, I.; L’Abbe, M.R. Validation of a Tablet Application for Assessing Dietary Intakes Compared with the Measured Food Intake/Food Waste Method in Military Personnel Consuming Field Rations. Nutrients 2017, 9, 200. [Google Scholar] [CrossRef]
  19. Ji, Y.; Plourde, H.; Bouzo, V.; Kilgour, R.D.; Cohen, T.R. Validity and Usability of a Smartphone Image-Based Dietary Assessment App Compared to 3-Day Food Diaries in Assessing Dietary Intake Among Canadian Adults: Randomized Controlled Trial. JMIR Mhealth Uhealth 2020, 8, e16953. [Google Scholar] [CrossRef]
  20. Livingstone, M.B.; Black, A.E. Markers of the validity of reported energy intake. J. Nutr. 2003, 133 (Suppl. 3), 895S–920S. [Google Scholar] [CrossRef]
  21. Illner, A.K.; Freisling, H.; Boeing, H.; Huybrechts, I.; Crispim, S.P.; Slimani, N. Review and evaluation of innovative technologies for measuring diet in nutritional epidemiology. Int. J. Epidemiol. 2012, 41, 1187–1203. [Google Scholar] [CrossRef]
  22. Wilkinson, M.J.; Manoogian, E.N.C.; Zadourian, A.; Lo, H.; Fakhouri, S.; Shoghi, A.; Wang, X.; Fleischer, J.G.; Navlakha, S.; Panda, S.; et al. Ten-Hour Time-Restricted Eating Reduces Weight, Blood Pressure, and Atherogenic Lipids in Patients with Metabolic Syndrome. Cell Metab. 2020, 31, 92–104.e105. [Google Scholar] [CrossRef]
  23. Acharya, S.D.; Elci, O.U.; Sereika, S.M.; Styn, M.A.; Burke, L.E. Using a personal digital assistant for self-monitoring influences diet quality in comparison to a standard paper record among overweight/obese adults. J. Am. Diet. Assoc. 2011, 111, 583–588. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Energy and macronutrient intakes and eating time windows in the trial: Food record analysis was conducted using the FDDB and PRODI® tools for energy intake (A,B), macronutrient intake (EN%, C,D), and meal timing (E) at baseline and during both periods of the time-restricted eating (eTRE and lTRE). EN%, percentage of total energy intake; eTRE, early time-restricted eating; lTRE, late time-restricted eating; ** p ≤ 0.01.
Figure 1. Energy and macronutrient intakes and eating time windows in the trial: Food record analysis was conducted using the FDDB and PRODI® tools for energy intake (A,B), macronutrient intake (EN%, C,D), and meal timing (E) at baseline and during both periods of the time-restricted eating (eTRE and lTRE). EN%, percentage of total energy intake; eTRE, early time-restricted eating; lTRE, late time-restricted eating; ** p ≤ 0.01.
Nutrients 14 03697 g001
Figure 2. Repeated-measures Bland-Altman plots of the differences in intakes analyzed using the FDDB and PRODI tools against the mean values for the two methods for (A) energy, (B) carbohydrates, (C) fat, and (D) protein. The solid line indicates the mean difference, while the dashed lines indicate the 95% limits of agreement (LOAs) (1.96 SD) for nutrient intake. EN%, relative percentage energy intake of total macronutrient intake.
Figure 2. Repeated-measures Bland-Altman plots of the differences in intakes analyzed using the FDDB and PRODI tools against the mean values for the two methods for (A) energy, (B) carbohydrates, (C) fat, and (D) protein. The solid line indicates the mean difference, while the dashed lines indicate the 95% limits of agreement (LOAs) (1.96 SD) for nutrient intake. EN%, relative percentage energy intake of total macronutrient intake.
Nutrients 14 03697 g002
Table 1. Baseline characteristics of the study participants.
Table 1. Baseline characteristics of the study participants.
Characteristicsn = 10
Age (year)61.4 ± 7.1
Gender (male/female)0/10
Height (cm)162 ± 7
Weight (kg)82.7 ± 10.3
BMI (kg/m2)31.4 ± 2.7
Waist circumference (cm)98.1 ± 10.6
Hip circumference (cm)109.8 ± 4.9
Waist-to-hip ratio0.89 ± 0.09
Body fat (%)40.2 ± 7.9
Table 2. Daily energy and nutrient intakes analyzed using the PRODI® and FDDB tools.
Table 2. Daily energy and nutrient intakes analyzed using the PRODI® and FDDB tools.
NutrientsPRODIFDDBCorrelationDifference FDDB vs. PRODIp-Value *
Mean ± SDMean ± SDr (p)Δ%
Energy (kcal)1796 ± 3281827 ± 3280.926 (2.27 × 10−13)17.60.178
Protein (g)66.9 ± 13.769.5 ± 13.30.921 (5.36 × 10−13)3.90.014
Protein (EN%)15.7 ± 2.016.0 ± 2.10.907 (5.26 × 10−12)2.30.033
Carbohydrates (g)185.6 ± 34.5191.9 ± 39.80.929 (1.31 × 10−13)3.30.031
Carbohydrates (EN%)43.6 ± 4.944.4 ± 5.10.759 (1.17 × 10−6)1.80.231
Fat (g)80.8 ± 20.078.1 ± 18.00.849 (2.96 × 10−9)−3.40.166
Fat (EN%)41.4 ± 5.038.4 ± 4.50.699 (1.71 × 10−5)−7.31.07 × 10−4
Saturated fat (g)34.7 ± 9.020.7 ± 7.60.532 (0.003)−40.35.04 × 10−10
Cholesterol (mg)317 ± 90124 ± 490.625 (2.21 × 10−4)−61.13.87 × 10−15
Fiber (g)20.7 ± 7.217.8 ± 6.80.745 (2.29 × 10−6)−13.60.002
Alcohol (g)0.90 ± 1.624.93 ± 23.690.527 (2.77 × 10−3)4480.014
Sugar (g)79.0 ± 23.070.9 ± 22.90.893 (3.39 × 10−11)−10.32.35 × 10−4
Salt (g)5.74 ± 1.744.91 ± 1.790.754 (3.63 × 10−6)−14.55.88 × 10−4
Vitamin A (mg)0.75 ± 0.661.33 ± 2.560.317 (0.088)76.00.805
Vitamin D (µg)3.53 ± 3.061.32 ± 0.810.500 (0.005)−62.64.07 × 10−5
Vitamin E (mg)11.60 ± 3.656.29 ± 5.860.725 (5.85 × 10−6)−45.84.14 × 10−9
Vitamin B1 (mg)1.05 ± 0.290.60 ± 0.380.455 (0.012)−42.92.59 × 10−5
Vitamin B2 (mg)1.19 ± 0.340.89 ± 0.510.554 (0.002)−26.13.45 × 10−4
Vitamin B6 (mg)1.28 ± 0.391.50 ± 1.660.590 (0.001)17.28.04 × 10−2
Vitamin B12 (µg)4.42 ± 1.852.16 ± 1.330.378 (0.039)−51.16.55 × 10−9
Vitamin C (mg)90.7 ± 50.882.9 ± 55.70.697 (1.91 × 10−5)−8.60.017
Potassium (mg)2568 ± 7351418 ± 6520.835 (9.66 × 10−9)−44.83.57 × 10−14
Magnesium (mg)287 ± 79137 ± 660.835 (9.66 × 10−9)−52.31.49 × 10−15
Calcium (mg)598 ± 150360 ± 1560.679 (3.71 × 10−5)−39.81.68 × 10−11
Iron (mg)11.84 ± 3.304.95 ± 2.420.749 (1.88 × 10−6)−58.29.15 × 10−16
Phosphorus (mg)1080 ± 239498 ± 2260.624 (2.28 × 10−4)−53.99.19 × 10−16
Copper (mg)1708 ± 5021184 ± 15190.272 (0.146)−30.75.71 × 10−4
Zinc (mg)8.82 ± 2.013.89 ± 1.810.539 (2.10 × 10−3)−55.91.73 × 10−6
Chloride (mg)4989 ± 45061338 ± 9680.618 (2.75 × 10−4)−73.21.73 × 10−6
Fluoride (mg)586 ± 4081024 ±18240.427 (0.019)74.80.237
Iodide (µg)63.3 ± 25.994.9 ± 302.10.414 (0.023)50.04.90 × 10−4
Manganese (mg)4447 ± 23122069 ± 16000.711 (1.06 × 10−5)−53.51.73 × 10−6
Sulfur (g)645 ± 272226 ± 1390.667 (5.74 × 10−5)64.91.73 × 10−6
* p-Value is the significance level for differences between two methods. EN%, percentage of total energy intake.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Baum Martinez, I.; Peters, B.; Schwarz, J.; Schuppelius, B.; Steckhan, N.; Koppold-Liebscher, D.A.; Michalsen, A.; Pivovarova-Ramich, O. Validation of a Smartphone Application for the Assessment of Dietary Compliance in an Intermittent Fasting Trial. Nutrients 2022, 14, 3697. https://doi.org/10.3390/nu14183697

AMA Style

Baum Martinez I, Peters B, Schwarz J, Schuppelius B, Steckhan N, Koppold-Liebscher DA, Michalsen A, Pivovarova-Ramich O. Validation of a Smartphone Application for the Assessment of Dietary Compliance in an Intermittent Fasting Trial. Nutrients. 2022; 14(18):3697. https://doi.org/10.3390/nu14183697

Chicago/Turabian Style

Baum Martinez, Isabella, Beeke Peters, Julia Schwarz, Bettina Schuppelius, Nico Steckhan, Daniela A. Koppold-Liebscher, Andreas Michalsen, and Olga Pivovarova-Ramich. 2022. "Validation of a Smartphone Application for the Assessment of Dietary Compliance in an Intermittent Fasting Trial" Nutrients 14, no. 18: 3697. https://doi.org/10.3390/nu14183697

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop