Next Article in Journal
A Distinct Pattern of Circulating Amino Acids Characterizes Older Persons with Physical Frailty and Sarcopenia: Results from the BIOSPHERE Study
Previous Article in Journal
Possible Role of CYP450 Generated Omega-3/Omega-6 PUFA Metabolites in the Modulation of Blood Pressure and Vascular Function in Obese Children
 
 
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Field Testing of the Use of Intake24—An Online 24-Hour Dietary Recall System

1
Human Nutrition Research Centre, Institute of Health & Society, Newcastle University, Newcastle upon Tyne NE2 4HH, UK
2
Open Lab, School of Computing Science, Newcastle University, Newcastle upon Tyne NE4 5TG, UK
*
Author to whom correspondence should be addressed.
Nutrients 2018, 10(11), 1690; https://doi.org/10.3390/nu10111690
Received: 27 September 2018 / Revised: 30 October 2018 / Accepted: 2 November 2018 / Published: 6 November 2018

Abstract

:
Dietary assessment is important for monitoring and evaluating population intakes. Online tools can reduce the level of participant burden and the time taken to complete records, compared with other methods. The study aimed to field test an online dietary recall tool (Intake24) to test the suitability for collecting dietary information in Scottish national surveys and to develop the system based on feedback and emerging issues. Previous Scottish Health Survey participants, aged 11+ years, were invited to complete Intake24 and provide feedback about it. Of those who agreed to take part, 60% completed at least one recall. Intake24 was found to be user-friendly, enjoyable to use, and easy to follow and understand. Users agreed they would like to use Intake24 often, (44% compared with 15% who disagreed) and >75% felt the system accurately captured their dietary intakes. The main challenge reported was finding foods within the database. Of those completing fewer recalls than requested, the majority reported that they believed they had completed the required number or reported not receiving emails requesting they complete a further recall. Intake24 was found to be a user-friendly tool allowing dietary assessment without interviewer presence. Feedback indicated the method for recall reminders needs to be refined and tailored.

1. Introduction

Dietary assessment is important for monitoring and evaluating dietary intakes of a population. The use of online dietary recalls as a method of dietary assessment has been found to reduce the level of burden on participants and reduce the time taken to complete records, compared with other assessment methods [1]. The multiple pass method (MPM) [2] allows detailed dietary information to be obtained whilst avoiding the use of time consuming and burdensome methods such as the weighing of foods [1]. Online tools allow large sample sizes to be targeted and there is no need for the presence of an interviewer; they ensure that coding is consistent and enable much faster and cheaper dietary analysis to be conducted, with only minimal manual data entry required [3]. There is evidence that 24-h recalls and food diaries provide more accurate and less biased estimates of usual dietary intake than food frequency questionnaires (FFQs) and that two to four recalls are better than FFQs for estimating usual dietary intake of all but those food groups which are rarely consumed [4]. There are a number of online dietary tools worldwide including myfood24 (UK), ASA24 (USA) and YANA-C (Belgium), all of which are based on an automated MPM [5,6,7].
Intake24 is an online 24-h dietary recall tool that allows users to self-report their dietary intake. The system is based on the automated MPM and has over 2400 food photographs of more than 100 foods for portion size estimation based on the portion sizes of foods reported in the UK National Diet and Nutrition Surveys (NDNS) [8]. These photos have been validated in a feeding study and a relative validation against four-day weighed intake records [9,10]. The database contains more than 2300 foods and is regularly expanded to include new foods. It has a ‘missing foods’ tool allowing users to highlight food/drinks that are not in the database and there is a bespoke spelling correction system which handles most cases of misspelled food names. There is a function allowing participants to add their own recipes and a ‘Make your own sandwich/salad’ function enabling participants to add fillings and other items to their sandwich/salad. The system was developed by an iterative process involving four cycles of user-testing and development [11] and it was compared against interviewer-led recalls in a relative validation study [12].
Intake24 has a video tutorial explaining the features of the system and there are contextual help buttons describing the functions of the different aspects.
The aim of the study was to test the usability of Intake24 in the general population aged 11–65+ years (as it was originally developed for 11–24 year-olds) and to further develop the system based on user feedback and emerging issues. It also aimed to assess the suitability of Intake24 as a tool for collecting dietary information in Scottish national surveys.

2. Materials and Methods

Ethical approval for the study was granted by the Newcastle University Faculty of Medical Sciences Ethics Committee (00875/2015).
In collaboration with ScotCen Social Research (a part of NatCen Social Research), 1000 participants who had previously taken part in the Scottish Health Survey (SHeS), 50% in 2013 and 50% in 2014 aged 11 years and over, were invited to take part in the study. The population sample was stratified by age, gender and deprivation using the Scottish Index of Multiple Deprivation (SIMD) [13]. A minimum of 20 people in each separate stratum were selected with over-sampling in sub-sets of the population in which digital technology adoption and frequency of use is known to be low, particularly older people and those living in the most deprived areas [14]. One thousand participants were approached in order to ensure sufficient numbers to allow meaningful analysis by the stratified sample.
Introductory letters were sent in the post and these were followed up by a phone call from the NatCen Telephone Unit to establish whether or not the individual wanted to take part and if so, whether they had internet access. Those who agreed to take part were asked to complete Intake24 on four occasions (non-consecutively) over a 10-day period, including both week (two days) and weekend days (two days). Participants were notified of their days and prompted to complete their recall by either text messages, emails or letters depending on the details they provided. For participants aged 11–15 years, all contact was with their parent/carer. Participants who completed Intake24 on all four days were sent a £20 Post Office voucher. Date of birth, gender, SIMD and body mass index (BMI) were obtained from the SHeS dataset for those consenting to participate in the study.
Feedback on the usability of the system along with suggestions for improvements and details of any issues encountered were collected using SurveyMonkey® (see Tables S1–S4). It also enabled feedback on the newer functions of the system, such as the sandwich and recipe functions, to be collected. The questionnaire was linked to Intake24 and participants were asked to complete the questionnaire after their final dietary recall.
Participants that initially agreed to take part, but stopped completing the recalls, were sent a short questionnaire via email link or were telephoned to ascertain their reasons for stopping. Those who agreed to take part but did not log on were telephoned and asked what had prevented them from completing the recalls.
Statistical significance testing was performed using SPSS Version 21 to establish whether or not there were any differences between groups in either response to the telephone unit stage or the recall stage. The approach chosen was two-tailed logistic regression which enabled the testing of between group differences, for example if there was any statistical difference in numbers agreeing to take part in the study by the stratified groups (gender, age group, etc.), or any differences in the number of people completing recalls by these stratified groups. p values less than 0.05 were deemed significant and are marked with an asterisk (*). Results of recall completion are presented with 95% confidence intervals. Sentiment analyses was performed on the free text comment section in the feedback questionnaire and responses were categorised into either negative, mixed, neutral or positive comments. Google analytics was used to gain information about technology usage.

3. Results

3.1. Participant Response

The NatCen Telephone Unit was able to make contact with 747 participants, 74.7% of the participant sample (n = 1000). Of these, 71 (9.5%) were considered ineligible and were excluded from the response rates. Those classed as ineligible were those whose physical or mental health circumstances had changed since completing the Scottish Health Survey (SHeS) and those who were not able to take part as they were not available during the fieldwork period. Of those individuals who were eligible (n = 676), 55.1% agreed to take part, 1.6% agreed to a field visit whereby a researcher visited them to help complete their first recall), 35.4% refused to take part, and 7.8% were classed as unable to take part (Figure 1).
Table 1 below represents the reasons for participants being “unable to take part”. One individual could be coded to more than one reason. The most common reasons for being unable to take part in the study were linked to the lack of internet connectivity; “not having internet access” or “not having any devices linked to the Internet” (69% of answers). The reason “age” was described for those participants who felt they were too old to take part. Other reasons included “not being interested”, “not having time to take part”, and “not taking part for health reasons”.
Analyses were performed to assess the statistical significance of difference in response rate by demographic group (gender, age group, BMI, or SIMD) for the “agreed”, “refused” and “unable” groups. There were no significant differences between the outcomes by gender or by SIMD. There was a statistically significant difference by age group whereby the youngest participants (aged 11–16 years) were more likely to take part than the other age groups, particularly those aged 65+ years with 81% and 27% agreeing respectively (p value < 0.001). Similarly, the 65+ year age group was the most likely to refuse to take part with 54% refusing (see Supplementary Material for further information).

3.2. Demographics of Those Who Completed a Recall

Participant demographics of those eligible and those agreeing to take part (which includes those who agreed to a field visit) are shown in Table 2. There were equal numbers of male and female participants who were classed as eligible to take part, however slightly more males than females agreed to take part (203 males cf. 181 females). Of the participants agreeing to take part, 47% were in the healthy weight category (n = 165) with only 2% in the underweight category (n = 6). There was an almost equal split between the quintiles of SIMD (Table 2).

3.3. Number of Recalls Completed

Of the participants who agreed to take part, 230 (~60% of those who agreed) completed at least one recall and within these participants, 132 completed four or more recalls (~34% of those who agreed) (Table 3).
Recall completion rates of those who agreed to take part in the study by gender, age group, BMI and SIMD classification are shown in Table 4, Table 5, Table 6 and Table 7. There were no differences in completion rates between gender (95% confidence intervals (CIs) male: 34.3–47.8, female: 32.4–46.6) (p value: 0.741), age group (CI 11–16 years: 35.4–52.8, 17–24 years: 22.8–43.0, 25–64 years: 30.0–47.4, 65+ years: 34.5–59.3) (p value 0.256) or BMI (CI Under-weight 16.7–83.3, Healthy weight: 28.8–43.4, Over-weight: 34.7–53.1, Obese: 33.5–58.5, Morbidly obese: 15.6–62.5) (p value 0.564) (Table 4, Table 5 and Table 7 below). However, there was a difference in completion rates by SIMD quintiles (CI SIMD1: 40.7–61.6 and SIMD5: 17.4–36.9, p value 0.019) (Table 6). Those that were in the most deprived SIMD quintile were significantly less likely to complete a recall (Table 6).

3.4. Technology Use

Google Analytics was used to identify platforms (mobile vs. desktop), operating systems and browsers. The most popular browsers used were Chrome (~60%) and Safari (~25%), with recent versions of Internet Explorer (version 10 and 11) also being frequently used (~9%); indicating that a significant portion of the user base are well supported. Sixty-six percent of users logged in using either laptops or desktops, 22% used a smart phone, and 11% used tablets.

3.5. All Participant Feedback on Intake24

In total 245 participants logged on to Intake24 (this includes 15 participants who did not go on to complete a recall) of these, 182 (74%) completed the feedback questionnaire using SurveyMonkey®. In addition to the fixed choice questions, there was a section allowing optional free text for participants to add further comments (see Supplementary Material). A sentiment analysis was performed on the free text answers allowing the classification of statements into ‘negative’, ‘neutral’, ‘positive’, and ‘mixed’ categories (Table 8). Examples of some of the positive quotes included “Easy to use, enjoyable and user friendly” (female, 25–64 years) and “I honestly enjoyed taking part…Visual representation of what I had worked well for me and helped me give more accurate information” (female, 11–16 years). Examples of negative quotes included “Visuals were dull, e.g., plain white plates on a white background” (female, 11–16 years) and “If possible, minimize questions being asked” (female, 11–16 years). An example of a mixed quote included ‘I thought it was very visual and easy to pick up but it took me longer I would of liked’ (male, 11–16 years).
From the fixed choice answer questions, it was found that almost half (44%) of answers given agreed that they would like to use Intake24 often, compared with 15% that disagreed. Over 67% of answers disagreed that the system was unnecessarily complex or had too many inconsistencies and over 80% agreed that the system was easy to follow and understand. Users also found Intake24 enjoyable to use, with 57% of answers agreeing with the statement ‘I enjoyed using Intake24′ and just 9% disagreeing with this statement (Figure 2).
The majority of answers (84%) disagreed that help would be required using Intake24 with only 3% of answers agreeing that help would be needed. More than 75% of answers agreed that Intake24 accurately captured dietary intakes and 79% of answers agreed that Intake24 could be completed in a reasonable time.

3.6. Feedback from Those Completing Fewer than four Recalls

Feedback from those completing fewer than four recalls was obtained from 34 (37%) participants out of the 93 who were contacted by email and phone call (there were no email or phone details for five participants). Participants were asked to choose the reason(s) they did not fully complete their allocated recalls. Participants were able to give more than one answer. Of the responses, 28% indicated ‘I thought I had fully completed the survey’, 18% indicated that email reminders were missed, another 18% opened their emails too late for the allocated day, and 9% were away or had no Internet access so were unable to complete their recalls. The remaining 17% indicated that participants either struggled accessing the system or decided not to complete further recalls because they had lost interest or found it took too long (Table 9).

3.7. Timings of Recalls

The average time to complete recalls based on those who completed four recalls was 14 min, whereas analysis of those completing two days showed the completion time was slightly longer at 16 min on average.

3.8. Help Requests

There were 17 help requests from participants throughout the study. The most common issue was that participants had trouble logging in due to typing their username and password incorrectly (n = 10). Five participants had trouble finding a food and completing a recall and two were confused about which day to complete their recall. The majority (88%) of these issues were resolved in under 10 min.

4. Discussion

4.1. Response and Reminders

Of those classed as eligible to take part in this study, 55.1% agreed to take part, with 59.9% of those who agreed, completing at least one recall, and 34.4% completing four recalls. This gave a lower completion rate than anticipated (we had hoped for around a 50% response rate based on the NDNS rolling program response in Scotland [15]) which could be partly attributed to the recruitment and chasing strategy used.
Participants were asked only once to complete their recalls on each allocated day; no reminders were sent to encourage participation if they didn’t submit a recall. In addition, reminders were not sent directly to participants under 16 years, but instead to their parent/guardian. This could have reduced the likelihood of the participants getting the notification. However, although lower than anticipated, the recruitment rate compares favourably to similar research, where SHeS participants who had agreed to be a part of further research were invited to take part in a dietary assessment validation study using food frequency questionnaires and non-weighed food diaries; only 9% of participants agreed to take part, with just 6% completing the study [16]. Feedback from non-completers found a substantial number of participants either forgot about the study or did not see the emails. Additional reminders may reduce these issues whilst remaining inexpensive. Increasing participation through the use of reminders has been demonstrated by Christensen et al., in a Danish health survey where it was found that multiple reminders led to an increase in participant response [17]. The use of telephone calls or text messages as reminders, in particular, may increase participation whilst reducing the risk of emails being easily overlooked if, for example they are misdirected into a participant’s ‘junk folder’. A Finnish study by Tolonen et al., reported that text message reminders increased participation compared to those that didn’t receive a text reminder and research by Breen et al., concluded that telephone reminders increased response rates [18,19]. It is hypothesised that by increasing the number of reminders sent via text message, email and phone call the completion rate would increase. In particular, personalised reminders such as follow-up notifications could be sent if a participant doesn’t log in on their allocated day which might increase participation. It is also noted that the field test was conducted over just a two month period over the summer, where approximately 15% of participants indicated that although they agreed to take part, they were actually unable to take part due to being away; this would be less of an issue in a study of longer duration. Participation rates in studies have been shown to be lower in people from lower socio-economic groups [18], and as anticipated, the response and completion rates differed by level of deprivation, with lower response rates in the sub-sets of the population in which digital technology adoption and frequency of use is known to be low [14]. It is thought that additional support via telephone calls for those groups, in particular, may increase response and completion rates.

4.2. Usability and Developments

In terms of the usability of Intake24, there were just seventeen participant requests for help from the study team throughout the field testing. The majority of these were easily resolved, however the recurring issues with log in details suggest that for large scale surveys, using a unique link, rather than ask the user to enter a username and password may help to alleviate such issues. From the Google analytics data, the majority (66%) of participants used a computer to complete Intake24, however with around 33% of participants using either a smart phone or tablet, future developments could be made to create an App specifically designed for these devices. The developments identified through the field testing have been used to improve the usability and accuracy of the system. These included the addition of prompts, so when commas, ‘/’ or ‘&’ are entered into the system, the user is asked whether these are ‘separate foods’. Previously, when many items were listed on one line, this sometimes resulted in only one of those foods or drinks being entered into the system. Through use of the ‘missing foods’ function, new foods were identified and added into the database (this is a continuous process and therefore ensures the system is as comprehensive as possible). In addition to identifying new foods, the missing food function can be used to highlight foods that are in the database, but that users were unable to locate. Meta-data for these foods (synonyms and brand names) can then be added in order to make them easier for participants to find and therefore minimise the number of foods that require manual coding. These changes are likely to improve the accuracy of the nutrient data and to reduce the time taken for manual coding. Furthermore, a ‘Frequently Asked Questions’ page has been added along with a more concise video tutorial including instructions on how to use the ‘Recipe Tool’. In addition, due to the majority (75%) of participants stating they would like to receive dietary feedback from their recalls, an optional feature of providing personalised dietary feedback on completion of a recall has been developed.
The feedback questionnaire used in this study allowed for extensive usability feedback to be obtained from participants. However, unfortunately due to the rewording of some of the questions in the survey, we were unable to use participant answers to rate Intake24 using the Standard Usability Scale [20]. This is a limitation of the study, meaning it cannot be compared to other tools rated using this scale. In future we would aim to include these questions in feedback questionnaires regarding Intake24 enabling such comparisons to be made [20].

5. Conclusions

The overall feedback on Intake24 was very positive and allowed identification of key aspects of the system which required adaption. Although the completion rate was lower than expected, possible reasons for this have been identified and it is likely that completion rates could be increased using additional reminders. Key aspects of development were identified based on extensive user feedback, enabling the system to be further improved.

Supplementary Materials

The following are available online at https://www.mdpi.com/2072-6643/10/11/1690/s1, Table S1: Difference in percentage for response outcomes of those classed as eligible (n = 676) by Gender, Table S2: Difference in percentage for response outcomes of those classed as eligible (n = 676) by Age group, Table S3: Difference in percentage for response outcomes of those classed as eligible (n = 676) by BMI classification, Table S4: Difference in percentage for response outcomes of those classed as eligible (n = 676) by SIMD quintile.

Author Contributions

Conceptualization, A.J.A., I.P., J.B., E.S., P.O. and E.F.; Data curation, M.K.R., I.P. and E.S.; Formal analysis, M.K.R.; Funding acquisition, E.F.; Investigation, M.K.R.; Methodology, A.J.A., P.O., and E.F.; Project administration, E.F.; Resources, I.P.; Software, I.P.; Validation, E.F.; Visualization, M.K.R. and E.F.; Writing—original draft, M.K.R.; Writing—review and editing, M.K.R., A.J.A., I.P., J.B., E.S., P.O. and E.F.

Funding

This research was funded by Food Standards Scotland (previously the Foods Standards Agency Scotland), grant number FSS 051015.

Acknowledgments

This work was funded by Food Standards Agency in Scotland. On 1 April 2015, Food Standards Scotland took on all of the functions previously carried out in Scotland by the Food Standards Agency. AJA is funded by the National Institute of Health Research as an NIHR Research Professor. We would like to thank ScotCen Social Research for recruiting participants, conducting all survey correspondence and assisting in data analysis and report writing. Finally, we would like to thank all of the people who took part in the study.

Conflicts of Interest

Food Standards Scotland helped to guide the design of the study.

References

  1. National Obesity Observatory, Review of Dietary Assessment Methods in Public Health. 2010. Available online: http://webarchive.nationalarchives.gov.uk/20170110165944/https://www.noo.org.uk/NOO_pub/briefing_papers (accessed on 24 September 2018).
  2. Raper, N.; Perloff, B.; Ingwersen, L.; Steinfeldt, L.; Anand, J. An overview of USDA’s Dietary Intake Data System. J. Food Compos. Anal. 2004, 17, 545–555. [Google Scholar] [CrossRef]
  3. Liu, B.; Young, H.; Crowe, F.L.; Benson, V.S.; Spencer, E.A.; Key, T.J.; Appleby, P.N.; Beral, V. Development and evaluation of the Oxford WebQ, a low-cost, web-based method for assessment of previous 24 h dietary intakes in large-scale prospective studies. Public Health Nutr. 2011, 14, 1998–2005. [Google Scholar] [CrossRef][Green Version]
  4. Carroll, R.J.; Midthune, D.; Subar, A.F.; Shumakovich, M.; Freedman, L.S.; Thompson, F.E.; Kipnis, V. Taking advantage of the strengths of 2 different dietary assessment instruments to improve intake estimates for nutritional epidemiology. Am. J. Epidemiol. 2012, 175, 340–347. [Google Scholar] [CrossRef] [PubMed]
  5. Carter, M.C.; Albar, S.A.; Morris, M.A.; Mulla, U.Z.; Hancock, N.; Evans, C.E.; Alwan, N.A.; Greenwood, D.C.; Hardie, L.J.; Frost, G.S. Development of a UK Online 24-h Dietary Assessment Tool: Myfood24. Nutrients 2015, 7, 4016–4032. [Google Scholar] [CrossRef] [PubMed]
  6. Subar, A.F.; Kirkpatrick, S.I.; Mittl, B.; Zimmerman, T.P.; Thompson, F.E.; Bingley, C.; Willis, G.; Islam, N.G.; Baranowski, T.; Mcnutt, S.; et al. The Automated Self-Administered 24-h Dietary Recall (ASA24): A Resource for Researchers, Clinicians, and Educators from the National Cancer Institute. J. Acad. Nutr. Diet. 2012, 112, 1134–1137. [Google Scholar] [CrossRef] [PubMed]
  7. Vereecken, C.A.; Covents, M.; Sichert-Hellert, W.; Alvira, J.M.F.; Le Donne, C.; De Henauw, S.; De Vriendt, T.; Phillipp, M.K.; Béghin, L.; Manios, Y.; et al. Development and evaluation of a self-administered computerized 24-h dietary recall method for adolescents in europe. Int. J. Obes. 2008, 32, S26–S34. [Google Scholar] [CrossRef] [PubMed]
  8. Smithers, G.; Gregory, J.R.; Bates, C.J.; Prentice, A.; Jackson, L.V.; Wenlock, R. The National Diet and Nutrition Survey: Young people aged 4–18 years. Nutr. Bull. 2000, 25, 105–111. [Google Scholar] [CrossRef]
  9. Foster, E.; O’Keeffe, M.; Matthews, J.N.; Mathers, J.C.; Nelson, M.; Barton, K.L.; Wrieden, W.L.; Adamson, A.J. Children’s estimates of food portion size: The effect of timing of dietary interview on the accuracy of children’s portion size estimates. Br. J. Nutr. 2008, 99, 185–190. [Google Scholar] [CrossRef] [PubMed]
  10. Foster, E.; Hawkins, A.; Stamp, E.; Adamson, A.J. Development and validation of an interactive portion size assessment system (IPSAS). Proc. Nutr. Soc. 2010, 69, E430. [Google Scholar] [CrossRef]
  11. Simpson, E.; Bradley, J.; Poliakov, I.; Jackson, D.; Olivier, P.; Adamson, A.J. Iterative Development of an Online Dietary Recall Tool: INTAKE24. Nutrients 2017, 9, 118. [Google Scholar] [CrossRef] [PubMed]
  12. Bradley, J.; Simpson, E.; Poliakov, I.; Matthews, J.N.; Olivier, P.; Adamson, A.J.; Foster, E. Comparison of INTAKE24 (an Online 24-h Dietary Recall Tool) with Interviewer-Led 24-h Recall in 11–24 Year-Old. Nutrients 2016, 8, 358. [Google Scholar] [CrossRef] [PubMed]
  13. The Scottish Government. Scottish Index of Multiple Deprivation 2013. Available online: http://www.scotland.gov.uk/Topics/Statistics/SIMD (accessed on 26 September 2018).
  14. Office for National Statistics. Statistical Bulletin: Internet Access—Households and Individuals. 2014. Available online: http://www.ons.gov.uk/ons/dcp171778_373584.pdf (accessed on 26 September 2018).
  15. Bates, B.; Lennox, A.; Prentice, A.; Bates, C.; Page, P.; Nicholson, S. National Diet and Nutrition Survey Rolling Programme (NDNS RP) Results from Years 1–4 (combined) for Scotland (2008/09-2011/12). Available online: https://www.foodstandards.gov.scot/downloads/NDNS_Y1-4_Scotland_report_FULL_TEXT_MASTER_DOC_FINAL_FOR_REPUBLICATION__JUNE_2017.pdf (accessed on 26 September 2018).
  16. Hollis, J.L.; Craig, L.C.A.; Whybrow, S.; Clark, H.; Kyle, J.A.M.; McNeill, G. Assessing the relative validity of the Scottish Collaborative Group FFQ for measuring dietary intake in adults. Public Health Nutr. 2017, 20, 449–455. [Google Scholar] [CrossRef] [PubMed]
  17. Christensen, A.I.; Ekholm, O.; Kristensen, P.L.; Larsen, F.B.; Vinding, A.L.; Glumer, C.; Juel, K. The effect of multiple reminders on response patterns in a Danish health survey. Eur. J. Public Health 2015, 25, 156–161. [Google Scholar] [CrossRef] [PubMed]
  18. Tolonen, H.; Aistrich, A.; Borodulin, K. Increasing health examination survey participation rates by SMS reminders and flexible examination times. Scand J. Public Health 2014, 42, 712–717. [Google Scholar] [CrossRef] [PubMed]
  19. Breen, C.L.; Shakeshaft, A.P.; Doran, C.M.; Sanson-Fisher, R.W.; Mattick, R.P. Cost-effectiveness of follow-up contact for a postal survey: A randomised controlled trial. Aust. N. Z. J. Public Health 2010, 34, 508–512. [Google Scholar] [CrossRef] [PubMed]
  20. Brooke, J. SUS-A Quick and Dirty Usability Scale. Available online: https://www.usability.gov/how-to-and-tools/methods/system-usability-scale.html (accessed on 25 October 2018).
Figure 1. Participant contact and response.
Figure 1. Participant contact and response.
Nutrients 10 01690 g001
Figure 2. Participant feedback from fixed choice answers in questionnaire.
Figure 2. Participant feedback from fixed choice answers in questionnaire.
Nutrients 10 01690 g002
Table 1. Participant reasons for being ‘unable’ to take part.
Table 1. Participant reasons for being ‘unable’ to take part.
ReasonsAnswers Obtained (n = 99)
n = %
No internet access4141
No devices linked to internet2828
Not comfortable/competent using computers/tablets/smart phones2424
Going away or in hospital during fieldwork33
Age33
Table 2. Participant demographics of those eligible (n = 676) and those who agreed (n = 384) by gender, age, BMI and SIMD.
Table 2. Participant demographics of those eligible (n = 676) and those who agreed (n = 384) by gender, age, BMI and SIMD.
DemographicEligible (n = 676) 1Agreed (n = 384) 1
n =%n =%
GenderMale3435120353
Female3334918147
Age Group11–16 years1512212332
17–24 years121188121
25–64 years1832712031
65+ years221336016
Body mass index (BMI)
classification
Under weight7162
Healthy weight2553816547
Over weight1952911031
Obese126195917
Morbidly obese244144
Scottish Index of Multiple
Deprivation (SIMD) Quintiles
1 (Most deprived)174268622
2111166417
3136208121
4126197620
5 (Least deprived)129197720
1 For the BMI data, there are 69 cases missing in the “eligible” group, and 30 cases missing in the “agreed” group.
Table 3. Response rates for those who were eligible and who agreed.
Table 3. Response rates for those who were eligible and who agreed.
Number of RecallsEligible (n = 676)Agreed (n = 384)
n = %n = %
044666.015440.1
4+13219.513234.4
Any23034.023059.9
Table 4. Recall completion by gender of those agreed.
Table 4. Recall completion by gender of those agreed.
Number of RecallsMale (n = 203)Female (n = 181)
n =% CIn =%CIp Value
08340.9 34.3–47.87139.232.4–46.60.741
4+7034.528.2–41.36234.327.7–41.50.963
Any12059.152.2–65.711060.853.4–67.60.741
Table 5. Recall completion by age of those who agreed. CI: confidence interval.
Table 5. Recall completion by age of those who agreed. CI: confidence interval.
Number of RecallsAge Group (Years)
11–16 (n = 123)17–24 (n = 81)25–64 (n = 120)65+ (n = 60)p Value
n =%CIn =%CIn =%CIn =%CI
05443.935.4–52.82632.122.8–43.04638.330.0–47.42846.734.5–59.30.256
4+4032.524.8–41.33239.529.5–50.54134.226.2–43.11931.721.2–44.50.726
Any6956.147.2–64.65567.957.0–77.27461.752.6–70.03253.340.7–65.50.256
Table 6. Recall completion by SIMD quintile of those who agreed.
Table 6. Recall completion by SIMD quintile of those who agreed.
Number of Recalls SIMD Quintile
1
(Most Deprived)
(n = 86)
2
(n = 64)
3
(n = 81)
4
(n = 76)
5
(Least Deprived)
(n = 77)
p Value
n = %CIn = %CIn = %CIn = %CIn = %CI
04451.240.7–61.63046.935.0–59.13239.529.5–50.52836.826.8–48.22026.017.4–36.90.019 *
4+2225.617.4–35.92234.423.8–46.83037.027.2–48.12634.227.2–48.13241.631.1–52.90.305
Any4248.838.4–59.33453.140.9–65.04960.549.5–70.54863.251.8–73.25774.063.1–82.60.19 *
* p values less than 0.05 were deemed significant.
Table 7. Recall completion by BMI classification of those who agreed (Note: there are missing data for 30 participants).
Table 7. Recall completion by BMI classification of those who agreed (Note: there are missing data for 30 participants).
Number of RecallsBMI Classification
Under-Weight
(n = 6)
Healthy Weight
(n = 165)
Over-Weight
(n = 110)
Obese
(n = 59)
Morbidly Obese
(n = 14)
p Value
n =%CIn =%CIn =%CIn =%CIn =%CI
0350.016.7–83.35935.828.8–43.44843.634.7–53.12745.833.5–58.5535.715.6–62.50.564
4+350.016.7–83.36539.432.2–47.13531.823.8–41.11627.117.3–39.8428.611.1–56.20.374
Any350.016.7–83.310664.256.6–71.26256.446.9–65.33254.241.5–66.5964.337.5–84.40.564
Table 8. Sentiment analysis from free text question in feedback questionnaire.
Table 8. Sentiment analysis from free text question in feedback questionnaire.
Sentimentn = 72%
Negative1115
Neutral2433
Positive2940
Mixed811
Table 9. Participant reasons for not fully completing recalls (34 participants, 57 responses).
Table 9. Participant reasons for not fully completing recalls (34 participants, 57 responses).
Reason GivenNumber of Responses (n = 57)% 1
Thought I had fully completed the survey1628
Don’t remember seeing any more emails1018
Opened the email too late to complete for allocated day1018
Did not receive any more emails712
Away/Holiday/No (or problems with) Internet access 159
Didn’t enjoy doing it35
Unable to access the website24
It took too long12
Lost interest12
Could access the website but was unable to log on12
Had enough after completing 1, 2 or 3 recalls12
Changed mind about taking part00
Didn’t like that it was online00
1 Discrepancies in percentages due to rounding.

Share and Cite

MDPI and ACS Style

Rowland, M.K.; Adamson, A.J.; Poliakov, I.; Bradley, J.; Simpson, E.; Olivier, P.; Foster, E. Field Testing of the Use of Intake24—An Online 24-Hour Dietary Recall System. Nutrients 2018, 10, 1690. https://doi.org/10.3390/nu10111690

AMA Style

Rowland MK, Adamson AJ, Poliakov I, Bradley J, Simpson E, Olivier P, Foster E. Field Testing of the Use of Intake24—An Online 24-Hour Dietary Recall System. Nutrients. 2018; 10(11):1690. https://doi.org/10.3390/nu10111690

Chicago/Turabian Style

Rowland, Maisie K., Ashley J. Adamson, Ivan Poliakov, Jennifer Bradley, Emma Simpson, Patrick Olivier, and Emma Foster. 2018. "Field Testing of the Use of Intake24—An Online 24-Hour Dietary Recall System" Nutrients 10, no. 11: 1690. https://doi.org/10.3390/nu10111690

Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop