1. Introduction
The rapid advancement of technology, particularly the growing use of augmented reality (AR), has significantly influenced various sectors, including food science. Reality refers to physical objects and environments in the real world, while virtual reality (VR) involves computer-generated environments that are not connected to real-life surroundings. VR may include fully digital worlds or immersive content created using 360° cameras. In contrast, AR overlays digital information, such as text, images, or 3D models, on top of what the user sees in real time [
1].
AR offers a dynamic and interactive platform that can not only transform consumer engagement but also support more informed decision-making by providing contextual, real-time information. This capability is particularly important in the context of a growing global population and rising concerns about food quality, safety, and sustainability [
2]. By improving consumers’ ability to assess intrinsic and extrinsic food characteristics, AR has the potential to play a key role in promoting healthier, safer, and more sustainable food choices.
Several interactive AR-based tools have been developed with the aim of enhancing food literacy among consumers. These technologies could not only aid consumers in understanding nutritional health and dietary implications but also support producers in adhering to food safety regulations and industry standards [
3,
4,
5,
6,
7,
8]. In parallel, recent advancements in AR technology offer new opportunities for exploring consumers’ sensory perceptions of food. By integrating multimodal stimuli, specifically the combination of visual and auditory cues, AR environments can simulate enriched sensory contexts. These multisensory experiences may alter the way individuals perceive and evaluate food attributes such as taste, texture, and appearance [
9,
10]. This highlights the potential of AR to enhance consumer sensory evaluation through multisensory interactions [
11]. Moreover, the potential of AR and other emerging technologies in advancing nutritional education has also gained increasing attention. AR-based tools could transform how individuals engage with food and nutrition by offering interactive, personalized information and real-time guidance on healthy choices and portion sizes [
12].
Similarly, in a world where almost everyone owns a smartphone, AR can be used to provide consumers with detailed food-related information simply by pointing their device at packaging. This can offer allergen warnings, ingredient lists, and personalized dietary recommendations based on individual preferences [
13,
14]. Other applications include enhancing transparency regarding food origins, sourcing, and sustainability practices through label scanning [
15]; providing real-time recipe suggestions, instructional videos, and ingredient substitutions [
16]; and helping consumers identify allergens [
17]. Additionally, AR can enhance brand engagement through immersive experiences such as 3D animations, product demos, and interactive games, fostering consumer loyalty and interaction [
18].
More specifically, ongoing research efforts by both academic institutions and the food industry aim to expand AR capabilities in this domain. For example, Chen et al. (2019) introduced NutriAR, an augmented reality system that uses computer vision techniques to recognize food and provide nutritional information [
19]. This system allows users to point their smartphone camera at a food item, displaying real-time nutritional information and recommendations through AR overlays. Similarly, Silva et al. (2020) proposed an AR tool that delivers personalized nutritional information based on users’ dietary needs and preferences, integrating AR, machine learning, and data analytics to offer real-time recommendations and educational content [
20]. Another example is ARFood, an AR-based, personalized food recommendation system that provides nutritional information and suggests food choices tailored to user preferences, dietary restrictions, and health goals [
21].
Integrating AR into food systems presents new opportunities to support informed food choices and enhance consumer engagement. In the context of nutrition education, for instance, AR can support personalised, self-directed learning by promoting interactivity and improving knowledge retention through immersive experiences [
22]. However, the effectiveness of AR depends heavily on how its features are utilised. One study found that although only 4.6% of customers had good knowledge of nutritional labelling, 71.3% expressed positive attitudes towards it. Nutrilabelapps©, an AR tool, was well received, with high feasibility and acceptability ratings [
8]. Additionally, consumers using AR tools to access nutritional data reported basing their decisions more on this information than on visual or branding cues, signalling a shift in behaviour at the point of purchase [
23]. Even basic applications, such as an app that visualized the number of teaspoons of sugar in beverages, has been shown raise consumer awareness of the impact of sugar intake [
24].
This study presents the development and evaluation of an AR tool designed to present nutritional information through two modalities: visual only and a combined visual plus auditory format. A key contribution of this research lies in its novel exploration of auditory AR within the context of nutritional labelling, an area where auditory cues remain largely underexplored. By integrating audio alongside visual stimuli, the study investigates whether multisensory AR interactions can improve consumer understanding, engagement, and perception of two distinct food products: lasagne and yogurt.
The study was structured around three primary objectives. First, we assessed which of the two AR tools (visual AR or visual and audio AR) more effectively supported consumers in understanding nutritional information, and how both compared to original product packaging. This evaluation focused on consumer perceptions of healthiness, caloric content, and macronutrient composition for lasagne and yogurt product. Second, we examined consumers’ overall perceptions within the three experimental conditions (original packaging, visual AR, and visual and audio AR) with respect to clarity, novelty, and perceived usefulness. This allowed us to explore potential barriers to adoption of AR-based nutritional communication. Third, we investigated the broader effect of nutritional information provision itself on consumer perception of food healthiness, specifically examining whether the presence of such information, regardless of format, affects consumer evaluation, as well as whether the experimental condition (i.e., the method of presentation—original packaging, visual AR or visual and audio AR) plays a significant role in shaping these perceptions.
2. Materials and Methods
2.1. Participants
A total of 30 participants were recruited voluntary via an internal email within Teagasc Food Research Centre, Dublin, Ireland, and word of mouth. Participants were included if they (1) were aged 18 years or older; (2) were able to use a smartphone; and (3) had no existing medical conditions that affect sight and hearing. Due to the exploratory nature of the research, quotas for gender and age were not applied during recruitment, and there was an over-representation of female participants (67%) and an overall mean age of 32.6 ± 10.4 years. Written informed consent was obtained from each participant prior to data collection.
2.2. Products
To test participants’ use and understanding of front-of-pack nutrition labels using AR, a single portion of a beef lasagne ready meal and a strawberry yogurt were selected as study stimuli due to their differences in terms of nutritional content, perceived healthiness and usage occasions. Both products were commercially available in the Republic of Ireland and had front-of-pack nutrition labelling in the form of the traffic light system whereby the colours green, amber and red indicated whether the product contained a low, medium or high quantity of fat, saturated fat, sugar, and salt. Energy information, expressed in kilojoules (kJ) and kilocalories (kcal), was also listed on the traffic light label on the front of each product package (
Figure 1). The nutrition information per 100 g was listed as per Regulation (EU) No. 1169/2011 at the back of each package; however, as the primary aim of this study was to investigate how an AR application could promote consumer understanding of front-of-pack nutrition labelling, the back of pack nutrition label was not presented for the purpose of this study.
2.3. Augmented Reality Application
An external company (The VR Agency, Dublin, Ireland) was enlisted to design a dedicated AR smartphone application for displaying the nutritional information for the beef lasagne and strawberry yogurt products. The AR application was developed using Vuforia
® software (version 10.1) and was compatible with an Android operating system. The AR application supported both visual and auditory content consisting of a 3D pop-up of the front-of-pack traffic light label for each product and a short audio voiceover explaining the respective nutritional information (
Supplementary File S1).
2.4. Experimental Design and Procedure
The assessment took place at the sensory science suite at Teagasc Food Research Centre, Dublin, Ireland. Using a between-subject design, the participants were randomly assigned to one of the following three experimental conditions: (1) original packaging (n = 10) (control condition whereby no AR technology was used and participants answered questions based on the original front-of-pack nutrition labelling displayed on the packaging); (2) visual AR (n = 10) (nutritional information for the product was displayed as a 3D pop-up of the front-of-pack traffic light label using AR); and (3) visual and audio AR (n = 10) (nutritional information for the product was displayed as a 3D pop-up of the front-of-pack traffic light label using AR and supplemented with an audio voiceover explaining the respective nutrition label). An overview of the experiment is illustrated in
Figure 2. For the two experimental conditions involving AR (i.e., visual AR and visual and audio AR), the front-of-pack nutrition label was replaced with a specific QR code which the participant could scan and experience the assigned information using a dedicated smartphone (Samsung Galaxy, A11) (
Figure 3). Due to the novelty of using AR technology for displaying and understanding nutrition labels, participants assigned to the AR conditions participated in a short familiarization session on how to use the AR application.
Within each experimental condition, participants attended two 30 min sessions (one for each product), during which they evaluated the nutritional information of the beef lasagne and strawberry yogurt product and recorded their answers via a questionnaire. The session was counterbalanced for product order effects so that 5 participants assessed the beef lasagne first, while the other 5 participants assessed the strawberry yogurt first. Within each session, to understand whether the provision of nutritional information via the AR tool improved participant understanding of the nutritional value of the product, they were first asked to evaluate the product in the absence of any nutritional information, and thus, the nutritional information on the front of the package was not presented. After viewing the product (without any nutritional information), participants were asked to rate the product for overall healthiness and rate the perceived healthiness of the product in terms of calories, and total fat, saturated fat, sugar, and salt contents on a scale of 1 (not healthy at all) to 7 (very healthy).
Following the provision nutritional information via one of the experimental conditions described above (i.e., original packaging, visual AR, or visual and audio AR), participants were asked to rate their perceived healthiness of the product using the same questions and scale as before and were subsequently also asked to rate the following statements on a 1 to 5 scale (1 = strongly disagree; 2 = disagree; 3 = neither agree nor disagree; 4 = agree; 5 = strongly agree): I could easily understand the nutrition label using the AR application; overall, the AR application is a useful way for obtaining information about the nutritional quality of the product; using the AR application did not require much effort; the AR application was eye-catching and memorable; I have a better understanding of the nutritional quality of the beef lasagne after using the AR application; using the AR application was a novel experience; I would use the AR application again in the future again for obtaining information about nutritional quality. For participants in the original packaging condition, the wording of the questions was edited slightly to focus on the ease of reading nutritional information on the packaging, as opposed to using an AR tool.
2.5. Data Analysis
To assess differences between means following the provision of information among the three conditions (i.e., original packaging, visual AR, and visual and audio AR) regarding consumer perception of healthiness, caloric content, and macronutrient composition of lasagne and yogurt, and the perception of the presentation methods, one-way ANOVA followed by post hoc tests (Fisher LSD) were conducted. Fisher’s LSD was used as the post hoc test, as only three conditions were examined. Given the exploratory nature of the analysis, aimed at identifying potential trends rather than confirming specific hypotheses, this approach was deemed appropriate [
25,
26].
To determine differences between means within each condition before and after the provision of information regarding consumer perception of healthiness, caloric content and macronutrient composition of the food products, one-way ANOVA followed by post hoc tests (Fisher LSD) were carried out. The results are presented using bar charts to clearly illustrate differences in consumer response to questions and to facilitate ease of interpretation.
A two-way ANOVA was applied to assess the significance of variance for the fixed factors, condition and information, as well as their interactions, in relation to consumer perception of healthiness, caloric content, and macronutrient composition of the food products. All the analyses, as well as the descriptive statistics were performed using XLSTAT Premium (Annual version 2024.4.01424) at a significant level of p < 0.05 unless otherwise indicated.
4. Discussion
The results of this study highlight consumer perception of the overall healthiness, and healthiness of the calorie content, and macronutrient composition, both among the different methods used to present nutritional information (i.e., original packaging, visual AR, or visual and audio AR) and between the two products (i.e., lasagne and yogurt). While information presented through original packaging was more effective in changing consumer perceptions, the AR tools were found to be more “novel”, “easier or better to understand”, and “memorable”. The provision of nutritional information had a greater impact on yogurt perception compared to lasagne. These findings are further discussed below.
4.1. Consumers Were More Engaged with AR Tools
The data on consumer perceptions of nutritional information presentation indicate a clear preference for AR tools over traditional packaging for both lasagne and yogurt. Visual AR and visual-plus-audio AR were consistently rated as “easier to understand” and more effective in providing a “better understanding” of nutritional information, suggesting that the interactive and visual features of AR enhanced user engagement. Visual AR, in particular, stood out for its “memorability” and “novelty”, factors that are critical for consumer engagement and brand differentiation [
27]. The higher ratings in these categories, especially for visual AR, suggest that consumers may perceive these tools as more engaging, which may lead to improved recall and stronger product preference.
The use of both visual AR and visual and audio AR formats, appeared to influence the perception of lasagne and yogurt differently compared to traditional original packaging. For lasagne, AR tools generally made consumers more aware of “saturated fat” and “sugar” contents, particularly using the visual and audio AR tool. For yogurt, visual and audio AR enhanced the perceptions of “overall healthiness” and “calories”, while visual AR highlighted “total fat” and “salt” contents more effectively. These findings are consistent with previous research demonstrating that the clarity and visibility of nutritional information play a crucial role in consumer decision-making, and that AR technology can enhance both [
28].
Digital food label interventions have been shown to encourage consumers to choose products of higher nutritional quality [
29]. Supporting the findings presented here, a recent study demonstrated that a smartphone application, which scanned labels using optical character recognition and applied the FDA’s 5–20 rule to assess nutrient levels, significantly improved consumer decision-making when combined with AR visualization [
30]. In that study, 91% of participants made healthier selections using the app, compared to only 45% without it [
30]. Similarly, another study introduced a mobile AR application to present nutrition information from labels on real packaged foods, further confirming the effectiveness of AR in enhancing consumer understanding of nutritional information [
31].
The use of visual and audio AR to deliver nutritional information aligns with findings by Ares et al. (2016), who showed that more engaging and interactive presentation formats can enhance both understanding and retention of nutritional information [
32]. Previous research has demonstrated that traffic light labeling requires less processing time than monochromatic alternatives, while simultaneously leading to higher consumer perceptions of product healthiness [
33]. In addition, studies of eye-tracking and healthiness ratings highlight the effectiveness of interactive packaging in drawing consumer attention [
34]. Similarly, digital Nutri-Score labels have been shown to increase consumer focus on the nutritional quality of foods during product selection [
29].
The use of AR in food labeling offers a promising approach to better inform consumers and guide healthier dietary choices. The differences between the visual AR and visual and audio AR tools indicate that the type of AR application can have a varied impact on consumer perception, an important consideration for future research and implementation in nutritional labeling. Overall, the preference for AR methods suggests that integrating AR into product packaging can enhance consumer experience by making information more accessible, engaging, and easier to understand.
4.2. The Original Packaging Remains the Most Effective Tool for Changing Perceptions
In terms of consumer perceptions of overall healthiness, calories, and macronutrient composition, products presented in their original packaging consistently received lower ratings—particularly in the categories of “memorability,” “better understanding,” and “novelty.” This suggests that traditional packaging may be less effective at engaging consumers compared to AR tools. However, these differences were not reflected in the results regarding the effectiveness of the different methods in changing consumer perceptions.
When comparing original packaging with the two AR tools, the former appeared to influence product perception to a greater extent for both lasagne and yogurt, showing significant differences in three health related attributes before and after the provision of nutritional information. In contrast, the AR tools produced significant differences in only one or two attributes, depending on the product. This suggests that the visual AR and visual and audio AR tools may be less effective than original packaging, possibly due to consumer familiarity with traditional formats.
In the present study, however, the largest contribution to variance across most evaluated traits was attributed to the provision of nutritional information itself, rather than the method of presentation. This indicates that the content of the information—regardless of delivery format—plays a central role in shaping consumer perceptions of healthiness, while the presentation method has only a moderate influence. Supporting this, a study on biscuits made with different oil sources found no differences in perceived healthiness between evaluations based solely on the label and evaluations that included both the label and the product, suggesting that judgments were driven primarily by label information rather than hedonic characteristics [
35]. Conversely, other research has reported that nutrition labels may have limited influence on perceptions of healthiness for certain foods, such as chocolate and cereal bars [
36].
Future applications of AR for nutritional information delivery could benefit from incorporating more interactive features to enhance user engagement and educational value. While the present study focused on relatively simple visual and auditory content, future developments may enrich the AR experience through touch-based interactions or gesture control. Such features would enable users to actively explore nutritional information, creating a more personalized and dynamic experience. For example, users could interact with different food items in a virtual environment and receive tailored feedback based on their selections. Gesture-based navigation or touch-enabled menus could further encourage deeper exploration and improve retention of nutritional information. These advancements would not only foster greater engagement but also provide a more immersive and informative experience, ultimately increasing the effectiveness of AR in supporting healthier food choices.
4.3. Product Differences
Previous research has shown that traffic light nutritional labels are most effective when communicating the nutritional quality of products perceived as “moderately” or “ambiguously” healthy, rather than those already widely regarded as healthy or unhealthy [
37,
38]. In the present study, providing nutritional information with the visual AR tool incorporating traffic lights resulted in significant differences in perception of two health related attributes for yogurt, but only one for lasagne. This may reflect the role of product health perceptions: while colored nutrient labels can draw consumer attention and reduce perceived healthiness for some foods, they have less impact on products generally viewed as clearly unhealthy [
39]. Yogurt is typically regarded as a healthy food, whereas lasagne is often considered unhealthy, which may explain the difference in outcomes. However, other studies have reported that front-of-pack labeling schemes, including the traffic light system, can improve overall perceptions of food healthfulness [
40].
Perceived healthiness of yogurt in relation to its “saturated fat” content was rated significantly lower across all conditions. This may be explained by consumer expectations: because yogurt is generally associated with nutritional value, participants may not anticipate it to contain substantial amounts of saturated fat, leading to lower ratings. Previous research has shown that consumers often underestimate the healthiness of milk and yogurt while overestimating that of butter and cheese [
41]. Similarly, they tend to underestimate the caloric content of foods considered “healthy” compared to those perceived as “unhealthy” [
42]. Familiarity is another important factor, as consumers are more likely to perceive a product as healthy if it is familiar to them, suggesting an avenue for future research [
41]. More broadly, consumer perceptions of food healthiness are influenced by seven key categories: the communicated information, consumer knowledge of specific products, the product category, packaging shape and color, product ingredients, organic origin, and sensory attributes [
41,
43].
4.4. Limitations
This pilot study explored consumer perception of using AR tools to display and interpret nutritional labels. One limitation of the study is the small sample size, which may affect the generalizability of the findings. Due to the resource-intensive nature of AR research, the number of participants was limited. Future studies should aim to include a larger and more diverse sample to enhance statistical power and ensure broader applicability of the results across different user groups and contexts.
A second limitation of the present study is the absence of an audio-only condition. While the visual AR and combined visual–audio AR formats provided valuable insights into how multimodal cues influence consumer perceptions and understanding of nutrition labels, the lack of an audio-only format makes it difficult to determine the contribution of auditory cues. Including an audio-only condition would have allowed for a clearer assessment of the relative engagement and effectiveness of visual AR cues compared with auditory cues alone. Future research could incorporate this condition to better isolate the effects of each sensory modality and inform the design of AR tools for nutrition communication.
4.5. Further Recommendations and Considerations
As noted above, the AR tools used in this study could be criticized for delivering information only through static visual content and audio, lacking the interactive or multimedia features that AR can offer. This limited use could have contributed to lukewarm responses from consumers, who may not have perceived sufficient value in the experience. While this limitation cannot be addressed retrospectively, future applications would benefit from integrating more dynamic and engaging features. For instance, an AR tool developed to help users interpret carbohydrate-related information on packaged foods used visual overlays to identify relevant sections of the label and explain portion sizes. This approach significantly improved consumers’ understanding and satisfaction [
31]. Similarly, an AR tool that highlighted health attributes during grocery shopping, through overlay tags and colour-coded recommendations, has been shown to reduce the time needed to identify healthier options and improve consumers’ ability to distinguish between recommended and non-recommended products [
44]. Despite these benefits, implementing AR tools in practice can pose challenges. For example, smartphone-based AR systems, such as the one used in this study, while widely accessible, require users to hold their devices throughout the interaction. This can lead to a diminished user experience due to camera distortions and user fatigue [
1].
More sophisticated headset-based AR systems have also been proposed. Such systems can allow users to point at real food items and receive recipe suggestions along with step-by-step video tutorials. Such systems have been associated with high user satisfaction and a strong willingness to recommend the tool to others [
45]. Nonetheless, head-mounted AR devices come with their own limitations, including reliance on wireless connectivity, limited battery life, and challenges related to food item recognition and localisation in uncontrolled environments [
46].
Looking forward, there is a growing consensus that AR tools should move beyond simply presenting nutritional information. Instead, they should encompass the entire food journey, from the origin of ingredients and production methods to their final presentation in stores or restaurants, providing consumers with a comprehensive view of food systems [
47]. With thoughtful design, rigorous evaluation, and features that prioritize consumer needs, AR has the potential to become a transformative tool for improving nutrition communication and supporting healthier food choices.
5. Conclusions
This study investigated the impact of AR tools, specifically those employing visual and auditory formats, on consumers’ perception and comprehension of nutritional labels for two commercially available food products. A key contribution of this research is its novel application of auditory AR in the context of food labelling, an area that remains largely underexplored in both academic literature and industry practice. By examining consumer responses to different methods of information delivery, this study provides important insights into how the presentation format influences perceptions of healthiness, caloric content, and macronutrient composition.
While nutritional information presented via original packaging proved most effective in influencing consumer perceptions, the AR-based tools were perceived as more memorable, novel, and easier to understand. These attributes are particularly important in enhancing consumer engagement and suggest that AR technologies hold strong potential as complementary tools for nutrition communication.
As AR becomes increasingly integrated into consumer’s daily experiences and they become more familiar with these technologies, the potential to transform food-related decision-making grows. By embedding interactive and multisensory content into food labels, AR tools could significantly enhance consumer literacy around nutrition, food quality, safety, and sustainability. Such applications have promising implications for public health, as they may empower individuals to make better informed, healthier dietary choices.
This pilot study offers valuable insights into the use of AR tools for nutrition labelling and communication. However, further research involving larger and more diverse sample of consumers is necessary to validate and extend these findings. Future studies could also explore the incorporation of more advanced and interactive AR features, such as personalized recommendations or real-time feedback, to better understand their potential in engaging users and influencing dietary behaviour. These enhanced applications may offer even greater opportunities to support consumer education and drive meaningful improvements in public health outcomes.