Next Article in Journal
Non-Saccharomyces Are Also Forming the Veil of Flor in Sherry Wines
Next Article in Special Issue
Analysis of Volatile Aroma Compounds and Sensory Characteristics Contributing to Regional Style of Red Wines from Hexi Corridor Based on Sixteen Grape Varieties/Clones
Previous Article in Journal
Effects of Lactobacillus curvatus HY7602-Fermented Antlers in Dexamethasone-Induced Muscle Atrophy
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Preliminary Study of Yeast Strain Influence on Chemical and Sensory Characteristics of Apple Cider

1
Tasmanian Institute of Agriculture, University of Tasmania, Private Bag 98 Sandy Bay, Tasmania, TAS 7001, Australia
2
National Wine and Grape Industry Centre, Charles Sturt University, Wagga Wagga, NSW 2650, Australia
*
Author to whom correspondence should be addressed.
Current address: Winequip, Dudley Park, Adelaide, SA 5008, Australia.
Fermentation 2022, 8(9), 455; https://doi.org/10.3390/fermentation8090455
Submission received: 11 August 2022 / Revised: 26 August 2022 / Accepted: 31 August 2022 / Published: 12 September 2022
(This article belongs to the Special Issue Flavor and Aroma in the Fermented Food)

Abstract

:
During the fermentation of apple juice, yeast metabolism creates complex biosynthetic pathways which produce a range of compounds responsible for the organoleptic qualities of cider. In this study, basic cider quality parameters were measured to investigate the influence of six yeast strains on cider made from three apple varieties (‘Pink Lady’, ‘Sturmer’, and ‘Bulmer’s Norman’). Measurement of pH, titratable acidity, and total phenolic content revealed that yeast can influence cider attributes, albeit variety and season dependent. Descriptive sensory analysis using a trained sensory panel was conducted on cider made from ‘Pink Lady’ apples and the same six yeast strains. The sensory panel significantly differentiated the yeast strains on the attributes of ‘fresh apple’, ‘earthy’ and ‘pear’. Identifying the variety specific influence of individual yeast strains on chemical and sensory characteristics of apple cider will provide cider makers with an enhanced understanding when choosing yeast strains.

1. Introduction

The idea that microorganisms could influence the flavour profiles of beverages was first presented by Louis Pasteur in the 1860s [1]. Yeast activity is a critical factor in the production of cider, primarily for the purpose of producing alcohol [2,3,4]. Alcoholic fermentation is the result of yeast converting sugars into ethanol [5,6]. During the fermentation process, yeast metabolises the sugars available in the substrate, which leads to the production of volatile (e.g., alcohols, esters, and fatty acids) and nonvolatile compounds (e.g., malic acid), which influence both the final aroma and flavour of the cider [6,7,8,9,10]. The development of flavour in ciders is similar to wine, where, through a long history of fermentation research, studies have identified which flavour influencing compounds are: (a) grape-derived, (b) grape-derived then altered by yeast, and (c) the result of the primary metabolism of yeast [11]. The interaction between compounds found naturally in the fruit juice and those developed by the yeast create the sensory experience for the consumer [11].
The most common yeast species used for wine and cider fermentation is Saccharomyces cerevisiae [4,11,12]. The industrial popularity of S. cerevisiae comes from its durability under extreme fermentation conditions, as it can tolerate high sugar content, low pH, and high ethanol [11,13]. The ability to tolerate these environments and produce consistent aroma and taste, as well as for complete fermentation, aids quality control and gives S. cerevisiae a competitive edge over other yeasts [4,11,12].
In the process of converting sugars to ethanol and carbon dioxide, yeast produces a variety of metabolites, which can have organoleptic qualities [6]. Yeast metabolites include esters, higher alcohols, carbonyl compounds, volatile acids, volatile phenol, and sulfur compounds [11]. The production of these compounds is influenced by the yeast strain, as well as fermentation conditions and nutrient availability [6,14]. In previous studies, different yeast strains have been shown to produce a varying intensity of flavour characteristics such as ‘apple or pear’ (in this case correlating with ethyl esters and terpenes) [15], ‘tropical fruity aroma’ (correlating with high production of 3-methylbutyl acetate), ‘nail polish’ (correlating with 2-methylbutan-1-ol, 3-methylbutan-1-ol, and 2-methyl-1-propanol) [12], and ‘sulfur’ (proposed to be driven by hydrogen sulfide) [16]. The spike in different characteristics is driven by the yeast as it creates different biosynthetic pathways during metabolism and, thus, forms different compounds [6,11,14]. The relationship between varietal characteristics of the fruit and the yeast’s ability to form these compounds creates the sensory complexity of fermented beverages such as wine and cider, compared to the sweet, relatively simplistic fruit juices they originated from [11]. The ability for yeast strains to influence flavour in fermented beverages highlights the importance of yeast selection, especially for those fermenting on a commercial scale [17].
In apple cider, the chemical properties that relate to flavour are influenced by the physical cider making process [18], yeast strain [19], variety, and ripeness of the apples being fermented [20]. Phenolic content is commonly used as a quality indicator of apple cider, as phenolic compounds are responsible for colour, mouthfeel, bitterness, and astringency, factors that relate directly to sensorial perception [21,22,23,24]. Consequently, it is expected that changes to total phenolic content (TPC) are likely to be reflected in the sensory experience [21]. Due to the large number of yeast strains and apple varieties to choose from for cider fermentation, it is important that cider producers and yeast manufacturers understand the influence of yeast strain on key cider characteristics and consumer perception in the context of a range of apple varieties [12,25].
This study investigated the influence of yeast on a range of common cider quality attributes. We hypothesized that ciders produced from the same apple variety fermented with different yeasts will be differentiated through base cider chemistry parameters and sensory analyses. To address this hypothesis, we analysed TPC, titratable acidity, pH, and total soluble solids in ciders produced from three apple varieties and six commercial yeast strains, as well as a wild ferment. Of the three apple varieties, cider made from ‘Pink Lady’ apples was used for sensory analysis, using descriptive analysis to test if consumers could differentiate the sensory properties of ciders fermented with different yeast strains.

2. Materials and Methods

2.1. Cider Making

Over two growing seasons, apples of four varieties (‘Pink Lady’ (dessert), ‘Sturmer’ (culinary), ‘Bulmer’s Norman’ (2018 only) (cider), and ‘Frequin Rouge’ (2019 only) (cider)) were collected from the Huon Valley, southern Tasmania, Australia (43.0295° S, 147.0580° E). Apple varieties were chosen to represent the varieties that are readily available and preferred by local cider makers, as well as providing a range of TPC and organoleptic attributes [21]. ‘Dessert’ varieties have typically been bred to provide a balance between crunch and sweetness for eating, whilst also having disease resistance. ‘Cider’ varieties are usually derived from a European background, have a higher phenolic content than dessert and are used primarily for the purpose of cider making [21,26]. ‘Culinary’ (or heritage) varieties are often regarded as dual-purpose apples, as they can be eaten fresh, used in cooking, or for juice or cider. ‘Sturmer’ can be consumed as a dessert variety, added to juice or cider, or be used in cooking.
All apples were harvested aligning with commercial harvest in both seasons. It was not possible to source sufficient ‘Bulmer’s Norman’ apples in 2019 due to climatic conditions affecting the orchard, so ‘Frequin Rouge’ was chosen as a replacement cider variety. Apples were milled and crushed according to the method detailed by Way et al. [21]. Following milling, three × 50 mL juice samples for each apple variety were taken and frozen for juice laboratory analysis. Fermentation (in triplicate) was completed and monitored as in Way et al. [21], with the same protocol followed for all yeast strain treatments, with the only exception being that the ciders were fermented in 1 L glass bottles (4 replicates × each variety × strain). Three commercial yeast strains, Lalvin ICV OKAY (Lallemand, Edwardstown, SA, Australia), Lalvin EC1118 (Lallemand, Edwardstown, SA, Australia), and IOC Be Fruits (Danstar Fermentation A.G., Australia), were used as treatments in the 2018 experiment (Table S1). The trial was repeated in 2019 with an additional three yeast varieties including: Maurivin Elegance (AB Biotek, North Ryde, NSW, Australia), Maurivin UOA Maxithiol (AB Biotek, North Ryde, NSW, Australia), and Mauribrew Weiss (AB Biotek, North Ryde, NSW, Australia) (Table S1). A ‘wild’ treatment was used in both 2018 and 2019 experiments, where the juice was treated the same as it was for the commercial yeast addition, but instead of adding 1 mL of a rehydrated commercial yeast, 1 mL of pure apple juice of the same variety was added to each wild ferment.

2.2. Chemical Analysis

The ciders were centrifuged for 10 min at 4000 rpm and brought to room temperature of 20 °C. pH was measured using a handheld WP-81 pH-Cond-Salinity Meter (TPS, Brisbane, Australia), and titratable acidity (TA) was measured using an automatic titrator (Mettler Toledo g20 Compact Titrator, Greifensee, Switzerland) where results were expressed as g/L of malic acid. The total soluble solids (TSS) of apple juice were measured using a handheld digital refractometer (A. Kruss Optronic, Hamburg, Germany) with results measured in °Brix. The TPC of both juice and base cider was quantified using the Somers method [21], as validated for use in cider by Way et al. [21] by diluting the samples 1:50 in 1M HCl and using a spectrophotometer (SPECTROstar Nano, BMG LABTECH, Windsor, NSW, Australia). The spectrophotometer results, as expressed in absorbance units, were multiplied by the dilution factor (×50); therefore, results are represented as total phenolic index (TPI).

2.3. Descriptive Sensory Analysis

The purpose of the sensory analysis was to quantify potential differences in the flavour profiles of ciders made from different yeast strains by a trained panel of consumers. Descriptive analysis was selected as the most suitable approach due to the volume of cider available as well as the intention of the study. An alternative approach, such as the discriminate method ‘triangle test’, may have differentiated ciders from one another, but cannot provide insight into how they differed and what was driving this difference, as descriptive analysis can [27]. Descriptive analysis allows a tailored approach, where descriptors can be derived from the attributes of the ciders being analysed [28]. To ensure that differences in flavour profiles were attributed to yeast strain, rather than apple variety, only ciders made from one apple variety were used in the sensory analysis. Ciders made from the dessert variety ‘Pink Lady’ were selected for the assessment given the high proportion of dessert apples that are used in cider making (due to their availability) compared to true cider varieties. Pink Lady is representative of dessert varieties in general and was readily available at the time of harvest. Each cider was fermented with a different yeast: Lalvin ICV OKAY (Lallemand), Lalvin EC1118 (Lallemand), IOC Be Fruits (Danstar Fermentation A.G.), Maurivin Elegance (AB Biotek), Maurivin UOA Maxithiol (AB Biotek), Mauribrew Weiss (AB Biotek), and a ‘wild’ ferment.

Sensory Training

Sensory training was conducted at the Tasmanian Institute of Agriculture in June 2020. Ten individuals (aged 25 to 65, six male, four female) were selected based on their availability and desire to participate. The panel was trained over five × 1 h sessions before participating in three formal descriptive analysis sessions. During the sessions, the panel was trained to evaluate and rate intensity of selected attributes. In the first session, the panel was asked to assess four × 30 mL cider samples for odour, taste, and mouthfeel and record three to five attributes they detected in the sample either from a list of potential attributes as in Qin et al. [29], or create their own. Training sessions 2 and 3 involved providing the panel with reference standards according to the attributes chosen in session 1. Thirteen attributes were chosen: nine aroma, and four taste/mouthfeel (Table 1). The odour attributes chosen were: ‘floral’, ‘fresh apple’, ‘cooked apple’, ‘pear’, ‘citrus’, ‘tropical fruit’, ‘earthy’, ‘yeasty’, and ‘chemical’, and for taste, they were: ‘astringent’, ‘sweet’, ‘sour’, and ‘alcoholic’. In the second training session, thirteen glasses were labelled with letters and the participants were asked to match each glass with one of the panel-generated attributes provided to them in a list. In the third session, two sets of the reference standards were presented; one set had weaker reference standards than the previous session, and the other set was stronger. The panel were asked to rate the intensity of each attribute from 0 to 9 on a 9 cm unstructured scale, 0 being ‘absent’ and 9 being ‘high intensity’. In the fourth and fifth training sessions, in preparation for formal analysis, two cider samples that were not included in the formal analysis were presented to each panellist to rate the intensity of each of the thirteen attributes in the provided list. Freshly opened bottles of cider, which had been refrigerated for 10 months, were used for all training sessions.
Formal sensory analysis occurred over three sessions where each panel member was presented with seven × 30 mL ciders per session, rating the intensity for all 13 attributes. The cider samples (30 mL) were served in 215 mL covered ISO/INAO clear glasses in an open-plan room, with all glasses presented at once. Panel members were placed at individual tables over 1.5 m apart and performed individual sensory analysis. Each session, a panel member analysed seven ciders made from ‘Pink Lady’ apples, as described above, each fermented by a different yeast strain. Each panellist was presented with a different randomised order of glasses. For each glass of cider, the panel rated the intensity of each attribute from 0 to 9 on an unstructured 9 cm line scale. Social science ethics approval for the collection of tasting data was obtained from the University of Tasmania’s Social Sciences Human Research Ethics Committee (Ref No: H0018534).

2.4. Statistical Analysis

Chemistry results were analysed using SPSS (IBM SPSS Statistics Version 24) with a multivariate general linear model approach to determine differences between yeasts. Yeast strain and variety were considered as the main effects. A two-way analysis of variance in SPSS was used to determine significant differences between varieties for each of the analytical methods at p ≤ 0.05. A Tukey’s post hoc test was used to determine differences between groups of samples. JMP (ver. 14, SAS Institute, Cary, NC, USA) was used to determine difference between sensory analysis results using a two-way ANOVA with panellist and treatment as the main factors.

3. Results and Discussion

3.1. Base Cider Parameters

The basic physiochemical properties of both juice and cider samples including titratable acidity, pH, and total phenolic content are presented in Table 2. Apple variety had the greatest impact on cider chemical attributes across both seasons consistent with other studies reporting similar findings. Rosend et al. [17] investigated the effect of variety, maturity, and yeast strains on the volatile composition of apple cider and found that variety was the most influential attribute and any yeast effect was variety-specific. During a study comparing the effect of two commercial strains of S. bayanus, Bandić et al. [30] also found variety strongly affected chemical parameters (which included alcohol, sugar-free extract, reducing sugars, and titratable and volatile acidity). Another study found results to be variety-dependent when examining the effects of maceration and press fraction [31]. The TSS (°Brix) of the juice in 2018 was 11 for ‘Pink Lady’, 10.6 for ‘Sturmer’, and 10.8 for ‘Bulmers Norman’, while in 2019, the TSS was measured as 14 for ‘Pink Lady’, 14.2 for ‘Sturmer’, and 15.5 for ‘Frequin Rouge’. In both seasons, no significant differences were observed between varieties for TSS.

3.1.1. Titratable Acidity (TA)

For TA (malic acid content), interactions were found between yeast strain and apple variety in both seasons. In 2018, a significant (p < 0.01) interaction was found between yeast strains (Lalvin ICV ‘OKAY’, Lalvin ‘EC1118’, IOC ‘Be Fruits’, and the wild ferment) and variety, which was heavily influenced by the TA results for cider made from ‘Sturmer’ apples (Figure 1). The ‘Sturmer’ apple cider had significantly greater TA compared to the other two varieties when fermented using the three commercial yeasts ‘EC1118’, ‘OKAY’, and BE ‘Fruits’ (Figure 1). When the same ‘Sturmer’ juice went through wild fermentation, the malic acid content was not significantly different to ciders produced from the other apple varieties. Differences in TA results between the wild ferment and the commercial yeasts, at least for this variety, are likely caused by the inability of the wild yeast to ferment comparably to the commercial yeasts. In contrast, the following season, the wild ferment produced a mid-range TA cider (Table 2). This finding demonstrates the unpredictable nature of using wild ferments, producing inconsistent flavours in comparison to Saccharomyces species, and indicates seasonal variation in results [7]. The changes for wild ferments between the two seasons also explain the possibility that the microorganisms responsible for the wild ferments in season one could be different to those in the second season, again alluding to the unpredictability of an uncontrolled wild ferment. ‘Sturmer’ ciders fermented using ‘Weiss’ and wild yeasts in 2019 had significantly higher TA results than those ciders made using ‘Pink Lady’ and ‘Frequin Rouge’ apples (Figure 2). This interaction is opposite to what was observed in 2018 (Figure 1), suggesting that apple variety and seasonality are strong drivers of variation in TA results during the fermentation process. The interaction between the yeast and variety is likely to be variety-driven; for example, if using Weiss yeast, cider made using ‘Sturmer’ apple juice may have more malic acid content than cider made using dessert or cider varieties. This understanding of how varieties may interact with different yeast strains to produce a range of organoleptic qualities could have a powerful and real impact on the decision making for cider makers [31].
It is clear that season to season variability can influence the flavour outcomes of the ciders produced. In contrast to 2018, the TA results for 2019 ciders showed no significant difference between the ciders fermented by different yeast strains (Table 1). Previous studies have reported comparable results. For example, Leguerinel et al. [19] used 13 strains of S. uvarum fermented with two different apple varieties and showed that the amount of malic acid was mainly dependent on the variety and TA was not significantly affected by yeast strain. Lachowicz et al. [32] showed similar findings using a red flesh apple variety to make cider with both S. bayanus and S. cerevisiae, where malic acid content was unaffected by the different yeast strains. Whilst the yeast used in this trial had a negligible influence on TA and no correlations were found between TA and sensory results (see below), perhaps trialling a yeast such as S. pombe, which has been found to reduce malic acid [33], may have had greater influence on sensory experience. It has been shown that reducing organic acids, particularly malic acid, leads to an increase in pH, which potentially could soften harsh attributes such as sourness and astringency [34,35].

3.1.2. pH

In 2018, a significant (p < 0.001) difference was found in the pH of ciders made with different yeast strains as a main effect, whilst in 2019, a significant (p < 0.001) interaction was found between apple variety and yeast strain (Table 2). In 2018, ciders fermented using the yeast ‘BE Fruits’ were significantly more acidic than those fermented by ‘OKAY’. Whilst significant (p < 0.001), the difference in 2018 between pH measurements of ciders made from different yeasts was 0.06. This difference is unlikely to influence a preference for a particular yeast as pH is often adjusted during cider production if it is >3.8 to prevent microbiological spoilage [26]. In 2019, there was no significant difference between the yeast ‘BE Fruits’ and ‘OKAY’ for any variety. Instead, in 2019, the yeast ‘Weiss’ was the main driver of an interaction between yeast strains and apple variety. ‘Weiss’ yeast produced ciders with significantly greater pH than other yeast strains for both ‘Pink Lady’ and ‘Frequin Rouge’ ciders. However, regardless of the yeast strain used, there was no significant difference for the pH results for all ciders made using ‘Sturmer’ apples in 2019.
The influence that the yeast strain ‘Weiss’ had on the pH for both ‘Pink Lady’ and ‘Frequin Rouge’ ciders in 2019 may be due to this yeast being intended for brewing beer (Figure 3) (Table S1). It is unclear why there was not a similar effect for ‘Sturmer’. Perhaps this is because the pH of ‘Sturmer’ was generally lower across ciders made using all yeasts compared to the other two varieties (Figure 3). This may indicate that regardless of yeast strain, the pH of cider made from the variety ‘Sturmer’ will be unaffected. This is a similar finding to a study using a red-flesh apple that found yeast strain did not significantly affect the pH value of cider [32]. The more complex results occurred for ‘Frequin Rouge’ ciders fermented using ‘Elegance’ and ‘UOA’ were different to wild, but for ‘Pink Lady’, wild and ‘UOA’ were different to ‘BE Fruits’. These findings show how yeast selection can alter base cider properties whilst being variety-specific.
In 2019, for both juice and cider, ‘Frequin Rouge’ had the highest pH, followed by ‘Pink Lady’ and then ‘Sturmer’; this trend was evident for all yeast strains. The difference was driven by varietal interactions with certain strains. For example, cider made with the variety ‘Pink Lady’ had a significantly greater pH when fermented using the ‘Weiss’ strain compared to when fermented using the ‘Elegance’ strain, but this interaction was not seen for other apple varieties. This may indicate to cider makers that yeast strain will not significantly alter the original range of the juice pH when looking at single varieties.
For yeast, the focus is on how the pH influences the fermentation conditions, rather than how the yeast influences the pH [11,36]. Although not statistically comparable, the pH results of the ciders fermented with different yeast strains had less variation in pH than between individual apple varieties across the two seasons. For example, ‘Pink Lady’ cider pH was 3.66 in 2018, then 3.72 in 2019 (Table 2). This is not uncommon as pH has been found to be influenced by season [37] and vary by variety [23,38]. Sadras et al. [37] found there was a complex, variety-specific interaction between seasonal effects, such as temperature and pH in juice.

3.1.3. Total Phenolic Content (TPC)

TPC is a measure of phenolic compounds which are secondary plant metabolites that influence sensorial properties such as bitterness astringency, mouthfeel, and also colour [23,24,25,39,40,41]. As a result, phenolic content is considered a key indicator of the quality of apple cider [21,42]. When ciders were analysed for TPC, it was found that yeast strain had no significant effect on the produced cider. Instead, the phenolic content of the cider was strongly influenced by apple variety (Table 2), particularly observed in the difference between dessert and cider varieties [20,25,31,34,41]. The limited influence of yeast strain on TPC is consistent with findings by Laaksonen et al. [25], who showed that yeast strain had less impact on the phenolic composition of apple ciders than the cider making technique, apple variety, or ripening stage. Yeast has been found to have an effect on phenolic content when using four non-Saccharomyces yeasts as both monocultures and mixed fermentations [12]. In this case, some of the non-Saccharomyces monocultures were able to produce significantly different phenolic contents in specific mixed-yeast fermentations [12].
The results in Table 2 show ciders fermented in 2018 had approximately half the TPC when compared to those fermented and grown in 2019, regardless of the yeast strain used. The juice and cider TPC for both ‘Pink Lady’ and ‘Sturmer’ remained unchanged across the seasons, so it is most likely the change in cider varieties, not seasonality, that increased the overall average TPC in the 2019 trial (Table 2). A greater range of TPC has been found to exist between cider varieties alone than between cider and dessert varieties [31]. This observation is repeated in this study, where the TPC results reported for ‘Bulmer’s Noman’ cider in 2018 were 54.62, while the results for ‘Frequin Rouge’ in 2019 were 127.65 (Table 2).

3.2. Sensory Analysis

The results from the sensory descriptive analysis from ‘Pink Lady’ cider made in 2019 showed that yeast selection can have a significant (p < 0.05) effect on cider sensory attributes. Of the 13 attributes selected by the trained panel, ‘fresh apple’, ‘earthy’, and ‘pear’ were found to significantly differ between samples (Figure 1). The yeast strains varied in their influence across the three attributes. For example, ‘wild’ yeast was the only treatment where the attribute ‘pear’ was distinguished with statistical significance, while the attributes ‘fresh apple’ and ‘earthy’ were identified with statistical significance with the yeast strains: ‘EC1118’, ‘OKAY’, and ‘UOA’ (Figure 4). There was no trend between the three significant attributes, as they were found to differentiate between the yeast strains independently of each other. These results suggest that yeast strains affect the sensory properties of cider, albeit in a manner that is specific to the yeast strain. A potential reason the attribute ‘pear’ may have been differentiated in the wild fermented cider from the other yeasts is due to incomplete fermentation compared to the ciders using commercial yeast strains. The commercial strain, S. cerevisiae, is a characteristically strong and fast fermenter, able to tolerate sulfur and alcohol better than other strains [26]. Ciders that do not ferment through to ‘completion’ or ‘dryness’ contain a proportion of unfermented sugars that completed fermentations do not. These incomplete fermentations can result in more ‘fruity’, ‘fresh’, and ‘sweet’ flavours in the cider [43]. Conversely, ciders that have fermented through to dryness are known to be less ‘sweet’ and ‘fruit’ and more ‘dry’ or ‘astringent’.
The panel successfully differentiated the ciders according to yeast strains for the attribute ‘fresh apple’. ‘Be Fruits’, ‘Weiss’, and ‘UOA MaxiThiol’ are all expected to promote ‘fruity esters’. When separated by significant (p < 0.05) differences for sensory results, ‘Be Fruits’ and ‘Weiss’ ranked high for ‘fresh apple’ and are denoted with an ‘a’, while ‘UOA MaxiThiol’ ranked the poorest and is denoted ‘c’, which suggests vast differences between the two ‘a’ attributes (see Figure 4). While ‘UOA MaxiThiol’ was expected to promote ‘fruity esters’, it is likely such esters are associated with more tropical-fruit attributes rather than apple. Different yeast strains produce different concentrations and types of esters, and ‘fresh apple’ aroma compounds are often associated with acetates [44]. Lorenzini et al. [7] found acetic acid content to vary between yeast strains and Riekstina-Dolge et al. [44] found acetic acids to be characteristic by-product compounds of yeasts.
The panel determined that ciders fermented by ‘UOA Maxithiol’ and ‘OKAY’ had significantly more intense ‘earthy’ aromas when compared to ciders fermented by ‘Weiss’, ‘Elegance’, and wild yeast. The attribute ‘earthy’ has been used in wine sensory studies [45,46,47,48] as well as those relating sensory aspects to yeast strain [36]. Gürbüz et al. [49] suggested high ‘earthy’ values relate to either more oak contact time or greater skin contact time in California Cabernet, neither of which can be directly translated to a cider context. Darriet et al. [50] found through gas chromatography–mass spectrometry that the compound geosmin (trans-1,10-dimethyl-trans-9-decalol) is responsible for the ‘earthy’ aroma, and suggested it is derived from microorganisms that develop on the grape. One commercial yeast strain may not always create a greater quality cider than another, but the strain chosen may help to enhance certain aspects or characteristics that are desired by the cider maker or consumer.
The results suggest that although the panel were able to detect differences between the ciders made with different yeasts, the chemical analyses were possibly not testing the chemical compounds responsible for the differences perceived. For example, TPC is strongly linked to astringency [25,26,51], yet this study found no relationship between the sensory property ‘astringency’ or TPC relating to the different yeast strains used. Riekstina-Dolge et al. [24] showed that variation in cider sensory properties was dependent on apple physiochemical composition in a study looking at the TPC and sensory evaluation of different apple varieties for cider. However, the correlations made between sensory results and physiochemical properties in that study were reliant on the composition of phenolic compounds rather than the total phenolic content [41]. As there was no overlap between the basic physiochemical cider properties measured, and the attributes were found to significantly differ between yeast strains, it is likely the difference in sensory perception was driven by properties not measured during this study, such as volatile compounds [12,29,36,52,53].

4. Conclusions

Improving the understanding of the impact of individual yeast strains on base cider characteristics when using different apple varieties may lead to cider makers choosing specific yeast strains depending on the apple varieties available or preferred. The yeast strain can clearly influence the flavour profile of cider; however, its influence on the flavour profile will differ and depend on the properties being analysed, as shown in this study. We showed that base cider attributes are strongly influenced by variety, and less so yeast strains, yet also are subject to seasonal influences. There was limited overlap between the findings of the base cider characteristics measured analytically and the attributes observed by the panel in this study. Further research focusing on the link between other base cider characteristics not studied here (such as volatiles or specific phenolic compounds) and sensory properties may still find relationships existing between yeast strains and apple varieties, as occurred within the treatments used in this study.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/fermentation8090455/s1, Table S1: Condensed description and technical information of the commercial yeast strains used.

Author Contributions

Conceptualization and methodology of this research were carried out by M.L.W., J.E.J. and N.D.S.; formal analysis, investigation, and data curations by M.L.W. and R.L.; writing—original draft preparation by M.L.W.; writing—review and editing was a joint effort between M.L.W., J.E.J., R.L., R.G.D. and N.D.S. The research was supervised by J.E.J. and N.D.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by a Westpac Future Leaders Scholarship and the Tasmanian Institute of Agriculture at the University of Tasmania with in-kind support from AB Biotek and Lallemand. Apples were supplied in kind from the Grove Research Station and Matthew Griggs of Lucaston Park Orchards.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Research integrity and Ethics Unit of University of Tasmania (protocol code H0018534 and 13/12/2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Not applicable.

Acknowledgments

The authors wish to acknowledge Tim Jones from Willie Smith’s Cider for in-kind apples and whose input and support was greatly appreciated. The authors also wish to acknowledge Fiona Kerslake and Briony Liebich for their sensory support.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Barnett, J.A. A history of research on yeasts 2: Louis Pasteur and his contemporaries, 1850–1880. Yeast 2000, 16, 755–771. [Google Scholar] [CrossRef]
  2. Dashko, S.; Zhou, N.; Compagno, C.; Piškur, J. Why, when, and how did yeast evolve alcoholic fermentation? FEMS Yeast Res. 2014, 14, 826–832. [Google Scholar] [CrossRef]
  3. Leguerinel, I.; Mafart, P.; Cleret, J.; Bourgeois, C. Yeast strain and kinetic aspects of the formation of flavour components in cider. J. Inst. Brew. 1989, 95, 405–409. [Google Scholar] [CrossRef]
  4. Liu, S.-Q.; Aung, M.T.; Lee, P.-R.; Yu, B. Yeast and volatile evolution in cider co-fermentation with Saccharomyces cerevisiae and Williopsis saturnus. Ann. Microbiol. 2016, 66, 307–315. [Google Scholar] [CrossRef]
  5. Bisson, L.F. The biotechnology of wine yeast. Food Biotechnol. 2004, 18, 63–96. [Google Scholar] [CrossRef]
  6. Romano, P.; Ciani, M.; Fleet, G.H. Yeasts in the Production of Wine; Springer: Berlin, Germany, 2019. [Google Scholar]
  7. Lorenzini, M.; Simonato, B.; Slaghenaufi, D.; Ugliano, M.; Zapparoli, G. Assessment of yeasts for apple juice fermentation and production of cider volatile compounds. LWT 2019, 99, 224–230. [Google Scholar] [CrossRef]
  8. Romano, P.; Fiore, C.; Paraggio, M.; Caruso, M.; Capece, A. Function of yeast species and strains in wine flavour. Int. J. Food Microbiol. 2003, 86, 169–180. [Google Scholar] [CrossRef]
  9. Pretorius, I.S.; Høj, P.B. Grape and wine biotechnology: Challenges, opportunities and potential benefits. Aust. J. Grape Wine Res. 2005, 11, 83–108. [Google Scholar] [CrossRef]
  10. Howell, K.S.; Cozzolino, D.; Bartowsky, E.J.; Fleet, G.H.; Henschke, P.A. Metabolic profiling as a tool for revealing Saccharomyces interactions during wine fermentation. FEMS Yeast Res. 2006, 6, 91–101. [Google Scholar] [CrossRef]
  11. Swiegers, J.H.; Pretorius, I.S. Yeast modulation of wine flavor. Adv. Appl. Microbiol. 2005, 57, 131–175. [Google Scholar]
  12. Wei, J.; Zhang, Y.; Wang, Y.; Ju, H.; Niu, C.; Song, Z.; Yuan, Y.; Yue, T. Assessment of chemical composition and sensorial properties of ciders fermented with different non-Saccharomyces yeasts in pure and mixed fermentations. Int. J. Food Microbiol. 2020, 318, 108471. [Google Scholar] [CrossRef]
  13. Al Daccache, M.; Koubaa, M.; Maroun, R.G.; Salameh, D.; Louka, N.; Vorobiev, E. Impact of the physicochemical composition and microbial diversity in apple juice fermentation process: A Review. Molecules 2020, 25, 3698. [Google Scholar] [CrossRef]
  14. Ugliano, M.; Henschke, P.A. Yeasts and wine flavour. In Wine Chemistry and Biochemistry; Springer: Berlin, Germany, 2009; pp. 313–392. [Google Scholar]
  15. Wei, J.; Zhang, Y.; Qiu, Y.; Guo, H.; Ju, H.; Wang, Y.; Yuan, Y.; Yue, T. Chemical composition, sensorial properties, and aroma-active compounds of ciders fermented with Hanseniaspora osmophila and Torulaspora quercuum in co-and sequential fermentations. Food Chem. 2020, 306, 125623. [Google Scholar] [CrossRef]
  16. Rosend, J.; Kuldjärv, R.; Nisamedtinov, I.; Arju, G. Yeast Performance Characterisation in Different Cider Fermentation Matrices. Agron. Res. 2019, 17. [Google Scholar] [CrossRef]
  17. Rosend, J.; Kuldjärv, R.; Rosenvald, S.; Paalme, T. The effects of apple variety, ripening stage, and yeast strain on the volatile composition of apple cider. Heliyon 2019, 5, e01953. [Google Scholar] [CrossRef]
  18. Mangas, J.; Cabranes, C.; Moreno, J.; Gomis, D. Influence of cider-making technology on cider taste. LWT-Food Sci. Technol. 1994, 27, 583–586. [Google Scholar] [CrossRef]
  19. Leguerinel, I.; Cleret, J.; Bourgeois, C.; Mafart, P. Yeast strain and the formation of flavour components in cider. J. Inst. Brew. 1988, 94, 391–395. [Google Scholar] [CrossRef]
  20. Girschik, L.; Jones, J.E.; Kerslake, F.L.; Robertson, M.; Dambergs, R.G.; Swarts, N.D. Apple variety and maturity profiling of base ciders using UV spectroscopy. Food Chem. 2017, 228, 323–329. [Google Scholar] [CrossRef]
  21. Way, M.L.; Jones, J.E.; Nichols, D.S.; Dambergs, R.G.; Swarts, N.D. A Comparison of Laboratory Analysis Methods for Total Phenolic Content of Cider. Beverages 2020, 6, 55. [Google Scholar] [CrossRef]
  22. Alberti, A.; dos Santos, T.P.M.; Zielinski, A.A.F.; dos Santos, C.M.E.; Braga, C.M.; Demiate, I.M.; Nogueira, A. Impact on chemical profile in apple juice and cider made from unripe, ripe and senescent dessert varieties. LWT-Food Sci. Technol. 2016, 65, 436–443. [Google Scholar] [CrossRef]
  23. Thompson-Witrick, K.A.; Goodrich, K.M.; Neilson, A.P.; Hurley, E.K.; Peck, G.M.; Stewart, A.C. Characterization of the polyphenol composition of 20 cultivars of cider, processing, and dessert apples (Malus× domestica Borkh.) grown in Virginia. J. Agric. Food Chem. 2014, 62, 10181–10191. [Google Scholar] [CrossRef]
  24. Sanoner, P.; Guyot, S.; Marnet, N.; Molle, D.; Drilleau, J.-F. Polyphenol profiles of French cider apple varieties (Malus domestica sp.). J. Agric. Food Chem. 1999, 47, 4847–4853. [Google Scholar] [CrossRef]
  25. Laaksonen, O.; Kuldjärv, R.; Paalme, T.; Virkki, M.; Yang, B. Impact of apple cultivar, ripening stage, fermentation type and yeast strain on phenolic composition of apple ciders. Food Chem. 2017, 233, 29–37. [Google Scholar] [CrossRef]
  26. Jolicoeur, C. The New Cider Maker's Handbook: A Comprehensive Guide for Craft Producers; Chelsea Green Publishing: Hartford, VT, USA, 2013. [Google Scholar]
  27. Piggott, J.R.; Simpson, S.J.; Williams, S.A. Sensory analysis. Int. J. Food Sci. Technol. 1998, 33, 7–12. [Google Scholar] [CrossRef]
  28. Longo, R.; Pearson, W.; Merry, A.; Solomon, M.; Nicolotti, L.; Westmore, H.; Dambergs, R.; Kerslake, F. Preliminary study of Australian Pinot noir wines by colour and volatile analyses, and the Pivot© Profile method using wine professionals. Foods 2020, 9, 1142. [Google Scholar] [CrossRef]
  29. Qin, Z.; Petersen, M.A.; Bredie, W.L. Flavor profiling of apple ciders from the UK and Scandinavian region. Food Res. Int. 2018, 105, 713–723. [Google Scholar] [CrossRef]
  30. Bandić, L.; Žulj, M.M.; Fruk, G.; Babojelić, M.S.; Jemrić, T.; Jeromel, A. The profile of organic acids and polyphenols in apple wines fermented with different yeast strains. J. Food Sci. Technol. 2019, 56, 599–606. [Google Scholar] [CrossRef]
  31. Way, M.L.; Jones, J.E.; Swarts, N.D.; Dambergs, R.G. Phenolic content of apple juice for cider making as influenced by common pre-fermentation processes using two analytical methods. Beverages 2019, 5, 53. [Google Scholar] [CrossRef]
  32. Lachowicz, S.; Oszmiański, J.; Uździcka, M.; Chmielewska, J. The Influence of Yeast Strain, β-Cyclodextrin, and Storage Time on Concentrations of Phytochemical Components, Sensory Attributes, and Antioxidative Activity of Novel Red Apple Ciders. Molecules 2019, 24, 2477. [Google Scholar] [CrossRef]
  33. Mylona, A.; Del Fresno, J.; Palomero, F.; Loira, I.; Bañuelos, M.; Morata, A.; Calderón, F.; Benito, S.; Suárez-Lepe, J. Use of Schizosaccharomyces strains for wine fermentation—effect on the wine composition and food safety. Int. J. Food Microbiol. 2016, 232, 63–72. [Google Scholar] [CrossRef]
  34. He, W.; Liu, S.; Heponiemi, P.; Heinonen, M.; Marsol-Vall, A.; Ma, X.; Yang, B.; Laaksonen, O. Effect of Saccharomyces cerevisiae and Schizosaccharomyces pombe strains on chemical composition and sensory quality of ciders made from Finnish apple cultivars. Food Chem. 2021, 345, 128833. [Google Scholar] [CrossRef] [PubMed]
  35. Laaksonen, O.; Mäkilä, L.; Tahvonen, R.; Kallio, H.; Yang, B. Sensory quality and compositional characteristics of blackcurrant juices produced by different processes. Food Chem. 2013, 138, 2421–2429. [Google Scholar] [CrossRef] [PubMed]
  36. Lambrechts, M.; Pretorius, I. Yeast and its importance to wine aroma-a review. S. Afr. J. Enol. Vitic. 2000, 21, 97–129. [Google Scholar] [CrossRef]
  37. Sadras, V.O.; Petrie, P.R.; Moran, M.A. Effects of elevated temperature in grapevine. II juice pH, titratable acidity and wine sensory attributes. Aust. J. Grape Wine Res. 2013, 19, 107–115. [Google Scholar] [CrossRef]
  38. Alonso-Salces, R.M.; Barranco, A.; Abad, B.; Berrueta, L.A.; Gallo, B.; Vicente, F. Polyphenolic profiles of Basque cider apple cultivars and their technological properties. J. Agric. Food Chem. 2004, 52, 2938–2952. [Google Scholar] [CrossRef]
  39. Ye, M.; Yue, T.; Yuan, Y. Evolution of polyphenols and organic acids during the fermentation of apple cider. J. Sci. Food Agric. 2014, 94, 2951–2957. [Google Scholar] [CrossRef]
  40. Alberti, A.; Zielinski, A.A.F.; Zardo, D.M.; Demiate, I.M.; Nogueira, A.; Mafra, L.I. Optimisation of the extraction of phenolic compounds from apples using response surface methodology. Food Chem. 2014, 149, 151–158. [Google Scholar] [CrossRef]
  41. Riekstina-Dolge, R.; Kruma, Z.; Dimins, F.; Straumite, E.; Karklina, D. Phenolic composition and sensory properties of ciders produced from Latvian apples. Rural. Sustain. Res. 2014, 31, 39–45. [Google Scholar] [CrossRef]
  42. Calugar, P.C.; Coldea, T.E.; Salanță, L.C.; Pop, C.R.; Pasqualone, A.; Burja-Udrea, C.; Zhao, H.; Mudura, E. An Overview of the Factors Influencing Apple Cider Sensory and Microbial Quality from Raw Materials to Emerging Processing Technologies. Processes 2021, 9, 502. [Google Scholar] [CrossRef]
  43. Xiong, Z.R.; Chen, A.; Jiang, G.Z.; Lewis, A.G.; Sislak, C.D.; Cobo, M.; Worobo, R.W.; Gibney, P.A. Evaluation of Foodborne Pathogen Die-off in Back-Sweetened Wine and Apple Cider Models. J. Food Prot. 2021, 84, 1023–1032. [Google Scholar] [CrossRef]
  44. Riekstina-Dolge, R.; Kruma, Z.; Karklina, D.; Seglina, D. Composition of aroma compounds in fermented apple juice: Effect of apple variety, fermentation temperature and inoculated yeast concentration. Procedia Food Sci. 2011, 1, 1709–1716. [Google Scholar]
  45. Pittari, E.; Moio, L.; Arapitsas, P.; Curioni, A.; Gerbi, V.; Parpinello, G.P.; Ugliano, M.; Piombino, P. Exploring Olfactory–Oral Cross-Modal Interactions through Sensory and Chemical Characteristics of Italian Red Wines. Foods 2020, 9, 1530. [Google Scholar]
  46. Pickering, G.; Lin, J.; Riesen, R.; Reynolds, A.; Brindle, I.; Soleas, G. Influence of Harmonia axyridis on the sensory properties of white and red wine. Am. J. Enol. Vitic. 2004, 55, 153–159. [Google Scholar]
  47. Ou, C.; Du, X.; Shellie, K.; Ross, C.; Qian, M.C. Volatile compounds and sensory attributes of wine from cv. Merlot (Vitis vinifera L.) grown under differential levels of water deficit with or without a kaolin-based, foliar reflectant particle film. J. Agric. Food Chem. 2010, 58, 12890–12898. [Google Scholar] [CrossRef]
  48. Styger, G.; Prior, B.; Bauer, F.F. Wine flavor and aroma. J. Ind. Microbiol. Biotechnol. 2011, 38, 1145. [Google Scholar] [CrossRef]
  49. Gürbüz, O.; Rouseff, J.M.; Rouseff, R.L. Comparison of aroma volatiles in commercial Merlot and Cabernet Sauvignon wines using gas chromatography− olfactometry and gas chromatography−mass spectrometry. J. Agric. Food Chem. 2006, 54, 3990–3996. [Google Scholar] [CrossRef]
  50. Darriet, P.; Pons, M.; Lamy, S.; Dubourdieu, D. Identification and quantification of geosmin, an earthy odorant contaminating wines. J. Agric. Food Chem. 2000, 48, 4835–4838. [Google Scholar] [CrossRef]
  51. Ye, M.; Yue, T.; Yuan, Y. Changes in the profile of volatile compounds and amino acids during cider fermentation using dessert variety of apples. Eur. Food Res. Technol. 2014, 239, 67–77. [Google Scholar] [CrossRef]
  52. Francis, I.; Newton, J. Determining wine aroma from compositional data. Aust. J. Grape Wine Res. 2005, 11, 114–126. [Google Scholar] [CrossRef]
  53. Kheir, J.; Salameh, D.; Strehaiano, P.; Brandam, C.; Lteif, R. Impact of volatile phenols and their precursors on wine quality and control measures of Brettanomyces/Dekkera yeasts. Eur. Food Res. Technol. 2013, 237, 655–671. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Titratable Acidity (TA) of cider made with each yeast strain for all three apple varieties in 2018.
Figure 1. Titratable Acidity (TA) of cider made with each yeast strain for all three apple varieties in 2018.
Fermentation 08 00455 g001
Figure 2. Titratable Acidity (TA) of cider made by each yeast strain for all three apple varieties in 2019.
Figure 2. Titratable Acidity (TA) of cider made by each yeast strain for all three apple varieties in 2019.
Fermentation 08 00455 g002
Figure 3. pH of cider made by each yeast strain in 2019, for all three apple varieties.
Figure 3. pH of cider made by each yeast strain in 2019, for all three apple varieties.
Fermentation 08 00455 g003
Figure 4. Sensory profiles of ‘Pink Lady’ ciders made using 7 different yeast strains shown for ‘BE Fruits’, ‘Weiss’, ‘Elegance’, Wild, ‘EC1118’, ‘OKAY’. And ‘UOA Maxithiol’ yeasts, respectively). Lletters under the attributes ‘fresh apple’, ‘pear’, and ‘earthy’ indicate a statistically significant difference at p < 0.001.
Figure 4. Sensory profiles of ‘Pink Lady’ ciders made using 7 different yeast strains shown for ‘BE Fruits’, ‘Weiss’, ‘Elegance’, Wild, ‘EC1118’, ‘OKAY’. And ‘UOA Maxithiol’ yeasts, respectively). Lletters under the attributes ‘fresh apple’, ‘pear’, and ‘earthy’ indicate a statistically significant difference at p < 0.001.
Fermentation 08 00455 g004
Table 1. Sensory attributes chosen by sensory panel and corresponding reference standards’ compositions.
Table 1. Sensory attributes chosen by sensory panel and corresponding reference standards’ compositions.
AttributeReference Standard a
Odour
Floral120 mL elderflower juice
Fresh apple1 chopped fresh apple, 50 mL apple juice (Spreyton Fresh)
Cooked apple1 chopped fresh apple in boiling water for 5 min
Pear1 chopped fresh pear, 50 mL pear juice (Bickford’s)
Citrus50 mL juice and half of one chopped fresh grapefruit and one half of one chopped lemon
Tropical fruit1 cup of fresh chopped pineapple, ½ cup of chopped melon
Earthy1 chopped large potato, 4 chopped cup mushrooms
Yeasty1.5 g of commercial yeast (Lalvin EC1118 (Lallemand))
Chemical10 μL ethyl acetate
Taste
Sweet15 g white sugar (CSR)
Sour50 mL apple cider vinegar (Cornwell’s)
Astringent20 mL commercial winemaking tannin (Enartis)
Alcoholic10 mL of 95% ethanol
a In 500 mL of 50:50 filtered water: base cider (made from ‘Pink Lady’ apples, fermented by EC1118 cider) to have 30 mL poured into an ISO/INAO clear glass for each panellist.
Table 2. Mean TA (malic acid mg/mL), pH, and TPC (TPI) of initial juice (N = 1) samples and ciders for each variety as well as ciders fermented using different yeast strains (average of all three apple varieties) in 2018 and 2019. Cider results represent the average of all yeast strains combined. (* represents p ≤ 0.05, ** is p < 0.01, and *** p < 0.001. Different letters denote significant differences between means at p ≤ 0.05. No significant difference is denoted by “ns”).
Table 2. Mean TA (malic acid mg/mL), pH, and TPC (TPI) of initial juice (N = 1) samples and ciders for each variety as well as ciders fermented using different yeast strains (average of all three apple varieties) in 2018 and 2019. Cider results represent the average of all yeast strains combined. (* represents p ≤ 0.05, ** is p < 0.01, and *** p < 0.001. Different letters denote significant differences between means at p ≤ 0.05. No significant difference is denoted by “ns”).
TApHTPC
201820192018201920182019
JuicePink Lady4.364.673.773.584.504.00
Sturmer6.766.903.653.459.009.50
Bulmer’s Norman2.06 3.65 45.0
Frequin Rouge 2.24 4.06 71.0
CiderPink Lady6.265.283.66 b3.727.96 a7.63 a
Sturmer7.677.113.59 a3.5412.45 b14.79 b
Bulmer’s Norman6.09 3.56 a 54.62 c
Frequin Rouge 4.33 3.88 128 c
Significance *** ******
Yeast StrainWild6.295.663.62 ab3.7223.4849.96
OKAY6.555.473.63 b3.7226.0349.24
EC11186.535.783.60 ab3.7025.1448.85
BE Fruits7.315.713.57 a3.6925.4048.70
Weiss 5.38 3.79 50.95
Elegance 5.55 3.69 53.51
UOA Maxithiol 5.58 3.73 52.18
Significance ** nsns
Interaction (cider variety × yeast strain)****ns***nsns
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Way, M.L.; Jones, J.E.; Longo, R.; Dambergs, R.G.; Swarts, N.D. A Preliminary Study of Yeast Strain Influence on Chemical and Sensory Characteristics of Apple Cider. Fermentation 2022, 8, 455. https://doi.org/10.3390/fermentation8090455

AMA Style

Way ML, Jones JE, Longo R, Dambergs RG, Swarts ND. A Preliminary Study of Yeast Strain Influence on Chemical and Sensory Characteristics of Apple Cider. Fermentation. 2022; 8(9):455. https://doi.org/10.3390/fermentation8090455

Chicago/Turabian Style

Way, Madeleine L., Joanna E. Jones, Rocco Longo, Robert G. Dambergs, and Nigel D. Swarts. 2022. "A Preliminary Study of Yeast Strain Influence on Chemical and Sensory Characteristics of Apple Cider" Fermentation 8, no. 9: 455. https://doi.org/10.3390/fermentation8090455

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop