1. Introduction
Sedentary behaviour refers to a complex set of behaviours taking place in a range of settings [
1,
2] and is defined as any waking, sitting, reclining or lying behaviour with low energy expenditure (≤1.5 Metabolic Equivalent of Tasks (METs)) [
3]. Children have a higher resting energy expenditure than adults, therefore 2 METs is the recommended upper boundary for children’s sedentary behaviours [
4]. Recently the Sedentary Behaviour Research Network published consensus definitions for terms relating to sedentary behaviour. Standing still is one activity that has received attention, as it cannot be classed as sedentary behaviour, but falls under the category of stationary behaviour. Stationary behaviour is defined as “any waking behaviour done while lying, reclining, sitting, or standing, with no ambulation, irrespective of energy expenditure” [
3]. The metabolic cost of standing still is thought to be low [
5] and it has been recommended, just as for prolonged seated positions, that standing still for long periods should also be avoided [
6], despite this, many studies to date have not examined stationary time.
Recently, sedentary behaviour has received increased attention as an independent health risk factor. Evidence suggests that sedentary behaviour contributes to a number of health-related conditions in children, independent of physical activity [
7,
8,
9]. Accurate monitoring of not only volume, but also types of sedentary behaviour is important before the focus can shift to that of developing effective intervention strategies [
10]. Accelerometers are widely accepted objective methods of monitoring children’s physical activity levels [
11] and sedentary behaviour [
12]. However, most accelerometers are unable to differentiate between postures and have been found to both overestimate [
13] and underestimate [
14] sedentary time. GENEActiv and ActiGraph wrist accelerometers can predict a person’s most likely posture (sit or stand) through a method known as the Sedentary Sphere [
15], but this has not been validated in children. Traditionally, researchers have used accelerometer output reduced to proprietary counts, but counts-based data limits comparisons between studies using different brands [
16]. Physical activity intensity cut points derived from raw acceleration output have been developed for the GENEActiv and ActiGraph GT3X+ accelerometers [
17], making comparisons between these devices and placements (wrist and hip) possible [
18] whilst also increasing researcher control over data processing. Although previous studies have attempted to establish raw sedentary thresholds [
19,
20,
21,
22,
23,
24,
25], none of these studies focused solely on children’s sedentary behaviours, rather focusing on physical activity or adult populations. Hildebrand, Van Hees, Hansen and Ekelund [
17] used Euclidean norm minus one (ENMO), a data reduction method which results in signal vector magnitude (SVM) values not dependent on sampling frequency or epoch length, allowing for easier comparison between studies. Hildebrand and colleagues have published ActiGraph and GENEActiv ENMO thresholds for physical activity [
17] and sedentary time [
24] generated from a lab-calibration study. The sedentary thresholds were generated using two sedentary ‘stations’ (lying, watching television and sitting, using a computer) within a wider physical activity calibration protocol. The resultant thresholds were subsequently applied to free-living data but demonstrated low accuracy when compared with activPAL data [
26]. One potential reason for the reduced performance during free-living activities was that the stations included within the circuit were not representative of the range of sedentary behaviours that children engage in.
The present study applied the ENMO method to five sedentary activities representative of typical child behaviours. Data collection took place in the school gymnasium, mimicking a laboratory calibration study setting, but increasing the feasibility and ecological validity of the protocol involved. Furthermore, during a subsequent study, the thresholds were applied to free-living data and compared with data from activPAL as the criterion reference.
The aims of this study were: (1) to compare the raw accelerometer output of ActiGraph (AG) and GENEActiv (GA) accelerometers across different placements; (2) to identify raw acceleration signal thresholds for different sedentary behaviours in children, from both the hip and wrist, using AG and GA; and (3) to validate the thresholds during free-living activities.
2. Materials and Methods
2.1. Participants
After gaining ethical approval from the Research Ethical Committee of Liverpool John Moores University (16/SPS/056), all year 5 children (n = 60, 9–10 years old), from one primary school in Liverpool, England, were invited to participate in the calibration study. After receiving signed informed parental/carer consent and child assent forms, 27 children (17 girls) took part in this study. During a subsequent study (17/SPS/034), 21 children (13 girls, 9–10 years old) from two primary schools in Liverpool were recruited to participate in the free-living study.
2.2. Anthropometrics
Participants’ body mass was measured in light clothing without shoes, to the nearest 0.1 kg using electronic scales (Seca, Birmingham, UK). Stature and sitting height were measured to the nearest 0.1 cm using a stadiometer (Leicester Height measure; Seca, Birmingham, UK). Waist circumference was measured at the midpoint between the bottom rib and the iliac crest, to the nearest 0.1 cm using a non-elastic measuring tape (Seca, Birmingham, UK). Sex-specific regression equations [
27] were used to predict children’s age from peak height velocity, which is a proxy measure of biological maturation. Participants self-reported their dominant hand.
2.3. Sedentary Behaviour
2.3.1. Calibration Study Protocol
Each participant was fitted with six accelerometers: one ActiGraph GT9X (AG; ActiGraph, Pensacola, FL, USA) and GENEActiv (GA; ActivInsights Ltd., Cambridgeshire, UK) monitor on each wrist (next to each other, in no specific or consistent order), an ActiGraph GT3X on the right hip and an activPAL (PAL Technologies Ltd., Glasgow, UK) monitor on the right anterior thigh. All monitors were worn throughout the testing protocol, which involved seven different stations representative of sedentary behaviour and light physical activity (see
Table 1 for detailed description of the stations), with three participants rotating between the stations during each session. Before the standing with phone and sitting with tablet stations, participants were asked whether they were familiar with the games involved. All the participants knew the first game, while two participants were unfamiliar with the second game and they were given time to familiarise themselves with it. The activities were performed for five minutes each, in no particular order except for television viewing, which was always completed first in an effort to prevent the television from distracting participants during the other activities. The stations were designed to simulate children’s typical sedentary activities. Participants’ start and end times for each activity were observed with a Garmin Forerunner 235 wristwatch (synchronized with the same computer time used to initialise all monitors) and recorded. The researchers observed the participants completing the stations (while standing a few meters away). After each session in the school gymnasium, the participants continued to wear the monitors for at least 10 minutes during school recess. Participants were instructed to play as they normally would during recess, while the researchers observed and videotaped them from the side-line. Observational data is not presented here. The testing protocol lasted between 50 and 70 min per data collection session, with two sessions completed per day.
2.3.2. Free-Living Protocol
As part of a separate study, participants were fitted with three monitors: an AG GT9X and GA (both on the non-dominant wrist, with AG distal to GA) as well as an activPAL on the thigh. They were asked to wear the monitors for two days, only removing the wrist-worn monitors for water-based activities. Participants were given log sheets to record when they removed the monitors. After two days the GA and activPALs were collected, while participants continued to wear the AG as part of a larger study.
2.4. Accelerometers
The GA, AG GT9X and GT3X are small, lightweight tri-axial accelerometers with a dynamic range of ±8 g. All GA and AG monitors were initialised with a sampling frequency of 100 Hz. While the AG GT9X looks like a watch and shows the time, it is more appealing to wear on the wrist than the slightly bigger, more cumbersome AG GT3X that is more suitable for the hip. The activPAL is a small, single-site lightweight activity monitor that uses proprietary algorithms to classify an individual’s free-living activity into periods spent sitting, standing and walking. It collects data at a sampling frequency of 20 Hz and the default settings were used within this study.
All GA data were downloaded using GENEActiv PC software version 3.1 and saved in raw format as binary files. AG data were downloaded using ActiLife version 6.13.3, saved in raw format as .gt3x files and converted to time-stamped .csv files for data processing. ActivPAL data were downloaded using activPAL3 version 7.2.32, saved as .datx files and converted to .csv event files for processing.
2.5. Data Reduction
Signal processing of GA .bin files and AG .csv files was completed using R package GGIR version 1.5-17 (
https://cran.r-project.org/web/packages/GGIR/). The free-living data were processed using GGIR version 1.5-24. GGIR converts the raw tri-axial acceleration values from GA and AG into one omnidirectional measure of body acceleration using the ENMO metric [
28], with negative values rounded up to zero. The ENMO metric is sensitive to poor calibration [
28]; however, GGIR autocalibrates the raw tri-axial accelerometer signal in order to reduce the calibration error [
29]. Autocalibration was carried out for free-living data, but not for the calibration protocol where data were collected over a short period of time. GGIR further reduces the data by calculating the average values per 1 s epoch. The first and last 30 s of data from each activity were excluded to remove any potential transitional movements. The central four minutes were manually extracted and utilised for analysis. Data from all the participants (27) completing the sedentary activities were used to compare accelerometer output across brands and placements. All resulting values are expressed in milli (10
−3) gravity-based acceleration units (mg), where 1 g = 9.81 m/s
2.
In order to generate raw acceleration sedentary thresholds using receiver operating characteristic (ROC) curve analysis, data from activPAL were used as the criterion standard. The activPAL “Event” files provide exact time in seconds when posture changes occur, classifying events into sedentary, stand and step. Using an Excel formula, these files were expanded to second-by-second data, classifying each second into sit/lie (0), stand (1) or step (2). The activPAL files contain duplicate seconds, where two postures occurred during the same second. Our Excel formula chose the posture that the participant transitioned into as the classification for that particular second. This happened 28 times (i.e., 28 s) during the 28 h and 20 min of data used for the analysis. All 27 participants’ data from the sedentary stations were used in this part of the analysis, together with 23 of the participants’ recess data. During one data collection session, cold weather prohibited three participants from going outside to play during recess and on another occasion, one participant’s activPAL fell off. The resultant second-by-second activPAL files were synchronised with the 1 s ENMO values from ActiGraph and GENEActiv. ActivPAL data were coded in two different ways: Sit/Lie (0) vs. Stand/Step (1) and Sit/Lie/Stand (0) vs. Step (1).
During the free-living period, all valid hours between 7:00 and 21:00 on the second day of data collection were included in the analysis. Hours were deemed invalid when the monitors were removed for any number of minutes during that hour, according to the log sheets. Data files were visually inspected using ActiGraph, GENEActiv and activPAL software, to verify recorded log sheet wear time [
30]. Thirty-one hours were excluded due to non-wear, while two participants’ activPALs fell off resulting in another 18 h being excluded.
2.6. Data Analysis
Factorial repeated-measures analysis of variance (ANOVA), with Bonferroni corrections were undertaken to determine whether there were differences in output between brands (AG and GA) and placements (dominant- and non-dominant wrists) (interaction effect, brand x placement) for each activity on the circuit. Effect sizes are reported as partial eta-squared (η
2), with 0.02, 0.13 and 0.26 defined as small, medium and large respectively [
31]. Separate one-way repeated measures ANOVAs were undertaken to compare output from the AG hip and wrist monitors. Where assumptions of sphericity were violated, the conservative Greenhouse–Geisser corrected values of the degrees of freedom were used. Only data from the sedentary stations were used for this part of the analysis.
ROC curve analyses were used to identify raw acceleration sedentary and stationary thresholds, from the whole data collection session (sedentary stations and the recess data), with the activPAL data used as the criterion reference standard. To maximise both sensitivity and specificity, the Youden index (
J; Perkins and Schisterman [
32]) was used to identify thresholds. Two ROC curves were generated for each of the five monitors used: the first one was to distinguish between sedentary and non-sedentary behaviours (i.e., sit/lie vs. stand/step), while the second one distinguished between stationary and active behaviour (i.e., sit/lie/stand vs. step).
In addition, all free-living seconds with a corresponding accelerometer output below the developed thresholds were coded as either sedentary or stationary, while all other seconds were coded as non-sedentary or non-stationary. Agreement between sedentary time according to the thresholds and time spent sitting according to activPAL was examined using paired t-tests and effect sizes calculated as Cohen’s
d [
31] with 0.2, 0.5 and 0.8 defined as small, medium and large. The same was done with the stationary time according to the stationary thresholds and time spent sitting plus standing according to activPAL. Bland–Altman plots compared AG and GA data with that of activPAL. 95% limits of agreement were calculated by mean difference ±1.96 standard deviation of the differences [
33]. Free-living data are expressed in minutes or as percentage of total wear time. Furthermore, we also report the following, as recommended by DeShaw et al. [
34]: Pearson product correlations, mean percent errors (MPE), mean absolute percent errors (MAPE), and equivalence testing, all as described by DeShaw and colleagues [
34].
Statistical analyses were performed using IBM SPSS, version 24 (IBM, Armonk, UK), with the level of statistical significance set at p ≤ 0.05 and Microsoft Excel 2016 (Microsoft, Redmond, WA, USA).
4. Discussion
The first aim of this study was to compare the raw accelerometer output of AG and GA accelerometers across three different placements. The significantly lower output observed from the AG hip monitors (compared with wrists) is consistent with previous findings [
18,
24,
35]. These results suggest that sedentary behaviour studies should not compare data collected using hip monitors to ones using wrist monitors unless effective harmonisation approaches are used.
Inconsistent differences between monitors and placements were observed across the range of sedentary and stationary activities. The differences by activity could be attributed to the nature of the sedentary behaviours themselves. While the unique nature of children’s physical activity patterns have been well established [
36], little is known about differences in their sedentary behaviours. For example, the homework and standing with phone stations overall had the lowest average accelerometer output of all the stations, even lower than television viewing and resting. Even though statistically significant, many of these differences were small, as seen in
Table 3 and
Table 4. With the exception of walking and LEGO
®, the mean differences in output between activities ranged from 0.88 mg to 7.48 mg, differences that are unlikely to be meaningful. A possible explanation for the inconsistencies observed between monitors might be internal differences between devices. The difference observed between brands, although statistically significant, yielded a small effect size, which is unlikely to be meaningful. The dominant wrist monitors produced a higher output for most of the activities. Previous studies have used either the non-dominant wrist [
18,
37] or the dominant wrist [
38,
39], with few studies comparing outputs between these two placements. Two studies that compared wrist placements [
19,
20] found no significant differences between these two sites; however, these studies did not differentiate between dominant and non-dominant wrists, but rather compared the right side with the left. A recent study [
38] argues for the use of the dominant wrist in an effort to capture more activities requiring the use of the dominant hand.
The second aim of this study was to develop raw acceleration thresholds for sedentary and stationary behaviours in children. The lower classification accuracy (AUC) for differentiating between sedentary and non-sedentary behaviour may be partially attributed to the misclassification of some activities by activPAL. Comparing the direct observation notes with the activPAL data showed that activPAL misclassified sitting as standing on a number of occasions for different participants. For example: for two participants activPAL misclassified the entire duration of the seated homework station (5 min) as standing. Similar inconsistencies were found throughout the data which amounted to a total of 30 min of data. This may have had an impact on the accuracy of the thresholds generated using activPAL and the free-living validation. A possible explanation for this may lie in the nature of children’s sedentary behaviours (not sitting completely still for example). Participants might have been sitting on the edges of their seats, with their legs hanging down and thighs outside of the threshold angle to be classified as sitting by activPAL. Children were instructed to sit, however, researchers did not ask participants to sit with their legs at a specific angle to reflect the ‘typical’ behaviour of each child. The misclassifications observed suggest that the activPAL may underestimate sitting and overestimate standing, which is consistent with findings from another study [
40]. Other observations made by the researchers include the participants’ inability to lie still during the resting station. Participants were instructed to lie down and rest, as still as possible. This in practice seemed very difficult for the participants, which explains why the resting station did not result in the lowest accelerometer output, as might have been expected. Rather, it ranks fourth in total accelerometer output, with TV viewing, standing with phone and the homework station resulting in lower total accelerometer outputs.
The stationary activity ‘standing with phone’, produced the second lowest output from wrist monitors and the lowest output from hip monitors, highlighting the fact that children stand exceptionally still while playing with a mobile phone. Adding “stand” to the second ROC curve analysis (stationary behaviour) resulted in higher classification accuracy (the lowest being the GA dominant wrist with an AUC = 0.888 and highest the AG hip with AUC = 0.944) than when standing was excluded. Using stationary activity also removed the issues associated with the misclassification of activities by the activPAL. Despite this, the resultant thresholds for stationary behaviour are similar to those for sedentary behaviour, except for a slight difference between non-dominant wrists. Using the dominant wrist thresholds in future studies would thus capture both stationary and sedentary behaviours.
In comparison to those of Hildebrand, Hansen, van Hees and Ekelund [
24] our threshold for AG hip monitors is lower (32.6 mg versus 63.3 mg), while our AG non-dominant wrist threshold is higher (48.1 mg versus 35.6 mg). Our GA non-dominant wrist threshold is slightly lower than that of Hildebrand et al. (51.6 mg versus 56.3 mg) who did not include the dominant wrist in their protocol. Sensitivity and specificity were higher in the Hildebrand et al. [
24] results, possibly because of protocol differences: Hildebrand used two sedentary activities in a controlled laboratory environment and four light-to-vigorous physical activities. Hildebrand also concluded that posture misclassification from activPAL might have attributed to the lower specificity observed. Another noticeable difference between our results and those from Hildebrand is that our specificity increased greatly when we included the standing activity (e.g., from 57% to 85% for the GA non-dominant wrist monitors), while Hildebrand’s increased when they excluded the standing activity from their analysis. This observation is likely due to protocol differences. For example, during a standing activity in the Hildebrand protocol children were allowed to draw on a whiteboard, which probably resulted in more movement than our standing with a phone station.
Our GA non-dominant wrist threshold (51.6 mg) is similar to the recently published 51 mg by Boddy, Noonan, Kim, Rowlands, Welk, Knowles and Fairclough [
26]. Our sensitivity was slightly higher than that of Boddy et al. [
26] (87% vs. 81%), with both studies’ specificity at 57%. There is a 3.5 mg and 3.2 mg difference in our resultant sedentary and stationary thresholds estimated with AG and GA for non-dominant wrist, respectively. As previously stated, these small differences might be the result of internal differences between devices, and unlikely to be meaningful in practice. Future researchers might decide to use 50 mg as sedentary threshold and 60 mg as stationary threshold for both brands, facilitating comparisons between studies.
For two participants, there were periods classified as sitting by activPAL during recess. Observational data showed that the participants were not sitting, but rather hunching down during play (for example crouching behind an object during hide and seek). While the posture classification from activPAL was correct, the behaviour was not sedentary, which again highlights the differing nature of children’s sedentary behaviours in comparison to adults and the value of observational data. Similar observations were made during an activPAL validation in preschool children [
40] whereby the postures lie, sit, stand and walk were too limited for the range of positions children assume during play time. Cumulatively these findings question the suitability of using activPAL to classify what appears to be a wide range of sedentary behaviours performed by children.
During the free-living period, results from the paired t-tests as well as the various indicators of measurement agreement suggested that the sedentary thresholds performed better than the stationary thresholds compared with data from activPAL. The sedentary cut points for both AG and GA slightly overestimated time spent sedentary compared with time spent sitting/lying according to activPAL. While these were significant differences, the effect sizes were relatively small and equivalence testing showed that the 48 mg AG cut point came close to achieving equivalence with activPAL on average at the group level. Conversely, stationary cut points for both AG and GA underestimated time spent sitting/lying plus standing according to activPAL. For both brands, the computed MPE and MAPE values for the stationary thresholds were the same, confirming that all the error was in one direction (i.e., an underestimation of stationary time).
The main reason for the differences observed between cut points and activPAL data is that we are essentially comparing a lack of movement (or very little movement) with posture classifications. When using cut points to analyse sedentary behaviour data, researchers should acknowledge that there are certain circumstances that can result in misclassification. For example, where a lack of movement at the wrist will be classified as sedentary using cut points, the participant might in fact be standing. Conversely, the stationary thresholds’ underestimation of stationary time is likely due to children moving their arms while standing. This behaviour is called “active standing” (defined as waking activity characterised by energy expenditure above 2.0 METs, while standing without ambulation [
3]). When using cut points to analyse the data, it is unlikely that wrist-worn accelerometers would be able to differentiate between active standing and light-intensity physical activity with ambulation, for example slow walking, meaning this behaviour is incorrectly classified. Achieving an accurate estimate of stationary behaviours appears to be challenging using wrist-mounted accelerometers in the absence of postural information. While we agree with the recently published consensus definitions of sedentary and stationary behaviours [
3], we do argue that it is better to misclassify passive standing (like playing with a mobile phone) as sedentary behaviour rather than as physical activity when identifying children that would benefit from intervention; therefore, we recommend the use of the sedentary thresholds in practice. From a health perspective, it is better to overestimate sedentary time than to underestimate sedentary or stationary behaviours, as active children can still participate in interventions aiming to decrease sedentary or stationary time without causing any harm. Conversely, underestimating sedentary time might result in children not being identified for intervention and ultimately exposed to increased health risk. Where more accurate measures of sedentary and stationary time from wrist-worn accelerometers are needed, using postural approaches such as the Sedentary Sphere [
15] method in children might be a better option, although validation studies are required to examine this further.
Our study has several strengths. The protocol included seven different activities, representing a wide range of ‘typical behaviours’ in children, as well as playtime data. It took place in a school gymnasium and outside on the playground, spaces that the participants were familiar and comfortable with. This increased the ecological validity of the protocol involved. The participants wore six different monitors each, and raw data processing as opposed to proprietary counts allowed for various direct comparisons between brands and placements. There are also some limitations: we used a convenience sample and all the participants came from the same school, which might not be representative of the wider population. The homogeneous sample of 9- to 10-year-old children should not be considered representative of all children, and further studies are needed for younger and older populations to expand these findings. The activities were not performed in the same order for each participant, however, no formal randomisation techniques were used. AG and GA monitors were placed next to each other on the wrist, in no specific or consistent order [
41]. Placing one brand consistently distal to the other might have resulted in increased acceleration from that brand, however no formal randomisation techniques were used. Whilst activities were designed to reflect children’s typical sedentary behaviours, METs could not be measured and as a result we cannot assume that energy expenditures during the protocol were at all times ≤1.5 METs. The protocol in the school gymnasium highlighted the fact that activPAL sometimes misclassifies children’s postures, and we have to assume that the same might have happened during the free-living period. However, except for direct observation, which was unfeasible for this study, there is no other tool that can be used as a criterion measure.