Abstract
This review and meta-analysis (PROSPERO registration number: CRD42020138845) critically evaluates test-retest reliability, concurrent validity and criterion validity of different physical activity (PA) levels of three most commonly used international PA questionnaires (PAQs) in official language versions of European Union (EU): International Physical Activity Questionnaire (IPAQ-SF), Global Physical Activity Questionnaire (GPAQ), and European Health Interview Survey-Physical Activity Questionnaire (EHIS-PAQ). In total, 1749 abstracts were screened, 287 full-text articles were identified as relevant to the study objectives, and 20 studies were included. The studies’ results and quality were evaluated using the Quality Assessment of Physical Activity Questionnaires checklist. Results indicate that only ten EU countries validated official language versions of selected PAQs. A meta-analysis revealed that assessment of moderate-to-vigorous PA (MVPA) is the most relevant PA level outcome, since no publication bias in any of measurement properties was detected while test-retest reliability was moderately high (rw = 0.74), moderate for the criterion (rw = 0.41) and moderately-high for concurrent validity (rw = 0.72). Reporting of methods and results of the studies was poor, with an overall moderate risk of bias with a total score of 0.43. In conclusion, where only self-reporting of PA is feasible, assessment of MVPA with selected PAQs in EU adult populations is recommended.
1. Introduction
Increasing the level of physical activity (PA) has become one of the priorities of public health policies in most developed countries in the world [1]. Over the last thirty years, we have witnessed an accelerated increase in the quantity of interventions to increase PA worldwide, although with limited effects [2,3,4,5]. Creating optimal policies and planning effective interventions aimed at increasing PA is not possible without reliable data on the prevalence of physical inactivity [1]. Hence, numerous global authorities have called for concerted efforts in PA surveillance [6,7,8]. Conversely, how to execute PA monitoring is not entirely clear. Although methods for the assessment of PA are numerous, given the complex nature of PA, none of the currently available methods can assess all PA dimensions (duration, frequency, intensity and type of PA).
Based on the literature review, we can classify scientific methods for determining PA as direct observations or objectively assessed PA and indirect or subjectively assessed PA [9,10,11]. Large PA surveillance systems have, until recently, relied solely on PA questionnaires (PAQs) as one of the subjective assessments of PA [12]. Questionnaires are easy to apply in large groups of individuals and are therefore the basic method of assessing PA in large epidemiological studies. However, this method is subject to recall bias, which typically leads to overestimation of PA [13]. Therefore, some of the large PA surveillance systems have recently begun to rely on objective assessments by accelerometers to monitor activity levels [14]. Although the validity of accelerometers has been tested in numerous settings [15,16,17] and despite the fact that accelerometers have proved to be more reliable and valid than PA questionnaires [18,19,20], several shortcomings have to be noted, such as the underestimation of energy expenditure during uphill walking, cycling, load carrying, etc. [21] Additionally, other important issues for large surveillance systems might be costs [22], demanding data reduction procedures and obtrusiveness of devices, which reduces compliance and increases non-wear time [23], specialized training required for assessors and the need for the physical proximity of participants. On the other hand, the advancement in technology has led to the development of commercial activity monitors for personal use. Recent evidence on accuracy of these devices indicates that this technology could be a very useful tool for surveillance systems [15,24,25,26,27,28,29,30]; however, at the moment, PAQs still prevail [12,31,32].
In designing a monitoring system for PA, a harmonized approach using a single, international instrument is preferred to enable cross-country comparisons. However, because PA is a behavior, the cultural environment should be taken into account when the same PA questionnaire is used in different countries [1,33]. Namely, most PAQs rely on a person remembering activities they participated in, or self-estimates of the intensity of the recalled PA [34]. Therefore, the cultural context and country-specific types of PA are very important for the interpretation of questions, and consequently for the content validity of a PAQ [33,35].
Within the project EUPASMOS, which aims to establish PA, sedentary behavior patterns and sport participation monitoring framework in the European Union (EU) member states, we searched for studies performed in the EU, and described measurement characteristics of nationally adapted versions of the three most commonly used international PAQs intended for trans-national surveillance and aimed at generating comparable estimates across countries: (i) International Physical Activity Questionnaire-Short form (IPAQ-SF), which was the first instrument developed for PA surveillance activities, implemented in several large surveillance programs both globally and in Europe [36], and is the most frequently used and validated PAQ [37,38]; moreover, items from this PAQ are included in Eurobarometer, which is one of the tools used for decision-making in the EU [39] and is also the most commonly used PAQ in European national surveillance systems [40]; the (ii) Global Physical Activity Questionnaire (GPAQ) was designed by the World Health Organization (WHO) as a part of the STEPwise approach to chronic disease risk factor surveillance and was implemented in more than 120 countries globally [35,41], and is the most widely used PAQ also internationally [40]; and (iii) European Health Interview Survey-Physical Activity Questionnaire (EHIS-PAQ), created under the auspicies of Eurostat [40], and is used in the only currently available EU-wide surveillance system of all member states, and includes PA [33,42].
Selected PAQs have some common features, but many specifics. IPAQ is an instrument that was developed to establish a standardized and culturally adaptable measurement tool for measuring PA in different cultural areas of the world [33]. The short form of IPAQ (IPAQ-SF) comprises nine items [35]. IPAQ-SF is an open-ended questionnaire, last 7-days recall, available in English and many other languages, covering four domains of PA (leisure time PA, domestic activities, work-related PA, transport-related PA) in each of four types of PA (sitting, walking, moderate-intensity activities and vigorous-intensity activities) [43]. The outcome of the IPAQ-SF is MET min/week and PA category score. Although the original version of the IPAQ (IPAQ-L) is slightly more reliable, it has proven to be too long and less comprehensible compared to IPAQ-SF [44], making the latter more user-friendly. GPAQ uses a typical week recall and is somewhat longer than the IPAQ-SF. It has 16 questions and covers three domains of PA (work, transport and leisure) and sedentary behavior [45]. GPAQ can differentiate between two intensities of PA (vigorous and moderate) [35]. Both GPAQ and IPAQ were designed to compare PA levels in different cultural settings around the world. On the other hand, EHIS-PAQ is an EU-specific questionnaire within the European Health Interview Survey. EHIS-PAQ is a domain-specific questionnaire with last 30-days recall, which includes 8 questions, covering three domains of PA (work-related, transport-related and leisure time), and distinguishes between aerobic and muscle-strengthening PA [46]. Although some reviews and meta-analysis of measurement properties of PAQs have already been published [38,47,48,49], there is still lack of knowledge addressing this issue on the European population is very multi-national, multi-cultural and multi-lingual.
Therefore, the purpose of this systematic review and meta-analysis is to critically appraise, compare and summarize the measurement properties (reliability, criterion validity, construct validity) of PAQs most commonly used in trans-national surveillance systems for adults in EU-official language versions, taking the methodological quality of these studies, as well as the quality of the evidence, into account.
2. Materials and Methods
The meta-analysis was performed and reported in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines [50,51]. The present work was registered at the International Prospective Register for Systematic Reviews, identification code CRD42020138845.
2.1. Search Strategy
An identical search strategy was employed in PubMed, SportDiscus, Scopus, Dart and ResearhGate databases, looking for studies describing measurement properties of three international PAQs from April to May 2018. The search was later updated to include articles published between May 2018 and May 2020. We used the following search string “name of the questionnaire e.g., IPAQ AND (valid * OR reliab * OR repeat * OR reproducib * OR assess * OR measure *)”. Additional studies were identified by manually searching the reference lists of the full papers identified during the search. Grey literature was additionally reviewed through ResearchGate, Google Scholar and Mendeley, using only keyword “name of the questionnaire e.g., IPAQ AND valid *” and through personal communication of members of the research team with other scientists. Additional literature that corresponds to the eligibility criteria of the present review was also obtained through an online questionnaire posted on the platform 1KA (University of Ljubljana, Faculty of Social Sciences) with the help of the World Health Organization within EUPASMOS project activities. National health-enhancing physical activity (HEPA) focal points were asked to report on any national research, reports and doctoral theses, published in their national languages that examined the measurement properties of any of the three PAQs included in this study. All articles generated from the initial search were stored on Mendeley reference management software and researcher network (Elsevier, Amsterdam, The Netherlands) which was used to remove duplicate references.
2.2. Eligibility Criteria
Studies included in the present review had to be peer-reviewed, include healthy adults (18 years old or older), carried out in one of the EU countries (28 countries included—United Kingdom was still part of the EU and was, therefore, included in this review) and published in one of the EU’s 24 official languages. For the purposes of the present review only those studies which examined one or more of the most commonly used standardized PAQs in the EU [35,36,37,38,39,40,41], were included: IPAQ-SF, which was the first developed PA surveillance instrument [36] and the most frequently used PAQ in EU [37,38]; GPAQ, which is with 120 countries is the most used PAQ in the world [35,40,41]; and EHIS-PAQ, which is the only available EU surveillance system used by all EU member countries [33,42]. Studies needed to report the following characteristics: (i) PAQ translation protocol, (ii) mode of administration (interview, self-administered) and (iii) reliability or (iv) concurrent validity or (v) criterion validity of included PAQ. Studies performed in special populations (e.g., participants with specific medical conditions) were excluded.
The time interval between the test and retest must have been described and short enough that the subject’s PA could not have changed, but long enough to prevent recall [37]. For PA assessment during the current or previous week, a recall period of 1 day to 3 months was considered appropriate [37].
2.3. Quality and Risk of Bias Assessment
The assessment of the risk of bias of included studies was conducted using the criteria, previously used by Sneck [52] and Sember [53], which includes the criterion of power calculations. Each study received “0” (does not meet the criterion) or “1” (meets the criterion) for each criterion based on an analysis of the reporting in the original article. Methodological quality was assessed following the QAPAQ checklist [54], which was developed specifically for qualitative assessment of PA questionnaires. Risk of bias assessment and methodological quality was performed by two independent reviewers (Vedrana Sember and Kaja Meh)
2.4. Data Extraction and Statistical Analysis
Abstract and full-text article screening, data extraction and quality assessment were performed by two independent reviewers (Vedrana Sember and Kaja Meh) who also checked all databases and identified potential studies through the search process to identify potentially relevant articles. In case of uncertainty, a third and fourth reviewer (Gregor Jurak and Gregor Starc) screened the article. Summary tables of entered data were checked with the trial protocol and latest trial report or publication. Any discrepancies or unusual patterns were checked with the study principal investigator. A Hunter-Schmidt estimate was used for reducing the amount of bias and Fisher’s z transformation was applied to samples’ correlations to display publication bias [50,51]. We also assessed publication bias with Egger’s bias test [55] for all PA constructs, separately for reliability, concurrent and criterion validity.
For further analysis, correlation (rw) coefficients were determined by the Hunter-Schmidt approach [55,56], which was multiplied by the sample size of each study (rw × N). The generalizability of rp was corrected using an artefact correction and variance sample. For weighted means (rw), 95% credibility interval: CIw = rw + 1.96√Vp and I2 and Q statistics to measure heterogeneity of ES were calculated. Statistical analysis is explained in more detail elsewhere [53]. A forest plot was generated with online software “DistillerSR Forest Plot Generator” from Evidence Partners.
2.5. Data Synthesis
Results of 20 studies were synthesized into four categories: (1) General characteristics of selected studies of PAQs across the EU; (2) reliability of PAQs in selected studies across the EU; and (3) concurrent validity of PAQs in selected studies across the EU: Criterion validity of PAQs in selected studies across EU. The systematic review synthesized 20 studies and the meta-analysis synthesized only 17 studies, since it was performed only for moderate (MPA), moderate-to-vigorous (MVPA), vigorous (VPA) and total PA (tPA), and 3 studies failed to report these metrics.
2.6. Grading the Level of Evidence
Reliability levels of evidence were formulated following van Poppel and colleagues (2010) levels of evidence: (1) adequate time between test and retest and use of interclass correlation (ICC), Kappa or Concordance reliability score >0.7; (2) inadequate time interval between test and retest and use of ICC, Kappa or Concordance reliability score <0.7, adequate time interval between test and retest, Pearson/Spearman correlation >0.7; (3) an inadequate time interval between test and retest, Pearson/Spearman correlation <0.7. An additional grade was given depending on the number of participants and the level of index or correlation. A positive score (+) was given for studies with >50 participants and reliability coefficients >0.70. A negative (−) score was assigned to studies with <50 participants and reliability coefficients <0.70. Pearson and Spearman correlation were considered inadequate due to known systematic errors [57] and therefore only ICC, Kappa or Concordance were deployed in level (1) of evidence. Validity is the degree to which an instrument measures constructs [54]. The highest level of criterion validity evidence would be comparing PAQs to the gold standard—doubly labelled water (DLW) [58]. However, DLW also includes basal metabolic rate and the thermic effects of food, and therefore the use of other validated instruments is more reliable for obtaining construct validity. This is done by comparing a PAQ to another PAQ (concurrent validity), and accelerometers (criterion validity). For concurrent and criterion validity, the research team established the following levels of evidence: (1) concurrent validity score >0.8; (2) 0.8> validity score ≥0.5; (3) concurrent validity score <0.5. A positive score (+) was given for studies with >50 participants and a negative (−) score was given for studies with <50 participants.
3. Results
The flow of the review process is shown in Figure 1. In total, 4969 abstracts were identified, 1749 records were screened, 287 full-text articles were identified and read and 20 studies were finally included in the present review (Figure 1). The characteristics of the included studies are presented in Table 1. We included studies from 18 different EU countries, mostly from the United Kingdom (7), Spain (5) and Germany (3). Three studies were cross-national [33,59,60]. Table 1 represents information from all 20 studies included in the present review of selected PAQs [33,35,46,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75], including the country where the study was carried out, the sample size, participants’ age and gender, sample description, modes and means of administration of selected studies.
Figure 1.
Flowchart showing the study identification process.
Table 1.
General characteristics of selected studies of PAQs across the EU.
Altogether, 5997 people in 23 different sub studies participated. The age range of included participants in all studies was between 18 and 75 years. In 18 out of 20 studies, the gender proportion of participants was included, whereas in two studies, gender proportion was unknown [75,76]. Regarding sampling procedures, 13 studies used convenient sample (65%), 4 random sampling (20%), 1 quota sampling (5%), 1 multistage stratified probability sampling (5%) and one study did not report a sample description [61]. Most of the studies (n = 13) used a self-administered mode of administration, 4 used an interview and 2 used telephone interviews. In one study, both self-administered questionnaires and an interview mode was used. All of the included studies assessed the duration and frequency of physical activity.
Table 2 represents information from eight studies regarding the reliability of PAQs in selected studies across the EU [33,46,64,65,68,70,72,76], including information about measurement interval, results (Pearson r, Spearman ρ, Lin’s concordance correlation and Phi coefficient) and quality ratings. Most studies assessed test-retest reliability for MPA (30), and the least test-retest reliability for MVPA (5). The information for concurrent validity was reported in seven PAQ studies across the EU [33,35,46,69,70,72,75]. Information about comparison method, measured construct, correlation coefficient results and quality ratings are shown in Table 2. Most of these studies assessed the concurrent validity for tPA (11) and the least for VPA (6). Table 2 represents information from 13 studies regarding the criterion validity of PAQs in selected studies across the EU [33,46,59,62,63,64,65,68,70,71,72,73,74], including information on the country where the study was carried out, the duration of the objective assessment, the number of valid days and minutes per day, the method for validity comparison, cut-off points, epoch length, the definition of non-wear time and measured constructs. Most studies assessed the criterion validity for VPA and tPA (both 11) for MPA, while the fewest studies assessed the criterion validity for MPA (both 9).
Table 2.
Results for test-retest reliability, concurrent validity and criterion validity.
Based on weighted correlation means, measurement construct test-retest performed the best in construct MVPA (rw = 0.74), where 3 associations (of 5) were graded with level of evidence 1 (rw = 0.74) and 2 with levels of evidence 2 (rw = 0.73); whereas the worst were in MPA (rw = 0.40) (Table 3), where 28 of 30 associations were graded with a level of evidence of 3 (rw = 0.41) and only 2 with grade 2 (rw = 0.58).
Table 3.
Summary results for test-retest reliability, concurrent validity and criterion validity across all included studies stratified by PA intensity.
Based on weighted correlation means, concurrent validity was best for VPA (rw = 0.72), where 4 associations were graded with levels of evidence 1 (rw = 0.82) and 5 associations with levels of evidence 2 (rw = 0.62) (Table 3). Concurrent validity was the lowest for tPA (rw = 0.22), where 9 associations were evaluated with levels of evidence 2 (rw = 0.64) and 2 with levels of evidence 3 (rw = 0.38). On the other hand, VPA showed the highest validity (rw = 0.72), but it should be noted that the Egger test (−5.63) showed a significant bias between included correlations coefficients in VPA (p < 0.0001). Based on weighted correlation means, measurement construct performed the best for VPA (rw = 0.48), where 4 associations were evaluated with a level of evidence of 2 (rw = 0.64) and 7 associations with a grade of 3 (rw = 0.30); the worst criterion validity was noted for MPA (rw = 0.14) (Table 3), with all 9 associations graded with the level of evidence of 3. Once again, although the highest criterion validity was noted for VPA, the Egger test (−5.59) showed a significant bias between included correlations coefficients in VPA (p < 0.0001). Results of weighted correlation coefficients for test-retest reliability, concurrent validity and criterion validity across all included studies stratified by PA intensity are presented in Figure 2.
Figure 2.
Forest plot of weighted correlation coefficients for measurement characteristics stratified by PA intensity (Note: POP—population; ESW—weighted ES; LCI—lower confidence interval; UCI—upper confidence interval).
The Egge’s bias test [53] provided evidence for publication bias for the following measurement characteristics and PA constructs: concurrent validity VPA (bias = −5.63, 95% CI: −6.80 to −4.46, p < 0.0001), concurrent validity tPA (bias = −0.14, 95% CI: 6.47 to 6.20, p = 0.97), criterion validity VPA (bias = −5.59, 95% CI: −7.38 to −3.81, p < 0.0001) and criterion validity tPA (bias = −3.22, 95% CI: −6.55 to 0.11, p = 0.09) (Table 3). The results of the risk-of-bias assessment are shown in Table 4. The total average risk of bias of all included studies was moderate (0.43). Of the 20 studies, only two were rated as having a low risk of bias (≥67% of total score) with an average of 0.73 of the total score; 10 were rated as having a moderate risk of bias (>33 and <67% of the total score) with an average of 0.45 of the total score and 8 studies were rated as having a high risk of bias (<33% of total score) with an average of 0.32 of the total score. Only 6 studies (33%) reported power calculations to determine a sufficient sample size and only 3 studies met the assumption of randomization, which is not so important to determine the reliability and validity of questionnaires [77].
Table 4.
Results of the risk-of-bias assessment.
4. Discussion
This systematic review and meta-analysis investigated the test-retest reliability, concurrent validity and criterion validity of the three most commonly used PAQs across the EU in national language versions: IPAQ-SF, GPAQ and EHIS-PAQ. We identified 20 studies that adequately tested selected PAQs in the recent 17-year period between 2003 and 2020.
The main findings include the following: (i) IPAQ, GPAQ and EHIS-PAQ were validated for MPA, MVPA and VPA in only 10 countries across EU; (ii) the assessment of MVPA is the most relevant PA outcome, since no publication bias in any of the measurement characteristics were detected and test-retest reliability was moderately high (rw = 0.74), while both criterion (rw = 0.41) and concurrent validity (rw = 0.72) were judged to be moderate; (iii) reporting of methods and results of the studies was rather poor, leading to a high risk of bias in 8 studies and a moderate risk of bias in 10 studies, resulting in an overall moderate risk of bias with a total score of 0.43; and (iv) the representation of different EU countries may be biased, since out of 20, 7 were from the UK, 5 from Spain, 3 from Germany, 2 from Lithuania and 1 from the other countries.
Our results revealed that MPA reached the lowest overall correlations for reliability and criterion validity (reliability rw = 0.42; criterion validity rw = 0.14) and MVPA reached the lowest correlations for concurrent validity (rw = 0.41). VPA reached the highest overall correlations (reliability rw = 0.53; concurrent validity rw = 0.72; criterion validity rw = 0.48), but we also found publication bias in concurrent and criterion validity for this PA construct. All measurement characteristics were moderate-to-high for MVPA (reliability rw = 0.74; concurrent validity rw = 0.41; criterion validity rw = 0.41). Since we did not detect publication bias in any of the measurement characteristics for MVPA, we suggest the assessment of MVPA to be the most relevant PA outcome. To a larger extent, research findings indicate that MVPA in particular positively influences the health of the adult population, which also resulted in the development of recommendations for policymakers to increase the MVPA of the European population [1].
Although there is no single rule of the thumb relating to an adequate sample size, test-retest intervals and statistical analysis, academics have recommended the acceptable ratio of survey items and participants to be 1:5 [49,78], including test-retest interval between three and eight days [78] and the use of ICC and Pearson correlation coefficient [54]. Based on our qualitative rating, only 8 out of 311 PA constructs within different measurement characteristics received grade 1, 144 constructs were awarded with grade 2 and 149 with grade 3. Low qualitative ratings were mostly given because studies did not use the interclass correlation (ICC), Kappa or Concordance reliability score, but the majority of studies used the Spearman coefficient of association. We recommend researchers to use Kappa or ICC in the future, because they also take into account rater bias [79]. This is a foundation for concern, since more than half of the constructs did not satisfy the preferred recommendations for assessing the reliability and validity of PAQs, and calls for a more rigorous study design in future reliability and validity investigations.
It is promising that the reliability of investigated PAQs was found to be moderate to high (rw = 0.40 to 0.74). Of even greater importance, time intervals with the exception of two studies [46,76] were within the optional range [78] of the test-retest interval and ranged mostly between three and eight days. Since the reliability of MVPA and tPA was high even in the two aforementioned studies [49,78] that used one month interval between repeated assessments, this methodological weakness [49] does not hamper the conclusions of this study.
PAQs showed low-to-moderate validity (rw = 0.13 to 0.48) against measures of objectively measured PA and moderate-to-high validity against subjective measures of PA (other PAQs). Our results are comparable with previous reports [48,80] that showed the validity of PAQs to range from 0.1 to 0.50 against objective measures of PA [81]. However, it should be noted that the criterion validity was validated in only six different national versions for IPAQ (Ireland, Lithuania, Spain, Sweden, Finland and United Kingdom) and four different national versions for GPAQ (Austria, Belgium, Spain and the United Kingdom) across the EU. Results indicate differences in the validity between different versions, and therefore the remaining countries assessing PA do not even know how valid their data are. Moreover, factors explaining the variation in the validity of PAQs may relate to differences in the qualitative attributes of PAQs, such as recall period and number of items as well as heterogeneity of population. It is well documented that there are differences in the prevalence of overweight and obesity [82] and physical fitness levels between different nations and countries [83], which is the governing factor to assess PA with a questionnaire. PAQs are assessing the subjective perception of PA, which is conditioned by physical fitness. Accordingly, it is exceptional that only a few studies reported the reliability and validity of PAQ, observing differences in validity between countries and sex according to body mass index (BMI) [35,62], whereas we have not found a single study that used physical fitness as a criteria. It has been found that a high BMI can reduce accuracy of devices, such as accelerometers and heart rate monitors [84]. Additionally, PA data with self-reports seems to be over- or under-estimated among participants with higher BMI [84]. We believe one of the important factors affecting the variability of PAQs’ validity to be the different physical fitness levels of the participants, and therefore an inclusion of this control might allow for a more objective assessment of PA, as well as better international comparability of PA data. The rather low concurrent validity scores found in our study may be explained by the different recall periods in investigated PAQs. Next, objective measures of PA are less dependent on long-term variation, and can more accurately capture sporadic and intermittent behaviors [48], which results in a higher validity of measured PA constructs, but a lower criterion validity of PAQs. It was often blurred which dimension of PA a PAQ was supposed to measure, which made assessing concurrent validity sometimes impossible. Moreover, it was extremely difficult to assess whether the same or somewhat modified versions of PAQs were used in some studies, and it was not always clear whether the data were derived from a self-report questionnaire or whether the questionnaire was part of an interview [37]. Nevertheless, most of the studies enthusiastically concluded that PAQ is valid, but they did not take into account risk of bias and quality assessment. However, when we applied criteria for risk of bias and quality assessment, we found this conclusion to be over-optimistic, which is in concordance with a previous review [37].
Limitations
There are several limitations of this study that should be acknowledged: (i) although we systematically searched five biggest databases in the field of PA twice and with different investigators, it is possible that not all relevant studies are included in the present meta-analysis; (ii) the most commonly used PAQs in the included studies were IPAQ (7) and GPAQ (6), while EHIS-PAQ was included because it is the only questionnaire that is a part of the PA surveillance system of all EU member states [40]. GPAQ uses a typical week to assess PA data; however, a typical week can be different in many European countries due to weather conditions yielding different PA levels. (iii) The season of the assessed PA was not taken into account, and therefore different results could be reported from studies since the EU has four seasons; (iv) even though the quality of each study was assessed, findings from studies of a lower quality were given no less importance than the other findings; (v) sample type might have a potential impact on the results of the study, since 13 out of 20 used convenience sampling; (vi) meta-analysis included only 17 studies, whereas the systematic review included 20 studies; (vii) coefficients of associations were reported whether or not they were significant or insignificant in initial studies, potentially leading to different results if only significant results were used; (viii) according to the PROSPERO register we left Eurobarometer out of the manuscript since we did not find any validation studies; (ix) this review includes studies from the UK, although at the time of publication, the UK is no longer a part of the EU; (x) although there exist other widely used PA questionnaires, targeting specific parts of the populations, such as Physical Activity Scale for the Elderly [85], we focused only on the questionnaires targeting the general adult population; and (xi) results of the present meta-analysis refers only to the adult population and are not necessarily valid in other populations such as the elderly, children and patients.
5. Conclusions
Where only self-reporting is affordable due to time limitations and resources of the large-scale PA monitoring in EU adults, assessment of MVPA with GPAQ, IPAQ-SF or EHIS-PAQ is recommended. All EU countries should validate the translated PAQs in their national settings. In the validation studies, it would be advisable to employ BMI, physical fitness indicators or objective assesments of PA as validation criteria. Lastly, in order to further improve the validity and reliability of PAQ in adults, the researchers should report the results in a standardized manner to allow for the improved quality of assessment and a lower the risk of bias.
Author Contributions
Conceptualization, M.S., G.S., V.S and G.J.; methodology, V.S.; software, V.S.; formal analysis, V.S.; investigation, V.S. and K.M.; resources, G.J.; data curation, V.S. and K.M.; writing—original draft preparation, V.S.; writing—review and editing, V.S., P.R., M.S. and G.J.; visualization, V.S.; supervision, G.J. and G.S.; project administration, G.J.; funding acquisition, P.R. and G.J. All authors have read and agreed to the published version of the manuscript.
Funding
This research was co-funded by the Erasmus+ Programme of the European Union within the project EUPASMOS No 590662-EPP-1-2017-1-PT-SPO-SCP and Slovenian Research Agency within the Research programme Bio-psycho-social context of kinesiology No P5-0142.
Acknowledgments
The authors acknowledge the support of the HEPA Europe national focal points and other national representatives who provided information on PAQs validated in their countries.
Conflicts of Interest
The authors declare no conflict of interest.
References
- Hallal, P.C.; Andersen, L.B.; Bull, F.C.; Guthold, R.; Haskell, W.; Ekelund, U. Global Physical Activity Levels: Surveillance Progress, Pitfalls, and Prospects. Lancet 2012, 380, 247–257. [Google Scholar] [CrossRef]
- De Meester, F.; van Lenthe, F.J.; Spittaels, H.; Lien, N.; De Bourdeaudhuij, I. Interventions for Promoting Physical Activity among European Teenagers: A Systematic Review. Int. J. Behav. Nutr. Phys. Act. 2009, 6, 82. [Google Scholar] [CrossRef]
- Baranowski, T. Increasing Physical Activity among Children and Adolescents: Innovative Ideas Needed. J. Sport Health Sci. 2019, 8, 1–5. [Google Scholar] [CrossRef]
- Lewis, B.A.; Napolitano, M.A.; Buman, M.P.; Williams, D.M.; Nigg, C.R. Future Directions in Physical Activity Intervention Research: Expanding our Focus to Sedentary Behaviors, Technology, and Dissemination. J. Behav. Med. 2017, 40, 112–126. [Google Scholar] [CrossRef]
- Coughlin, S.S.; Stewart, J. Use of Consumer Wearable Devices to Promote Physical Activity: A Review of Health Intervention Studies. J. Environ. Health Sci. 2016, 2. [Google Scholar] [CrossRef]
- Andersen, L.B.; Andersen, S.A.; Bachl, N.; Banzer, W.; Brage, S.; Brettschneider, W.-D.; Ekelund, U.; Fogelholm, M.; Froberg, K.; Gil-Antunano, N.P. EU Physical Activity Guidelines: Recommended policy Actions in Support of Health-Enhacging Physical Activity Fourth Consolidated Draft, Approved by the EU-working Group. Available online: https://eacea.ec.europa.eu/sites/eacea-site/files/eu-physical-activity-guidelines-2008.pdf (accessed on 1 August 2020).
- WHO. Physical Activity Strategy for the WHO European Region 2016–2025; WHO: Geneva, Switzerland, 2015; ISBN 978-92-890-5147-7. [Google Scholar]
- European Commission. EU Action Plan on Childhood Obesity 2014–2020. A Growing Health Challenge for the EU; European Commission: Brusselss, Belgium, 2014; pp. 1–68. [Google Scholar]
- Warren, J.M.; Ekelund, U.; Besson, H.; Mezzani, A.; Geladas, N.; Vanhees, L. Assessment of Physical Activity–A Review of Methodologies with Reference to Epidemiological Research: A Report of the Exercise Physiology Section of the European Association of Cardiovascular Prevention and Rehabilitation. Eur. J. Cardiovasc. Prev. Rehabil. 2010, 17, 127–139. [Google Scholar] [CrossRef]
- Silfee, V.J.; Haughton, C.F.; Jake-Schoffman, D.E.; Lopez-Cepero, A.; May, C.N.; Sreedhara, M.; Rosal, M.C.; Lemon, S.C. Objective Measurement of Physical Activity Outcomes in Lifestyle Interventions among Adults: A Systematic Review. Prev. Med. Rep. 2018, 11, 74–80. [Google Scholar] [CrossRef]
- Dowd, K.P.; Szeklicki, R.; Minetto, M.A.; Murphy, M.H.; Polito, A.; Ghigo, E.; van der Ploeg, H.; Ekelund, U.; Maciaszek, J.; Stemplewski, R. A Systematic Literature Review of Reviews on Techniques for Physical Activity Measurement in Adults: A DEDIPAC Study. Int. J. Behav. Nutr. Phys. Act. 2018, 15, 15. [Google Scholar] [CrossRef]
- Bel-Serrat, S.; Huybrechts, I.; Thumann, B.F.; Hebestreit, A.; Abuja, P.M.; De Henauw, S.; Dubuisson, C.; Heuer, T.; Murrin, C.M.; Lazzeri, G. Inventory of Surveillance Systems Assessing Dietary, Physical Activity and Sedentary Behaviours in Europe: A DEDIPAC Study. Eur. J. Public Health 2017, 27, 747–755. [Google Scholar] [CrossRef]
- Helmerhorst, H.H.J.F.; Brage, S.; Warren, J.; Besson, H.; Ekelund, U. A Systematic Review of Reliability and Objective Criterion-Related Validity of Physical Activity Questionnaires. Int. J. Behav. Nutr. Phys. Act. 2012, 9, 103. [Google Scholar] [CrossRef]
- Pedišić, Ž.; Bauman, A. Accelerometer-Based Measures in Physical Activity Surveillance: Current Practices and Issues. Br. J. Sports Med. 2015, 49, 219–223. [Google Scholar] [CrossRef]
- Ferguson, T.; Rowlands, A.V.; Olds, T.; Maher, C. The Validity of Consumer-Level, Activity Monitors in Healthy Adults Worn in Free-Living Conditions: A Cross-Sectional Study. Int. J. Behav. Nutr. Phys. Act. 2015, 12, 42. [Google Scholar] [CrossRef]
- Corder, K.; Ekelund, U.; Steele, R.M.; Wareham, N.J.; Brage, S. Assessment of Physical Activity in Youth. J. Appl. Physiol. 2008, 105, 977–987. [Google Scholar] [CrossRef]
- Gastin, P.B.; Cayzer, C.; Dwyer, D.; Robertson, S. Validity of the ActiGraph GT3X+ and BodyMedia SenseWear Armband to Estimate Energy Expenditure during Physical Activity and Sport. J. Sci. Med. Sport 2018, 21, 291–295. [Google Scholar] [CrossRef]
- Kohl, H.W.; Cook, H.D.; Van Dusen, D.P.; Kelder, S.H.; Kohl, H.W.; Ranjit, N.; Perry, C.L. Educating the Study Body: Taking Physical Activity and Physical Education to School. Chapter 4: Physical Activity, Fitness, and Physical Education: Effects on Academic Performance; The National Academies Press: Washington, DC, USA, 2013. [Google Scholar]
- Skender, S.; Ose, J.; Chang-Claude, J.; Paskow, M.; Brühmann, B.; Siegel, E.M.; Steindorf, K.; Ulrich, C.M. Accelerometry and Physical Activity Questionnaires-A Systematic Review. BMC Public Health 2016, 16, 515. [Google Scholar] [CrossRef]
- Westerterp, K.R. Assessment of Physical Activity: A Critical Appraisal. Eur. J. Appl. Physiol. 2009, 105, 823–828. [Google Scholar] [CrossRef]
- Sirard, J.R.; Pate, R.R. Physical Activity Assessment in Children and Adolescents. Sports Med. 2001, 31, 439–454. [Google Scholar] [CrossRef]
- Prince, S.A.; Adamo, K.B.; Hamel, M.E.; Hardt, J.; Gorber, S.C.; Tremblay, M. A Comparison of Direct Versus Self-Report Measures for Assessing Physical Activity in Adults: A Systematic Review. Int. J. Behav. Nutr. Phys. Act. 2008, 5, 56. [Google Scholar] [CrossRef]
- Lee, I.-M.; Shiroma, E.J. Using Accelerometers to Measure Physical Activity in Large-Scale Epidemiological Studies: Issues And Challenges. Br. J. Sports Med. 2014, 48, 197–201. [Google Scholar] [CrossRef]
- An, H.-S.; Jones, G.C.; Kang, S.-K.; Welk, G.J.; Lee, J.-M. How Valid are Wearable Physical Activity Trackers for Measuring Steps? Eur. J. Sport Sci. 2017, 17, 360–368. [Google Scholar] [CrossRef]
- Bai, Y.; Welk, G.J.; Nam, Y.H.; Lee, J.A.; Lee, J.-M.; Kim, Y.; Meier, N.F.; Dixon, P.M. Comparison of Consumer and Research Monitors under Semistructured Settings. Med. Sci. Sports Exerc. 2016, 48, 151–158. [Google Scholar] [CrossRef]
- Lee, J.-M.; Kim, Y.-W.; Welk, G.J. TRACK IT: Validity and Utility of Consumer-Based Physical Activity Monitors. ACSMs Health Fit. J. 2014, 18, 16–21. [Google Scholar] [CrossRef]
- Nelson, M.B.; Kaminsky, L.A.; Dickin, D.C.; Montoye, A.H.K. Validity of Consumer-Based Physical Activity Monitors for Specific Activity Types. Med. Sci. Sports Exerc. 2016, 48, 1619–1628. [Google Scholar] [CrossRef]
- Sasaki, J.E.; Hickey, A.; Mavilia, M.; Tedesco, J.; John, D.; Keadle, S.K.; Freedson, P.S. Validation of the Fitbit Wireless Activity Tracker for Prediction of Energy Expenditure. J. Phys. Act. Health 2015, 12, 149–154. [Google Scholar] [CrossRef]
- Gomersall, S.R.; Ng, N.; Burton, N.W.; Pavey, T.G.; Gilson, N.D.; Brown, W.J. Estimating Physical Activity and Sedentary Behavior in A Free-Living Context: A Pragmatic Comparison of Consumer-Based Activity Trackers and ActiGraph Accelerometry. J. Med. Internet Res. 2016, 18, e239. [Google Scholar] [CrossRef]
- Price, K.; Bird, S.R.; Lythgo, N.; Raj, I.S.; Wong, J.Y.L.; Lynch, C. Validation of the Fitbit One, Garmin Vivofit and Jawbone UP Activity Tracker in Estimation of Energy Expenditure during Treadmill Walking and Running. J. Med. Eng. Technol. 2017, 41, 208–215. [Google Scholar] [CrossRef]
- Loyen, A.; Van Hecke, L.; Verloigne, M.; Hendriksen, I.; Lakerveld, J.; Steene-Johannessen, J.; Vuillemin, A.; Koster, A.; Donnelly, A.; Ekelund, U. Variation in Population Levels of Physical Activity in European Adults According to Cross-European Studies: A Systematic Literature Review within DEDIPAC. Int. J. Behav. Nutr. Phys. Act. 2016, 13, 72. [Google Scholar] [CrossRef]
- Falck, R.S.; McDonald, S.M.; Beets, M.W.; Brazendale, K.; Liu-Ambrose, T. Measurement of Physical Activity in Older Adult Interventions: A Systematic Review. Br. J. Sports Med. 2016, 50, 464–470. [Google Scholar] [CrossRef]
- Craig, C.L.; Marshall, A.L.; Sjöström, M.; Bauman, A.E.; Booth, M.L.; Ainsworth, B.E.; Pratt, M.; Ekelund, U.L.F.; Yngve, A.; Sallis, J.F. International Physical Activity Questionnaire: 12-Country Reliability and Validity. Med. Sci. Sports Exerc. 2003, 35, 1381–1395. [Google Scholar] [CrossRef]
- Finger, J.D.; Gisle, L.; Mimilidis, H.; Santos-Hoevener, C.; Kruusmaa, E.K.; Matsi, A.; Oja, L.; Balarajan, M.; Gray, M.; Kratz, A.L. How Well Do Physical Activity Questions Perform? A European Cognitive Testing Study. Arch. Public Health 2015, 73, 57. [Google Scholar] [CrossRef]
- Bull, F.C.; Maslin, T.S.; Armstrong, T. Global Physical Activity Questionnaire (GPAQ): Nine Country Reliability and Validity Study. J. Phys. Act. Health 2009, 6, 790–804. [Google Scholar] [CrossRef]
- Bauman, A.; Ainsworth, B.E.; Bull, F.; Craig, C.L.; Hagströmer, M.; Sallis, J.F.; Pratt, M.; Sjöström, M. Progress and Pitfalls in the Use of the International Physical Activity Questionnaire (IPAQ) for Adult Physical Activity Surveillance. J. Phys. Act. Health 2009, 6, S5–S8. [Google Scholar] [CrossRef]
- Van Poppel, M.N.M.; Chinapaw, M.J.M.; Mokkink, L.B.; Van Mechelen, W.; Terwee, C.B. Physical Activity Questionnaires for Adults. Sports Med. 2010, 40, 565–600. [Google Scholar] [CrossRef]
- Lee, P.H.; Macfarlane, D.J.; Lam, T.H.; Stewart, S.M. Validity of the International Physical Activity Questionnaire Short form (IPAQ-SF): A Systematic Review. Int. J. Behav. Nutr. Phys. Act. 2011, 8, 115. [Google Scholar] [CrossRef]
- European Commission. Special Eurobarometer 472; European Commission: Brusselss, Belgium, 2018; pp. 1–32. [Google Scholar]
- World Health Organization. Review of Physical Activity Surveillance Data Sources in European Union Member States; WHO Regional Office for Europe: Copenhagen, Denmark, 2011; pp. 1–68. [Google Scholar]
- Riley, L.; Guthold, R.; Cowan, M.; Savin, S.; Bhatti, L.; Armstrong, T.; Bonita, R. The World Health Organization STEP Wise Approach to Noncommunicable Disease Risk-Factor Surveillance: Methods, Challenges, And Opportunities. Am. J. Public Health 2016, 106, 74–78. [Google Scholar] [CrossRef]
- Finger, J.D.; Tafforeau, J.; Gisle, L.; Oja, L.; Ziese, T.; Thelen, J.; Mensink, G.B.M.; Lange, C. Development of the European Health Interview Survey-Physical Activity Questionnaire (EHIS-PAQ) to Monitor Physical Activity in the European Union. Arch. Public Health 2015, 73, 59. [Google Scholar] [CrossRef]
- Wolin, K.Y.; Heil, D.P.; Askew, S.; Matthews, C.E.; Bennett, G.G. Validation of the International Physical Activity Questionnaire-Short Among Blacks. J. Phys. Act. Health 2008, 5, 746–760. [Google Scholar] [CrossRef]
- Mannocci, A.; Di Thiene, D.; Del Cimmuto, A.; Masala, D.; Boccia, A.; De Vito, E.; La Torre, G. International Physical Activity Questionnaire: Validation And Assessment in An Italian Sample. Ital. J. Public Health 2010, 7, 369–376. [Google Scholar] [CrossRef]
- Hoos, M.B.; Plasqui, G.; Gerver, W.-J.M.; Westerterp, K.R. Physical Activity Level Measured by Doubly Labeled Water and Accelerometry in Children. Eur. J. Appl. Physiol. 2003, 89, 624–626. [Google Scholar] [CrossRef]
- Baumeister, S.E.; Ricci, C.; Kohler, S.; Fischer, B.; Töpfer, C.; Finger, J.D.; Leitzmann, M.F. Physical Activity Surveillance in the European Union: Reliability and Validity of the European Health Interview Survey-Physical Activity Questionnaire (EHIS-PAQ). Int. J. Behav. Nutr. Phys. Act. 2016, 13, 61. [Google Scholar] [CrossRef]
- Kim, Y.; Park, I.; Kang, M. Convergent Validity of the International Physical Activity Questionnaire (IPAQ): Meta-analysis. Public Health Nutr. 2013, 16, 440–452. [Google Scholar] [CrossRef]
- Bakker, E.A.; Hartman, Y.A.W.; Hopman, M.T.E.; Hopkins, N.D.; Graves, L.E.F.; Dunstan, D.W.; Healy, G.N.; Eijsvogels, T.M.H.; Thijssen, D.H.J. Validity and Reliability of Subjective Methods to Assess Sedentary Behaviour in Adults: A Systematic Review and Meta-Analysis. Int. J. Behav. Nutr. Phys. Act. 2020, 17, 1–31. [Google Scholar] [CrossRef]
- Keating, X.D.; Zhou, K.; Liu, X.; Hodges, M.; Liu, J.; Guan, J.; Phelps, A.; Castro-Piñero, J. Reliability and Concurrent Validity of Global Physical Activity Questionnaire (GPAQ): A Systematic Review. Int. J. Environ. Res. Public Health 2019, 16, 4128. [Google Scholar] [CrossRef]
- Moher, D.; Liberati, A.; Tetzlaff, J.; Altman, D.G.; Group, P. Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement. PLoS Med. 2009, 6, e1000097. [Google Scholar] [CrossRef]
- Moher, D.; Shamseer, L.; Clarke, M.; Ghersi, D.; Liberati, A.; Petticrew, M.; Shekelle, P.; Stewart, L.A. Preferred Reporting Items for Systematic Review and Meta-Analysis Protocols (PRISMA-P) 2015 Statement. Syst. Rev. 2015, 4, 1. [Google Scholar] [CrossRef]
- Sneck, S.; Viholainen, H.; Syväoja, H.; Kankaapää, A.; Hakonen, H.; Poikkeus, A.-M.; Tammelin, T. Effects of School-Based Physical Activity on Mathematics Performance in Children. Int. J. Behav. Nutr. Phys. Act. 2019, 16, 109. [Google Scholar] [CrossRef]
- Sember, V.; Jurak, G.; Kovač, M.; Morrison, S.A.; Starc, G. Children’s Physical Activity, Academic Performance and Cognitive Functioning: A Systematic Review And Meta-Analysis. Front. Public Health 2020, 8, 307. [Google Scholar] [CrossRef]
- Terwee, C.B.; Mokkink, L.B.; van Poppel, M.N.M.; Chinapaw, M.J.M.; van Mechelen, W.; de Vet, H.C.W. Qualitative Attributes and Measurement Properties of Physical Activity Questionnaires. Sports Med. 2010, 40, 525–537. [Google Scholar] [CrossRef]
- Egger, M.; Smith, G.D.; Schneider, M.; Minder, C. Bias in Meta-Analysis Detected by A Simple, Graphical Test. BMJ 1997, 315, 629–634. [Google Scholar] [CrossRef]
- Hunter, J.E.; Schmidt, F.L.; Le, H. Implications of Direct and Indirect Range Restriction for Meta-Analysis Methods and Findings. J. Appl. Psychol. 2006, 91, 594. [Google Scholar] [CrossRef]
- Teugels, J.L.; Vet, H. Observer Reliability and Agreement. Wiley StatsRef Stat. Ref. Online 2014. [Google Scholar] [CrossRef]
- Plasqui, G.; Westerterp, K.R. Physical Activity Assessment with Accelerometers: An Evaluation Against Doubly Labeled Water. Obesity 2007, 15, 2371–2379. [Google Scholar] [CrossRef]
- Laeremans, M.; Dons, E.; Avila-Palencia, I.; Carrasco-Turigas, G.; Orjuela, J.P.; Anaya, E.; Brand, C.; Cole-Hunter, T.; de Nazelle, A.; Götschi, T. Physical Activity and Sedentary Behaviour in Daily Life: A Comparative Analysis of the Global Physical Activity Questionnaire (GPAQ) and the SenseWear armband. PLoS ONE 2017, 12, e0177765. [Google Scholar] [CrossRef]
- Rütten, A.; Vuillemin, A.; Ooijendijk, W.T.M.; Schena, F.; Sjöström, M.; Stahl, T.; Vanden Auweele, Y.; Welshman, J.; Ziemainz, H. Physical Activity Monitoring in Europe. The European Physical Activity Surveillance System (EUPASS) Approach and Indicator Testing. Public Health Nutr. 2003, 6, 377–384. [Google Scholar] [CrossRef] [PubMed]
- De La Cámara, M.A.; Higueras-Fresnillo, S.; Cabanas-Sánchez, V.; Sadarangani, K.P.; Martinez-Gomez, D.; Veiga, Ó.L. Criterion Validity of the Sedentary Behavior Question from the Global Physical Activity Questionnaire in Older Adults. J. Phys. Act. Health 2020, 17, 2–12. [Google Scholar] [CrossRef] [PubMed]
- Cleland, C.L.; Hunter, R.F.; Kee, F.; Cupples, M.E.; Sallis, J.F.; Tully, M.A. Validity of the Global Physical Activity Questionnaire (GPAQ) in Assessing Levels and Change in Moderate-Vigorous Physical Activity and Sedentary Behaviour. BMC Public Health 2014, 14, 1255. [Google Scholar] [CrossRef] [PubMed]
- Ekelund, U.; Sepp, H.; Brage, S.; Becker, W.; Jakes, R.; Hennings, M.; Wareham, N.J. Criterion-Related Validity of the Last 7-Day, Short Form of the International Physical Activity Questionnaire in Swedish Adults. Public Health Nutr. 2006, 9, 258–265. [Google Scholar] [CrossRef]
- Kalvenas, A.; Burlacu, I.; Abu-Omar, K. Reliability and Validity of the International Physical Activity Questionnaire in Lithuania. Balt. J. Heal. Phys. Act. 2016, 8, 29–41. [Google Scholar] [CrossRef]
- Kleinauskienė, L. Tarptautinio Fizinio Aktyvumo Klausimyno Trumposios Lietuviškos Versijos (IPAQ-LT) Patikimumo Ir Pagrįstumo Nustatymas; Lithuanian Sports University: Kaunas, Lithuania, 2012; pp. 3–52. [Google Scholar]
- Kastelic, K.; Šarabon, N. Comparison of Self-Reported Sedentary Time on Weekdays with An Objective Measure (activPAL). Meas. Phys. Educ. Exerc. Sci. 2019, 23, 227–236. [Google Scholar] [CrossRef]
- Milton, K.; Bull, F.C.; Bauman, A. Reliability and Validity Testing of A Single-Item Physical Activity Measure. Br. J. Sports Med. 2011, 45, 203–208. [Google Scholar] [CrossRef]
- Murphy, J.J.; Murphy, M.H.; MacDonncha, C.; Murphy, N.; Nevill, A.M.; Woods, C.B. Validity and Reliability of Three Self-Report Instruments for Assessing Attainment of Physical Activity Guidelines in University Students. Meas. Phys. Educ. Exerc. Sci. 2017, 21, 134–141. [Google Scholar] [CrossRef]
- Novak, B.; Holler, P.; Jaunig, J.; Ruf, W.; van Poppel, M.N.M.; Sattler, M.C. Do We Have To Reduce the Recall Period? Validity of A Daily Physical Activity Questionnaire (PAQ24) in Young Active Adults. BMC Public Health 2020, 20, 72. [Google Scholar] [CrossRef] [PubMed]
- Rivière, F.; Widad, F.Z.; Speyer, E.; Erpelding, M.-L.; Escalon, H.; Vuillemin, A. Reliability and Validity of the French Version of the Global Physical Activity Questionnaire. J. Sport Heal. Sci. 2018, 7, 339–345. [Google Scholar] [CrossRef] [PubMed]
- Rudolf, K.; Lammer, F.; Stassen, G.; Froböse, I.; Schaller, A. Show Cards of the Global Physical Activity Questionnaire (GPAQ)–do They Impact Validity? A Crossover Study. BMC Public Health 2020, 20, 223. [Google Scholar] [CrossRef] [PubMed]
- Taylor, N.J.; Crouter, S.E.; Lawton, R.J.; Conner, M.T.; Prestwich, A. Development and Validation of the Online Self-Reported Walking and Exercise Questionnaire (OSWEQ). J. Phys. Act. Health 2013, 10, 1091–1101. [Google Scholar] [CrossRef]
- Vinas, B.R.; Barba, L.R.; Ngo, J.; Majem, L.S. Validación en población catalana del cuestionario internacional de actividad física. Gac. Sanit. 2013, 27, 254–257. [Google Scholar] [CrossRef]
- Rodríguez-Muńoz, S.; Corella, C.; Abarca-Sos, A.; Zaragoza, J. Validation of Three Short Physical Activity Questionnaires with Accelerometers among University Students in Spain. J. Sports Med. Phys. Fit. 2017, 57, 1660. [Google Scholar] [CrossRef]
- Scholes, S.; Bridges, S.; Fat, L.N.; Mindell, J.S. Comparison of the Physical Activity and Sedentary Behaviour Assessment Questionnaire and the Short-Form International Physical Activity Questionnaire: An Analysis of Health Survey for England Data. PLoS ONE 2016, 11, e0151647. [Google Scholar] [CrossRef]
- Rütten, A.; Ziemainz, H.; Schena, F.; Stahl, T.; Stiggelbout, M.; Vanden Auweele, Y.; Vuillemin, A.; Welshman, J. Using Different Physical Activity Measurements in Eight European Countries. Results of the European Physical Activity Surveillance System (EUPASS) Time Series Survey. Public Health Nutr. 2003, 6, 371–376. [Google Scholar] [CrossRef]
- Lameck, W.U. Sampling Design, Validity and Reliability in General Social Survey. Int. J. Acad. Res. Bus. Soc. Sci. 2013, 3, 212–218. [Google Scholar] [CrossRef]
- Meyers, R.M.; Bryan, J.G.; McFarland, J.M.; Weir, B.A.; Sizemore, A.E.; Xu, H.; Dharia, N.V.; Montgomery, P.G.; Cowley, G.S.; Pantel, S. Computational Correction of Copy Number Effect Improves Specificity of CRISPR–Cas9 Essentiality Screens in Cancer Cells. Nat. Genet. 2017, 49, 1779–1784. [Google Scholar] [CrossRef] [PubMed]
- Jinyuan, L.I.U.; Wan, T.; Guanqin, C.; Yin, L.U.; Changyong, F. Correlation and Agreement: Overview and Clarification of Competing Concepts and Measures. Shanghai Arch. Psychiatry 2016, 28, 115–120. [Google Scholar] [CrossRef]
- Sallis, J.F.; Saelens, B.E. Assessment of Physical Activity by Self-Report: Status, Limitations, and Future Directions. Res. Q. Exerc. Sport 2000, 71, 1–14. [Google Scholar] [CrossRef] [PubMed]
- Hansen, B.H.; Børtnes, I.; Hildebrand, M.; Holme, I.; Kolle, E.; Anderssen, S.A. Validity of the ActiGraph GT1M during Walking And Cycling. J. Sports Sci. 2014, 32, 510–516. [Google Scholar] [CrossRef] [PubMed]
- Abarca-Gómez, L.; Abdeen, Z.A.; Hamid, Z.A.; Abu-Rmeileh, N.M.; Acosta-Cazares, B.; Acuin, C.; Adams, R.J.; Aekplakorn, W.; Afsana, K.; Aguilar-Salinas, C.A. Worldwide Trends in Body-Mass Index, Underweight, Overweight, and Obesity from 1975 to 2016: A Pooled Analysis of 2416 Population-Based Measurement Studies in 1289 Million Children, Adolescents, and Adults. Lancet 2017, 390, 2627–2642. [Google Scholar] [CrossRef]
- Voss, M.W.; Weng, T.B.; Burzynska, A.Z.; Wong, C.N.; Cooke, G.E.; Clark, R.; Fanning, J.; Awick, E.; Gothe, N.P.; Olson, E.A. Fitness, but not Physical Activity, is Related to Functional Integrity of Brain Networks Associated with Aging. Neuroimage 2016, 131, 113–125. [Google Scholar] [CrossRef]
- Sylvia, L.G.; Bernstein, E.E.; Hubbard, H.L.; Keating, L.; Anderson, E.J. A Practical Guide to Measuring Physical Activity. J. Acad. Nutr. Diet. 2014, 114, 199–208. [Google Scholar] [CrossRef]
- Sattler, M.C.; Jaunig, J.; Tösch, C.; Watson, E.D.; Mokkink, L.B.; Dietz, P.; van Poppel, M.N. Current Evidence of Measurement Properties of Physical Activity Questionnaires for Older Adults: An Updated Systematic Review. Sports Med. 2020, 50, 1271–1315. [Google Scholar] [CrossRef]
© 2020 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).