Next Article in Journal
Chronic Obstructive Pulmonary Disease Increases the Risk of Mortality among Patients with Colorectal Cancer: A Nationwide Population-Based Retrospective Cohort Study
Next Article in Special Issue
“You’re Going to Have to Think a Little Bit Different” Barriers and Facilitators to Using mHealth to Increase Physical Activity among Older, Rural Cancer Survivors
Previous Article in Journal
Influence of Amino Acid Feeding on Production of Calcimycin and Analogs in Streptomyces chartreusis
Previous Article in Special Issue
¿Qué Pasa Con Papá? Exploring Paternal Responsibilities and Physical Activity in Mexican-Heritage Families
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Trail Conditions and Community Use: Utilizing Geospatial Video to Guide the Adoption of a Spatial-Temporal Trail Audit Tool (STAT)

1
School of Business, Northcentral University, La Jolla, CA 92037, USA
2
Department of Active Transportation, Headwaters Regional Development Commission, Bemidji, MN 56601, USA
3
College of Public Health, Kent State University, Kent, OH 44240, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2021, 18(16), 8741; https://doi.org/10.3390/ijerph18168741
Submission received: 25 June 2021 / Revised: 7 August 2021 / Accepted: 17 August 2021 / Published: 19 August 2021

Abstract

:
Physical activity (PA), associated with all-cause mortality, morbidity, and healthcare costs, improves vitamin D absorption, immune response, and stress when completed outdoors. Rural communities, which experience PA inequities, rely on trails to meet PA guidelines. However, current trail audit methods could be more efficient and accurate, which geospatial video may support. Therefore, the study purpose was (1) to identify and adopt validated instruments for trail audit evaluations using geospatial video and a composite score and (2) to determine if geospatial video and a composite score motivate (influence the decision to use) specific trail selection among current trail users. Phase 1 used a mixed-method exploratory sequential core design using qualitative data, then quantitative data for the development of the Spatial-temporal Trail Audit Tool (STAT). Geospatial videos of two Northeast Ohio trails were collected using a bicycle-mounted spatial video camera and video analysis software. The creation of STAT was integrated from Neighborhood Environment Walkability Scale (NEWS), Walk Score, and Path Environment Audit Tool (PEAT) audit tools based on four constructs: trail accessibility, conditions, amenities, and safety. Scoring was determined by three independent reviewers. Phase 2 included a mixed-method convergent core design to test the applicability of STAT for trail participant motivation. STAT has 20 items in 4 content areas computing a composite score and was found to increase trail quality and motivation for use. STAT can evaluate trails for PA using geospatial video and a composite score which may spur PA through increased motivation to select and use trails.

1. Introduction

1.1. Importance of Physical Activity

Physical activity (PA) is associated with a reduction in all-cause mortality, morbidity, and associated healthcare costs [1,2]. Physical inactivity is a public health problem globally as 1 in 4 adults of adults aged 18 years and older do not meet the globally recommended levels of PA [3]. These global recommendations of PA include 150 min of PA per week [3]. There is also a dose-response relationship, as adults who attain a minimum of 150 min of moderate-intensity or 75 min of vigorous-intensity exercise per week demonstrate a 15% mortality reduction across the lifespan, whereas those who accrue at a minimum of 300 min per week demonstrate a 26% mortality reduction [4]. While adult PA has significantly increased in the past decade (from about 18% of adults in 2008 to about 24% of adults in 2018) [5], about 75% of adults are still not meeting the above guidelines [6], demonstrating the need for PA interventions [7].

1.2. Inequities for PA in Rural Environments and the Socio-Ecological Model

A large number of adults do not meet PA recommendations due to inequities in access to safe environments for PA [7]. Some of these inequities are found in rural environments where only 19.6% of people are meeting PA guidelines compared to 25.3% among those living in urban communities [8,9]. The Spatial-temporal Trail Audit Tool (STAT) was developed using trails that run through a mix of rural and urban areas as defined by the proposed, updated United States Census Bureau area designations (an area fewer than 4000 housing units or a population less than 10,000) [10]. While STAT can be used on any trail, it is especially helpful in rural areas challenged with vast space and limited resources [11]. Rural women’s PA rates are even lower than men’s and especially those with low income [12]. Furthermore, rural communities have higher obesity rates, injury, and fatality rates from collisions, and poorer PA infrastructure, which have worsened during the COVID-19 pandemic [8].
The socio-ecological model (SEM) includes domains that impact PA, including individual, social/intrapersonal, community/environment (built and natural), and policy, needed to address complex challenges in rural communities. This better enables the promotion of PA across all the socio-ecological domains as having accessible, highly rated trails is shown to increase PA in rural populations [10,11,13]. Specifically, at the individual level, people in rural populations are more likely to access locations for PA that are free (such as a trail or neighborhood streets) as well as locations that can be easily accessed with others intersecting at the social/intrapersonal level [14]. At the community/environment level, the use of trails is associated with meeting PA recommendations in rural populations [15]. Finally, at the policy level, work needs to be conducted to ensure quality and safe conditions for trail use. Therefore, increased surveillance of rural trails for PA intersects multiple SEM domains and is needed to determine quality and usage patterns.

1.3. Importance of Trails for PA

In addition to increased access and use, engaging in trail PA provides the additional benefits of being outdoors. These benefits include vitamin D absorption and additional immune response and stress reduction [16,17]. The associations between trail conditions and community use illustrate the importance of testing increased PA uptake through trail audits [18]. At the same time, PA interventions addressing trail access inequities currently lack efficient and accurate trail audit methods. Trail audits include ways for researchers and practitioners to identify trail quality and utilize various measures and methods. Trail audit tools are designed to measure trail use facilitators.

1.4. Need for Increased Accuracy and Efficiency in Trail Quality and Use Measures and Methods

Trail quality is currently assessed through audit tools designed to measure trail use facilitators and barriers. Facilitators include groomed trail conditions, adequate lighting, mixed views (urban and natural scenery), and trailside amenities (e.g., restrooms, benches) [18,19]. Barriers include excessive noise, debris, dense vegetation, tunnels, non-visual drainage feature, and geographic factors (e.g., safety and accessibility) [18,19]. Trail audits can be particularly difficult to collect in rural communities challenged with vast space and limited resources [11]. Currently, trail use data collection methods include manually counting trail users with clickers or infrared video counters [20]. The former is time-intensive, and the latter has inaccuracies due to weather and wildlife interferences and cannot distinguish unique users [20]. Therefore, more efficient and accurate trail quality and use data collection methods are needed for practitioners and researchers focused on improving the current trail conditions and use.

1.5. Geospatial Video

Geospatial video may assist with trail quality measures and trail use collection methods as it captures both quality and use of PA access points, such as parks and trails, by combining Global Positioning Systems (GPS) with video. Mills et al. (2010) [21] developed this methodology, which enables data collection efficiency, the ability to survey locations over multiple time periods, and generate archival data, thus, places can be revisited through the video. This approach (1) increases field data collection efficiency while (2) increasing accuracy. Previously geospatial video has been used in disaster recovery efforts as well as surveillance of populations who are homeless [21,22].
Trail quality and use data can be collected more efficiently by attaching the camera to a bicycle, rather than walking the trails, and archived to allow multiple researchers or practitioners to audit locations over multiple time periods [21]. This results in the ability to archive trail conditions and be used to determine time and place relationships, such as specific trail features, resulting in increased use during specific times of the day or year and increases validity and reliability of the trail audit. Additionally, geospatial video provides researchers with a way of using this mechanism to include qualitative data into audit tools [21], providing significant improvements on the previous methodology. Furthermore, geospatial video can capture trail accessibility, conditions, amenities, and safety, supporting intuitive dissemination amongst colleagues and stakeholders. Geospatial video has not, to our knowledge, been used to measure trail quality and use, resulting in a need for validation.

1.6. Study Purpose

Current trail audit methods could be more efficient, accurate, and especially helpful in rural areas as having accessible, highly rated trails is shown to increase PA in rural populations. Using geospatial video with a redesigned audit tool may result in better audits and lead to improved PA interventions. Therefore, the purpose of this was (1) to identify and adopt validated instruments for trail audit evaluations using geospatial video and a composite score and (2) to determine if geospatial video and a composite score motivate (influence the decision to use) specific trail selection among physically active adults.

2. Materials and Methods

To create and validate the final quantitative trail quality and use instrument, STAT, this study was designed as a 2-phase mixed-methods study. Please see Figure 1 for a study design pictorial representation. Capital letters within Figure 1 represent which data type, quantitative or qualitative, was the prioritized method, and lowercase letters are used to represent the less focused on data type in mixed-methods [23]. Phase 1 used Creswell and Plano Clark’s (2018) [23] mixed-methods exploratory sequential core design using qualitative data then quantitative data for the purpose of development of STAT [24]. Phase 2 used Creswell and Plano Clark’s (2018) [23] mixed-methods convergent core design, which served the purpose of triangulation, converging, and corroborating the study findings through comparing the qualitative and quantitative data to test and revise STAT [24].

2.1. Phase 1

Phase 1, mixed-methods exploratory sequential core design, consisted of 3 steps. The first step was to collect qualitative data in the form of a geospatial trail video. The second step was to use previously validated quantitative built environment trail audit tools to create STAT. The third step integrated the qualitative and quantitative data to revise STAT. The rationale for this approach was for the development of STAT [24], and the qualitative data allowed the researchers to understand the measures and questions needed for the quantitative STAT [23].

2.1.1. Step 1: Geospatial Video Collection

As seen in Figure 2, portable, bicycle-mounted geospatial video cameras (Contour +2 model 1700) and the coordinating video analysis software (Contour Storyteller) were used to acquire, analyze, and test video of the 2 Northeast Ohio trails: West branch trail and Portage hike and Bike trail (Figure 3). These trails were selected based on researcher convenience and trail usage. The West branch trail is considered the most frequented free PA access point in Canton, Ohio, and has a broad range of users [25]. The Portage hike and Bike trail, centrally-located and spanning nearly 10 miles, connects Kent and Ravenna, Ohio, and is also within walking distance from Kent State University’s Kent campus. Trails included a mix of rural and urban areas [10,26]. Video of the trails was collected across 6 data collection outings, 3 for each of the 2 trails. The West branch trail data were collected by author C.S., and the and Portage hike and Bike trail data were collected by author N.C. All videos were collected at 4 pm Eastern Standard Time weekly as trail use may vary around users’ schedules as well as around seasonal and daily temperatures and daylight [27]. Each ride began from the same starting point and in the same direction (south to north). The resulting videos from these rides were uploaded into Contour Storyteller, the camera’s accompanying video software, for further analysis.

2.1.2. Step 2: STAT Creation

To create STAT, content analysis of validated trail audit tools was conducted by adopting previous applications of geospatial video [21,28]. Three independent reviewers examined the trail videos to determine previously-validated built environment audit tools’ content that could be scored using video content. The audit tools from which items and constructs were adopted included the Neighborhood Environment Walkability Scale (NEWS), Walk Score, and Path Environment Audit Tool (PEAT).
NEWS, developed in 2002 by Dr. Sallis, measures residents’ perception of neighborhood design features (environmental attributes), related to PA, within their local area [29]. NEWS addresses constructs of residential density, land use mix (including both indices of proximity and accessibility), street connectivity, infrastructure for walking/cycling, neighborhood aesthetics, traffic and crime safety, and neighborhood satisfaction [30]. NEWS has been well-documented, tested, and validated in multiple countries, and additional modifications have been made to abbreviate the tool to various situations [29]. We further adopted NEWS to specifically measure these constructs within trails.
Walk Score, developed in 2007 by Herstas, company Chief Executive Officer [31], is a previously-validated built environment audit tool that links PA and proximity to one’s destination, utilizes Geographic Information Systems (GIS) to measure and estimate neighborhood walkability via the physical distance to 13 specific destinations, including: grocery stores, parks, book stores, coffee shops, restaurants, bars, movie theaters, schools, libraries, fitness centers, drug stores, hardware stores, and clothing/music stores [32]. Walk Score is applicable across a variety of geographic settings and spatial scales [33]. Similarly, to NEWS, we further adopted Walk Score to specifically measure these constructs within trails.
Finally, PEAT was developed in 2006 by Troped, Cromley, Fragala, Melly, Hasbrouck, Gortmaker, and Brownson to assess the physical characteristics of community trails and paths, including their design, amenities, and aesthetics [34]. PEAT has displayed inter-rater reliability and validity for the majority of its items [34]. We added those constructs identified as important to trail users from NEWS and Walk Score not included in PEAT.
Beginning with validated question content from the original NEWS survey and thereafter incorporating elements of Walk Score and PEAT, researcher M.N. and authors N.C. and C.S. compiled a list of content relevant to physical trail conditions from which the language of these selected questions was later modified to address these concerns specifically. After an initial list was outlined, N.C., M.N. and C.S. then reviewed the spatial video and added additional question content evoked from the viewing. Each reviewer’s questions were again compiled and organized into categories, which were based upon the existing built environment tool categories and question themes that occurred naturally.
STAT composite scores were calculated from 0 to 100 to produce a general trail composite score by adding together the 4 content areas of access, conditions, amenities, and safety. Within the content areas, there were 20 items that used a 0 to 5, 6-point Likert Scale in which 0 equals “not at all” and 5, “yes, very much”. An additional composite score was produced for the low- and high-intensity PA subsets, ranging from 0 to 25, by adding together scores from items using a 0 to 5, 6-point Likert Scale as well.

2.1.3. Step 3: STAT Revision

Following the initial audit tool adoption and construction, STAT was reviewed by two experts in built environment research and one in research design and survey methods, respectively, to provide face validity and identify potential content gaps. Following this input, the researchers integrated the qualitative and quantitative data by reviewing the trail geospatial video, using STAT to conduct an audit of the trails using the video, and revised STAT based on the experts’ feedback and trail audit.

2.2. Phase 2

Institutional Review Board approval was obtained for human subjects research from the first author’s university (protocol code 16-597). Phase 2, convergent core design, consisted of steps 4 and 5 in the study. Step 4 simultaneously collected qualitative (focus group) and quantitative (online survey) data about the applicability and usability of STAT. Step 5 integrated and compared the qualitative and quantitative data to revise STAT. The rationale for this approach is that this allowed the researchers to compare, corroborate, and examine facets of STAT through triangulation and convergence of the data, which developed a more complete picture and tested the applicability and usability of STAT [24,25].

2.2.1. Step 4: Test STAT Focus Group

A convenience sample of participants, including close to equal representation of males and females, was then recruited using email from self-identified physically active participants at the first author’s university to join the focus group. Already physically active adults were recruited because they were familiar with the access, conditions, amenities, and safety of PA locations that tend to increase their selection of specific locations for PA. Therefore, using already active people provides clear insights into how STAT will work, which researchers and practitioners can use to improve the trails and increase the probability that those not meeting physical activity guidelines will be encouraged to use the trails. A semi-structured focus group was chosen to elicit participants’ thoughts and perceptions of STAT through intra- and inter-personal conversations for more open dialog supplementing the STAT survey in step 4 [35]. Members of local area running groups’ message boards were recruited to complete a survey. These self-identified cyclists, walkers, and runners tested the applicability of the geospatial techniques to collect data using the validated tools described to provide perceptions of the importance of the video, individual items, constructs, and composite score of STAT. We also assessed trail user motivation that examined which components of STAT influenced participants’ decisions to select a specific trail.
Participants were given a copy of the STAT items and constructs, asked to review and then share which items and constructs were important for selecting a trail for exercise, items they would change or add to help them select a trail, and what was most important in selecting a trail for exercise. Next, participants were asked to watch a trail video played for them at the focus group. After watching the video, participants were asked if the video, specific categories of items, or a combination would help them determine whether or not they would select a trail for exercise and if having any of this information would motivate them to do so. Finally, participants were asked about their trail use and PA. The focus group discussion was transcribed, and focus group participants were asked to record notes on the copy of the STAT items, which included a copy of the focus group questions to assist in validating responses.
After all focus groups were completed, researcher M.N., and authors N.C. and C.S. transcribed and de-identified files. The transcripts were entered into QSR International’s NVivo 11 qualitative data analysis software and analyzed using Saldaña’s (2016) [36] evaluation and descriptive coding. Evaluation coding includes applying codes to qualitative data to assign judgment about the merit, worth, or significance of trail quality and use measures. Descriptive coding includes labeling assigned to data to summarize in a word or short phrase. The basic topic of the qualitative data passage provides an inventory of topics for indexing and categorizing.

2.2.2. Step 4: Test STAT Survey

The survey included STAT items and participants were asked to rate each item for importance of selecting a trail for exercise using a Likert scale with 0 being not at all to 5 being very much. Participants were also asked which items they would change or add to help them select a trail, and what item was most important to them when selecting a trail for exercise. Next, participants were asked to watch a trail video linked to the survey. After watching the video participants were asked if the video, specific categories of items, or a combination would help them determine whether they would select a trail for exercise and if having STAT information would motivate them to do so, again, using a Likert scale with 0 being not at all to 5 being very much. Finally, participants were asked about their trail use PA, using the valid and reliable International Physical Activity Questionnaire (IPAQ) [37,38], and demographics including race, age, gender, and income. All survey data were analyzed with descriptive statistics using IBM SPSS Statistics for Windows, Version 21.0. This supplemented the qualitative data from focus groups addressing the second part of the research purpose, to determine if geospatial video and a composite score motivate (influence the decision to use) specific trail selection among physically active adults.

2.2.3. Step 5: Final STAT Revisions

The final STAT was created from the integration of the qualitative and quantitative data collected in step 4. This integration was completed by analyzing patterns between focus group and survey data to compare findings from the qualitative and quantitative data [34]. Data were assessed using parallel constructs for both types of data and results were compared through transforming the qualitative data set into quantitative scores through ranking and jointly displaying both forms of data [23]. The two types of data provide validation for each other and also create a foundation for deriving decisions about changes to the items in the STAT tool while providing triangulation for perceptions about whether or not the video, specific categories of items, or a combination would help them determine if they would select a trail for exercise and if having any of this information would motivate them to do so.

3. Results

3.1. Step 2 Content Adopted from Validated Instruments

After reviewing NEWS, Walk Score, and PEAT audit tools, the researchers pulled content areas from these tools that served as a valid, theoretical basis including four constructs: (1) trail accessibility, (2) trail conditions, (3) trail amenities, and (4) trail safety. Constructs from the three validated instruments that could not be captured using the video were excluded from survey construction. These include (1) types of neighborhood residences; (2) stores, facilities, and other neighborhood amenities; and (3) neighborhood satisfaction. Constructs adopted and modified include (4) safety from traffic, and (5) safety from crime; the latter serving as a basis for STAT’s trail safety content. Please see Appendix A, Table A1 for the final STAT.
These validated instruments’ constructs were adopted based on what the researchers could capture using the video from which STAT was created and comprised of 20-items measuring trail quality. Trail audit tools also cannot archive or share collected data. Therefore, in conjunction with the adopted audit tool (STAT), a video-based composite score was calculated using geospatial techniques. The researchers determined that a geospatially enhanced instrument, combining items from three validated built environment audit tools, was most appropriate based on the ability to measure the items using geospatial techniques to archive and therefore share the collected data.
A composite score was calculated by adding together items from 6-point Likert scales. The scales included a not applicable inclusion (0), allowing for greater generalizability without devaluation of the composite score since (1) as the lowest option assigns value to a score that should have no value. An additional composite score was produced for the low- and high-intensity PA subsets, ranging from 0 to 25.

3.2. Step 3 STAT Test Results

During step 3, STAT was tested using the geospatial video collected in step 1. While researcher M.N. and authors N.C. and C.S. had different scores from each other (low interrater reliability), every score was within two points of each other, and consensus of the scores between the researcher and authors was determined and are reported in Table 1.

3.3. Step 4 Focus Group Responses

Participants from the focus group (n = 30) were an average age of 44, mostly White, 53% male, $70,000 average income, and averaged about 70 min per trail session 4.2 days a week. Participants also indicated that the type of exercise they planned to do informed which trail they would select. Please see Table 2 for survey participant demographics.
The focus group analysis resulted in six themes. The frequency of these themes as well as participant ranking indicated that safety was most important in selecting a trail for exercise. Trail amenities, conditions, and access were also highly important, aligning with the content areas included in STAT (Table 3). Safety was described by a participant as, “…how much a trail interacts with automobile traffic. Specifically, how much time must I spend riding in the street. In winter, if the trail is clear of snow and ice”. Another participant shared that amenities should include “…good trail markings and mileage markers, restrooms and water refill stations accessible”. A third participant shared the importance of trail of conditions, “I would prefer the level of muddiness on trail sections to be low when possible”. In terms of access, one participant shared, “…for some folk, I am assuming that wheelchair or stroller capabilities are important. I prefer my trails a bit raw less groomed”.
Participants shared that exercise type determined their trail selection. Therefore, they would only be motivated to use a new trail if it was appropriate for and supported the activity they were planning to do. A participant shared that this included “…length of the trail and ability to make your running route longer/shorter (multiple loops available)”. The motivation was increased if “…the trail has elevation change, is at least somewhat technical”. Lastly, participants shared that they would use the video, amenity scoring, and condition items to help them determine a trail was appropriate for and supported the activity they were planning to do if they had access to the trail.

3.4. Step 4 Survey Responses

Participants from message boards (n = 56) were slightly older than focus group participants with an average age of 46, similar to focus group participants in that they were mostly White and 55% male, with a higher average income of $74,000, and averaged more time, about 100 min per trail session, but less (2.3) days a week. Similar to the focus group participants, survey participants also indicated that the type of exercise they planned to do informed which trail they would select. Please see Table 4 for survey participant demographics.
The importance of STAT items for survey participants is in Table 5. Survey participants indicated that STAT items most important to them were how long the trail segments were followed by if there was any loitering or suspicious activity. The least important items included if there were picnic areas followed by if it was well lit and traffic speed.
As indicated by the mean score of the Likert scales, survey participants indicated that using the STAT composite score alongside the video to select a trail would be slightly more helpful in assisting them in planning to use a trail and in motivating them to use a trail than one or the other”. Trail conditions are slightly more important to survey participants than the other constructs, followed by safety, amenities, and access (Table 6).
When comparing focus group and survey data, both participant groups indicated that exercise type determined their trail selection rather than the opposite. Seeing a new trail would only motivate them to select it if it was appropriate for and supported the PA activity they were planning to do (Table 7). Table 7 shows the ranking comparison of how focus group and survey participants viewed the importance of STAT constructs. While focus group participants indicated safety was the most important construct, survey responses indicated access was the most important construct. The only category that ranked the same between the groups was conditions as the third most important construct.

4. Discussion

The study purpose was (1) to identify and adopt validated instruments for trail audit evaluations using geospatial video and a composite score and (2) to determine if geospatial video and a composite score motivate (influence the decision to use) specific trail selection among physically active adults. Current methods of measuring the use of trails for PA includes counting users, as well as noting types of PA at trail heads or using infrared cameras, which are often ineffective and inaccurate. Therefore, using a bicycle-mounted camera to collect trail quality and use simultaneously is an effective, time-saving approach to data collection, enabling access to locations not reachable by car and providing a faster alternative to walking. An analysis of male versus female results was not completed since equal representation was ensured, and it was outside the scope of this research purpose. Outcomes of STAT can be used by a variety of stakeholders to increase trail quality and subsequent trail use.

4.1. STAT Uses

Geospatial methods and trail audits (such as STAT) have numerous uses. First, trail user motivation to select and use a trail based on video and the composite score would be strengthened. This may be helpful for researchers, practitioners, employee health coordinators, health insurance companies, and clinicians interested in health promotion efforts focusing on access to locations for exercise. Outdoor spaces may offer a more sustainable solution than costs and commute time associated with a traditional gym membership. Furthermore, safety and accessibility measures included in STAT should be considered alongside familiarity, distance to the location, physical ability, and socioeconomic access when referring patients to locations for PA [39]. Thus, strengthening the healthcare system and public land links, including local trails, can help medical communities promote healthy, lower-cost activities that can be incorporated into the patients’ daily life.
Another potential use for STAT is to monitor trail maintenance for park district paths at all levels (community, state, and national) and community use over time. Neighborhoods could be evaluated for walking, cycling, and running for recreation and active transit, including shared or dedicated bike/pedestrian paths and safe routes to schools, parks, libraries, and other community locations. Grant writers applying to awards to enhance these locations (e.g., parks, schools, neighborhoods, active transit) are often required to include path or trail audit results in their applications. STAT provides both these audit results and examples such as frame images and video links, enhancing grant applications.
Additionally, community safety concerns could be addressed by matching city crime data with STAT’s trail safety perceptions. By testing trail safety perception with actual city crime data, community concerns can be addressed as needed through communication or police department surveillance as needed. Moreover, trail condition and amenity outcomes can be mapped and distributed to stakeholders and community members to increase the passage of park levies and other trail improvement and upkeep.

4.2. Rural Implications

Rural communities may find STAT particularly helpful as they manage more geographical space with fewer resources, including staff. These communities also tend to have poorer health outcomes, including PA [8], making safe access to high quality and trails and paths for PA even more important. Therefore, STAT results could be disseminated to community hospitals, government officials, stakeholders, and community members to raise awareness and address rural trail inequities through financial support such as grants.
The use of trails is associated with meeting PA recommendations in rural populations and at the same time, aside from one intervention, Heartland Moves (HM) [15], study settings do not focus on trail quality or use [40,41,42,43]. Rather, settings tend to include schools, churches, community locations, worksites, medical practices and clinics, participants’ homes, community or recreation centers and are sometimes unreported [40,41,42,43]. Though these studies have mixed results on increasing rural PA, there is some evidence to support the effectiveness of theory and models, including the SEM [13] and community-based interventions that include low to moderate-intensity exercise to increase PA, physical function, and psychological state [43]. Authors recommended that future rural interventions focus on reported values and interests, such as personal relationships and being outdoors, and focus on those rural populations who do not meet PA recommendations [15]. More rigorous studies are required to identify the most critical characteristics of community-based interventions for rural settings, which may be supported through STAT.

4.3. Future Research Directions

Although each of the three built environment audit tools (NEWS, Walk Score, PEAT) have been well-documented, tested, and validated, our adopted version of these tools, STAT, should undergo further validation among both diverse samples of trail users and practitioners, grant writers, and researchers. Additionally, while the development of STAT was both inspired by and constructed in conjunction with the use of geospatial video, the use of STAT is not limited to this technology. Geospatial video is, in general, a helpful dissemination tool and communication aid to share trail conditions and results with community stakeholders. While Plano Clark’s (2018) [23] exploratory sequential core design helped create and validate STAT, it requires ensuring participants included in the qualitative strand are different than those in the quantitative strand. Although the authors followed this during recruitment, it could not be ensured that there was no overlap. Therefore, future research should use a large sample of individuals who are very different (e.g., location, age, income) than those included in this research. Due to using trails that run through a mix of rural and urban areas to develop STAT, it should be further tested in rural areas.
While Plano Clark’s (2018) [23] exploratory sequential core design in phase 1 helped create and validate STAT, it requires ensuring participants included in the qualitative strand are different than those in the quantitative strand. Although the authors followed this during recruitment, it could not be ensured that there was no overlap. Therefore, future research should use a large sample of individuals who are very different (e.g., location, age, income) than those included in this research. Phase 2 used Plano Clark’s (2018) [23] convergent design, which recommends using equal quantitative and qualitative sample sizes. The researchers were not able to achieve this, but the intent of the sample sizes was different as the focus group had a smaller sample size to ensure each participant had a chance to speak, and the survey was to obtain group means. Future research could build on this strategy by gathering data to compare quantitative group means with qualitative individual experiences through interviews.
Though geospatial video is instrumental for STAT, it likewise poses noteworthy temporal limitations. Captured geospatial data are physically limited to what was captured during the collection outing, characterized by the day and time of data collection. Since trail condition is variable depending upon the time of day, the time of year, and weather condition, temporality could alter the physical condition and, subsequent evaluation of the trail. As such, trail evaluations utilizing spatial video to administer STAT should collect multiple videos across a variety of times (such as seasonally) and continue routinely to establish archival data. Finally, a central platform for geospatial video storage, retrieval, and dissemination would be helpful due to large file sizes.

5. Conclusions

STAT increases efficiency and accuracy of assessing trail quality and use for PA using multiple levels of the SEM compared to current methods of counting users, noting types of PA at trail heads, and infrared cameras. Furthermore, since STAT uses geospatial video, a bicycle-mounted camera, it simultaneously collects trail quality, special temporal relationships and provides access to locations not reachable by car. Additionally, trail users indicated motivation to select and use trails based on STAT’s video and composite score. Therefore, a variety of stakeholders and communities may find STAT useful for increasing trail quality and use. Rural communities may especially benefit from STAT to promote PA across a variety of industries and environments. STAT results could be disseminated to address inequities through potential supports such as grants, levies, and other applications for funds.

Author Contributions

Conceptualization, C.S. and N.C.; methodology, C.S., N.C. and C.K.; software, C.S. and N.C.; validation, C.S. and N.C.; formal analysis, C.S. and N.C.; investigation, C.S. and N.C.; resources, C.S., N.C. and C.K.; data curation, C.S., C.K.; writing—original draft preparation, C.S., N.C. and C.K.; writing—review and editing, C.S. and C.K.; visualization, C.S. and C.K.; supervision, C.S.; project administration, C.S.; funding acquisition, C.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by a Faculty Research Capacity Award from Northcentral University.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Kent State University (protocol code 16-597, 10.13.16).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data are not publicly available due to privacy concerns.

Acknowledgments

The authors would like to thank Matthew Nichols for his important contributions to the conceptualization, methodology, and validation of this research.

Conflicts of Interest

The authors declare no conflict of interest.

Appendix A

Table A1. Spatial–Temporal Trail Audit Tool (STAT).
Table A1. Spatial–Temporal Trail Audit Tool (STAT).
Access No Not at All Yes Very Much
(Circle One)
1There is adequate parking at the respective trailhead.012345
2The trail’s design enables easy access to connecting routes and paths.012345
3The trail is easily accessible by both cyclists and pedestrians.012345
4The trail is free of many four-way intersections.012345
5There is adequate signage throughout the length of the trail.012345
6The trail is not interrupted by long street segments.012345
Trail Conditions
7The trail is groomed, even, and easy to navigate.012345
8The trail is generally free from litter and debris.012345
9The distance between the trail’s intersections is short (100 yards or less).012345
Amenities
10There are bridges where applicable.012345
11Benches and/or picnic tables can be found along the trail.012345
12There are adequate restroom facilities near the trailhead along the trail.012345
13Trees provide ample shade along the trail.012345
Safety
14There is adequate separation between the street and the trail.012345
15The speed of traffic on nearby streets is slow (30 mph or less).012345
16The trail is free of blind spots.012345
17The trail is free of loitering/suspicious activity.012345
18The trails is free of graffiti.012345
19The trail is well lit at dusk and dawn.012345
20Walkers and bikers can easily be seen by other trail users.012345
Lower intensity exercise (Walking)
1The trail is not overly crowded.012345
2The area around the trail has pedestrian destinations.012345
3Trail promotes walking with others (wide enough, social interaction).012345
4There is natural scenery throughout the trail.012345
5The trail is in close proximity to my home.012345
Higher intensity exercise (Running, Cycling)
1The trail is free from congestion and traffic to allow safe pass through.012345
2The trail has ideal surface for (select one of the below for scoring):012345
-Running: natural surface (uneven and even surfaces)012345
-Road bicycling: asphalt (hard, even surfaces)012345
-Mountain bicycling: dirt (uneven surfaces)012345
-Hybrid bicycling: sandstone (even surfaces)012345
3The trail provides adequate mileage for higher intensity exercise.012345
4The trail provides adequate facilities (bike rack, water fountain, etc.).012345
5The trail is in route to a destination (home, work, recreation, etc.).012345

References

  1. Towne, S.D.; Li, Y.; Lee, S.; Smith, M.L.; Han, G.; Quinn, C.; Du, Y.; Benden, M.; Ory, M.G. Physical Activity and Associated Medical Cost Savings Among At-Risk Older Adults Participating a Community-Based Health & Wellness Program. PLoS ONE 2018, 13, e0198239. [Google Scholar] [CrossRef]
  2. Kokkinos, P. Physical Activity, Health Benefits, and Mortality Risk. Int. Sch. Res. Not. 2012, 2012. [Google Scholar] [CrossRef] [Green Version]
  3. World Health Orangization Physical Activity. Available online: https://www.who.int/news-room/fact-sheets/detail/physical-activity (accessed on 6 May 2021).
  4. Arem, H.; Moore, S.C.; Patel, A.; Hartge, P.; de Gonzalez, A.B.; Visvanathan, K.; Campbell, P.T.; Freedman, M.; Weiderpass, E.; Adami, H.O.; et al. Leisure Time Physical Activity and Mortality: A Detailed Pooled Analysis of the Dose-Response Relationship. JAMA Intern. Med. 2015, 175, 959–967. [Google Scholar] [CrossRef]
  5. Centers for Disease Control and Prevention 2018 Trend Tables. 2019. Available online: https://www.cdc.gov/nchs/data/hus/hus18.pdf (accessed on 16 June 2021).
  6. Clarke, T.C.; Norris, T.; Schiller, J.S. Early Release of Selected Estimates Based on Data from the 2016 National Health Interview Survey; Division of Health Interview Statistics, National Center for Health Statistics. 2017. Available online: https://www.cdc.gov/nchs/data/nhis/earlyrelease/earlyrelease201705.pdf (accessed on 16 June 2021).
  7. Ball, K.; Carver, A.; Downing, K.; Jackson, M.; O’Rourke, K. Addressing the Social Determinants of Inequities in Physical Activity and Sedentary Behaviours. Health Promot. Int. 2015, 30, ii8–ii19. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Beck, A.M.; Eyler, A.A.; Hipp, J.A.; King, A.C.; Tabak, R.G.; Yan, Y.; Reis, R.S.; Duncan, D.D.; Gilbert, A.S.; Serrano, N.H.; et al. A Multilevel Approach for Promoting Physical Activity in Rural Communities: A Cluster Randomized Controlled Trial. BMC Public Health 2019, 19, 1. [Google Scholar] [CrossRef] [PubMed]
  9. Whitfield, G.P. Trends in Meeting Physical Activity Guidelines Among Urban and Rural Dwelling Adults—United States, 2008–2017. Morb. Mortal. Wkly. Rep. 2019, 68, 513–518. [Google Scholar] [CrossRef] [Green Version]
  10. Census, B. of the Urban Areas for the 2020 Census—Proposed Criteria. Fed. Regist. 2021, 86, 10237–10243. [Google Scholar]
  11. Meyer, M.R.U.; Moore, J.B.; Abildso, C.; Edwards, M.B.; Gamble, A.; Baskin, M.L. Rural Active Living: A Call to Action. J. Public Health Manag. Pract. 2016, 22, E11–E20. [Google Scholar] [CrossRef] [Green Version]
  12. Osuji, T.; Lovegreen, S.; Elliott, M.; Brownson, R.C. Barriers to Physical Activity Among Women in the Rural Midwest. Women Health 2006, 44, 41–55. [Google Scholar] [CrossRef]
  13. Walsh, S.M.; Meyer, M.R.U.; Gamble, A.; Patterson, M.S.; Moore, J.B. A Systematic Review of Rural, Theory-Based Physical Activity Interventions. Am. J. Health Behav. 2017, 41, 248–258. [Google Scholar] [CrossRef]
  14. Chrisman, M.; Nothwehr, F.; Yang, G.; Oleson, J. Environmental Influences on Physical Activity in Rural Midwestern Adults: A Qualitative Approach. Health Promot. Pract. 2015, 16, 142–148. [Google Scholar] [CrossRef] [Green Version]
  15. Park, T.; Eyler, A.A.; Tabak, R.G.; Valko, C.; Brownson, R.C. Opportunities for Promoting Physical Activity in Rural Communities by Understanding the Interests and Values of Community Members. J. Environ. Public Health 2017, 2017. [Google Scholar] [CrossRef] [Green Version]
  16. Aranow, C. Vitamin D and the Immune System. J. Investig. Med. 2011, 59, 881–886. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Demir, M.; Demir, F.; Aygun, H. Vitamin D deficiency is associated with COVID-19 positivity and severity of the disease. J. Med. Virol. 2021, 93, 2992–2999. [Google Scholar] [CrossRef] [PubMed]
  18. Reynolds, K.D.; Wolch, J.; Byrne, J.; Chou, C.-P.; Feng, G.; Weaver, S.; Jerrett, M. Trail Characteristics as Correlates of Urban Trail Use. Am. J. Health Promot. 2007, 21, 335–345. [Google Scholar] [CrossRef] [PubMed]
  19. Petrella, R.J.; Kennedy, E.; Overend, T.J. Geographic Determinants of Healthy Lifestyle Change in a Community-Based Exercise Prescription Delivered in Family Practice. Environ. Health Insights 2008, 1, 51–62. [Google Scholar] [CrossRef]
  20. Abildso, C.G.; Haas, V.; Daily, S.M.; Bias, T.K. Field Test of a Passive Infrared Camera for Measuring Trail-Based Physical Activity. Front. Public Health 2021, 9, 225. [Google Scholar] [CrossRef]
  21. Mills, J.W.; Curtis, A.; Kennedy, B.; Kennedy, S.W.; Edwards, J.D. Geospatial Video for Field Data Collection. Appl. Geogr. 2010, 30, 533–547. [Google Scholar] [CrossRef]
  22. Curtis, A.; Curtis, J.W.; Shook, E.; Smith, S.; Jefferis, E.; Porter, L.; Schuch, L.; Felix, C.; Kerndt, P.R. Spatial Video Geonarratives and Health: Case Studies in Post-Disaster Recovery, Crime, Mosquito Control and Tuberculosis in the Homeless. Int. J. Health Geogr. 2015, 14, 22. [Google Scholar] [CrossRef] [Green Version]
  23. Creswell, J.W.; Plano Clark, V.L. Designing and Conducting Mixed Methods Research, 3rd ed.; Sage Publications Inc.: Thousand Oaks, CA, USA, 2018. [Google Scholar]
  24. Greene, J.C.; Caracelli, V.J.; Graham, W.F. Toward a Conceptual Framework for Mixed-Method Evaluation Designs. Educ. Eval. Policy Anal. 1989, 11, 255–274. [Google Scholar] [CrossRef]
  25. Rink, M. Stadium Park Walking Track to be Replaced. 2014. Available online: https://www.cantonrep.com/article/20140403/NEWS/140409616 (accessed on 16 June 2021).
  26. United States Census Bureau Data. Available online: https://www.census.gov/data (accessed on 16 June 2021).
  27. Ermagun, A.; Lindsey, G.; Loh, T.H. Urban Trails and Demand Response to Weather Variations. Transp. Res. Part D Transp. Environ. 2018, 63, 404–420. [Google Scholar] [CrossRef]
  28. Curtis, A.; Duval-Diop, D.; Novak, J. Identifying Spatial Patterns of Recovery and Abandonment in the Post-Katrina Holy Cross Neighborhood of New Orleans. Cartogr. Geogr. Inf. Sci. 2010, 37, 45–56. [Google Scholar] [CrossRef]
  29. Cerin, E.; Saelens, B.E.; Sallis, J.F.; Frank, L.D. Neighborhood Environment Walkability Scale: Validity and Development of a Short Form. Med. Sci. Sports Exerc. 2006, 38, 1682–1691. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Sallis, J.F.; Floyd, M.F.; Rodríguez, D.A.; Saelens, B.E. Role of Built Environments in Physical Activity, Obesity, and Cardiovascular Disease. Circulation 2012, 125, 729–737. [Google Scholar] [CrossRef]
  31. Lerner, M.R.; Kocher, J.G.; Mathieu, M.C.; EBSCOhost. Walk Score Management LLC Gets Patent for Systems, Techniques, and Methods for Providing Location Assessments Global IP News: Information Technology Patent News, Gale MI USA, 2014. Available online: https://search.ebscohost.com/login.aspx?direct=true&AuthType=ip,sso&db=edsinc&AN=edsinc.A390574362&site=eds-live (accessed on 16 June 2021).
  32. Carr, L.J.; Dunsiger, S.I.; Marcus, B.H. Validation of Walk Score for estimating access to walkable amenities. Br. J. Sports Med. 2011, 45, 1144–1148. [Google Scholar] [CrossRef]
  33. Duncan, D.T.; Aldstadt, J.; Whalen, J.; Melly, S.J.; Gortmaker, S.L. Validation of Walk Score® for Estimating Neighborhood Walkability: An Analysis of Four US Metropolitan Areas. Int. J. Environ. Res. Public Health 2011, 8, 4160–4179. [Google Scholar] [CrossRef] [PubMed]
  34. Troped, P.J.; Cromley, E.K.; Fragala, M.S.; Melly, S.J.; Hasbrouck, H.H.; Gortmaker, S.L.; Brownson, R.C. Development and Reliability and Validity Testing of an Audit Tool for Trail/Path Characteristics: The Path Environment Audit Tool (PEAT). J. Phys. Act. Health 2006, 3, S158–S175. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Liamputtong, P. Focus Group Methodology: Principles and Practice; SAGE Publications, Inc.: Thousand Oaks, CA, USA, 2011. [Google Scholar]
  36. Saldana, J. The Coding Manual for Qualitative Researchers, 3rd ed.; SAGE Publications: Thousand Oaks, CA, USA, 2016; ISBN 978-1-4739-0248. [Google Scholar]
  37. The IPAQ Group IPAQ Scoring Protocol. Available online: https://sites.google.com/site/theipaq/scoring-protocol (accessed on 30 April 2019).
  38. Craig, C.L.; Marshall, A.L.; Sjorstrom, M.; Bauman, A.E.; Booth, M.L.; Ainsworth, B.E.; Pratt, M.; Ekelund, U.L.F.; Yngve, A.; Sallis, J.F. International Physical Activity Questionnaire: 12-Country Reliability and Validity. Med. Sci. Sports Exerc. 2003, 35, 1381–1395. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  39. Vaughan, K.B.; Kaczynski, A.T.; Stanis, S.A.W.; Besenyi, G.M.; Bergstrom, R.; Heinrich, K.M. Exploring the Distribution of Park Availability, Features, and Quality Across Kansas City, Missouri by Income and Race/Ethnicity: An Environmental Justice Investigation. Ann. Behav. Med. 2013, 45, S28–S38. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Bhuiyan, N.; Singh, P.; Harden, S.M.; Mama, S.K. Rural Physical Activity Interventions in the United States: A Systematic Review and RE-AIM Evaluation. Int. J. Behav. Nutr. Phys. Act. 2019, 16, 1–11. [Google Scholar] [CrossRef] [PubMed]
  41. Cai, Y.; Richards, E.A. Systematic Review of Physical Activity Outcomes of Rural Lifestyle Interventions. West. J. Nurs. Res. 2016, 38, 909–927. [Google Scholar] [CrossRef] [PubMed]
  42. Cleland, V.; Squibb, K.; Stephens, L.; Dalby, J.; Timperio, A.; Winzenberg, T.; Ball, K.; Dollman, J. Effectiveness of Interventions to Romote Physical Activity and/or Decrease Sedentary Behaviour Among Rural Adults: A Systematic Review and Meta-Analysis. Obes. Rev. 2017, 18, 727–741. [Google Scholar] [CrossRef] [PubMed]
  43. Moore, M.; Warburton, J.; O’Halloran, P.D.; Shields, N.; Kingsley, M. Effective Community-Based Physical Activity Interventions for Older Adults Living in Rural and Regional Areas: A Systematic Review. J. Aging Phyiscal Act. 2016, 24, 158–167. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Study timeline and pictorial representation of study design.
Figure 1. Study timeline and pictorial representation of study design.
Ijerph 18 08741 g001
Figure 2. Portable, bicycle-mounted geospatial video camera.
Figure 2. Portable, bicycle-mounted geospatial video camera.
Ijerph 18 08741 g002
Figure 3. Map of Portage hike and Bike trail and West branch trail. Note. From trails-to-trail conservancy. Portage hike and Bike trail. Available online: https://www.traillink.com/trail-maps/portage-hike-and-bike-trail/ (accessed on 5 August 2021).
Figure 3. Map of Portage hike and Bike trail and West branch trail. Note. From trails-to-trail conservancy. Portage hike and Bike trail. Available online: https://www.traillink.com/trail-maps/portage-hike-and-bike-trail/ (accessed on 5 August 2021).
Ijerph 18 08741 g003
Table 1. Scoring of the Ohio trails.
Table 1. Scoring of the Ohio trails.
Measure (Max Score)Trail A: CantonTrail B: Kent
Access (30)2624
Conditions (15)1514
Amenities (20)1820
Safety (35)3032
Composite Score (100)8990
Lower intensity exercise (25)2123
Higher intensity exercise (25)1912
Table 2. Focus group participants.
Table 2. Focus group participants.
MeasurenMean/Percentage *
Age3046
Race
White2893.3%
Choose not to answer26.7%
Sex
Male1653.3%
Female1446.7%
Income30$70,000
Minutes per trail session3069.6
Days per week trail session304.2
Trail determines activity30100%
* Mean and percentage of frequency are reported.
Table 3. Focus group themes.
Table 3. Focus group themes.
ThemeSample QuoteFrequency
SafetyIt is important to have no poison ivy, oak on the trails”.30
AmenitiesWater at trailhead. Information board at trailhead with maps and information about connecting trails”.26
ConditionsSplit litter and debris into two different items. No one wants litter, but I don’t care about downed branches, leaves etc”.23
AccessProximity of a trailhead that I can actually ride my bike to vs. driving”.21
Selection decisionoverall length of trails-high priority19
MotivationWhether the trail can be a challenge12
Table 4. Survey participants.
Table 4. Survey participants.
MeasurenMean/Percentage *
Age3846
Race
White3592.1%
Choose not to answer25.3%
Asian/Pacific Islander12.6%
Sex
Male2155.3%
Female1744.7%
Income35$74,000
Minutes per trail session38100.8
Days per week trail session352.3
Trail determines activity3791.9%
* Mean and percentage of frequency are reported.
Table 5. Importance of STAT items for survey participants (n = 56).
Table 5. Importance of STAT items for survey participants (n = 56).
ConstructMeasureMean/Percentage *
AccessParking3.93
Connecting3.79
Cyclists/Pedestrians2.54
4-way intersections2.62
Signage3.80
Segments4.23
ConditionsGroomed2.38
Litter Free3.77
Short Intersections2.02
AmenitiesBridges2.80
Picnic Tables1.50
Restrooms3.02
Shade3.25
SafetyStreet Separation3.68
Traffic Speed1.96
Blind Spots2.09
Loitering4.14
Graffiti3.29
Well lit1.91
Can see others2.56
* Mean and percentage of frequency are reported.
Table 6. Use of STAT to select trails (n = 35).
Table 6. Use of STAT to select trails (n = 35).
MeasureConstructMean/Percentage *
Geospatial VideoPlanning2.14
Motivating2.26
STAT ConstructsAccess2.63
Conditions2.91
Amenities2.83
Safety2.86
All constructs used to select trail2.91
Geospatial video used to select trail2.71
STAT used to select trail2.94
* Mean and percentage of frequency are reported.
Table 7. Qualitative and quantitative joint table: ranking comparison of focus group and survey scores.
Table 7. Qualitative and quantitative joint table: ranking comparison of focus group and survey scores.
ConstructFocus GroupSurvey
Access4th1st
Conditions3rd3rd
Amenities2nd4th
Safety1st2nd
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Smock, C.; Carlson, N.; Kirkland, C. Trail Conditions and Community Use: Utilizing Geospatial Video to Guide the Adoption of a Spatial-Temporal Trail Audit Tool (STAT). Int. J. Environ. Res. Public Health 2021, 18, 8741. https://doi.org/10.3390/ijerph18168741

AMA Style

Smock C, Carlson N, Kirkland C. Trail Conditions and Community Use: Utilizing Geospatial Video to Guide the Adoption of a Spatial-Temporal Trail Audit Tool (STAT). International Journal of Environmental Research and Public Health. 2021; 18(16):8741. https://doi.org/10.3390/ijerph18168741

Chicago/Turabian Style

Smock, Carissa, Naomi Carlson, and Chelsey Kirkland. 2021. "Trail Conditions and Community Use: Utilizing Geospatial Video to Guide the Adoption of a Spatial-Temporal Trail Audit Tool (STAT)" International Journal of Environmental Research and Public Health 18, no. 16: 8741. https://doi.org/10.3390/ijerph18168741

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop