Next Article in Journal
Effects of Training of Pharmacists in Japan on Reasonable Accommodations for People with Intellectual Disabilities
Previous Article in Journal
Challenges with the Disability Policy Framework in Zimbabwe: An In-Depth Qualitative Analysis of Perspectives of Youth with Disabilities
Previous Article in Special Issue
Perceived Inclusivity in Mobility Aids Use: A Qualitative Study in Iran
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Enhancing Urban Accessibility: Reliability and Validity Assessment of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool

1
Department of Gerontology, Simon Fraser University, Vancouver, BC V6B 5K3, Canada
2
Department of Occupational Science and Occupational Therapy, Faculty of Medicine, University of British Columbia, Vancouver, BC V6T 2B5, Canada
*
Author to whom correspondence should be addressed.
Disabilities 2025, 5(2), 42; https://doi.org/10.3390/disabilities5020042
Submission received: 29 November 2024 / Revised: 15 April 2025 / Accepted: 17 April 2025 / Published: 25 April 2025
(This article belongs to the Special Issue Mobility, Access, and Participation for Disabled People)

Abstract

:
As Canada’s population ages and disability prevalence increases, understanding the built environment’s impact on mobility and social participation is essential. This study evaluates the measurement properties of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods (SWAN) tool, a user-led instrument designed to assess environmental factors affecting older adults and individuals with disabilities. Using community-based participatory research, we recruited 54 participants from five cities to assess the SWAN tool’s inter-rater reliability, construct validity, and internal consistency. The results indicated a high overall inter-rater reliability of 85.22%, with substantial Cohen’s Kappa coefficients across domains, particularly in the Safety domain (0.73). The construct validity was confirmed through moderate to strong correlations with established measures, notably a correlation of 0.79 between the Street Crossing subdomain and the Sidewalk Index. The internal consistency analysis showed excellent reliability in the Functionality domain (α = 0.95) and a lower consistency value in the Social Environment domain (α = 0.63), suggesting the need for further refinement. These findings provide preliminary evidence of the SWAN tool’s potential for evaluating neighbourhood accessibility. By identifying barriers and facilitators to mobility, the SWAN tool can guide urban planning efforts aimed at creating inclusive environments for aging populations and individuals with disabilities. Future research should focus on larger samples to explore structural validity. Ultimately, the SWAN tool can contribute to improving the quality of life of vulnerable populations and promote more equitable urban policy development.

1. Introduction

Canada’s population is aging, and the prevalence of disability is also increasing. In 2010, 14.1% of Canada’s population was aged 65 or older, a proportion that has notably climbed to 19.0% in 2022. Projections from Statistics Canada indicate a continuation of this trend, reaching an estimated 22.5% by 2030 [1]. Likewise, the prevalence of disabilities among Canadians aged 15 and older has significantly increased from 22% in 2017 to 27% in 2022, with a notable correlation between age and disability prevalence [2]. This dual demographic trend signifies the evolving character of Canada’s population, suggesting the necessity for nuanced policies and better health and social services to address the needs of these populations.
The built environment has a profound impact on the mobility of older adults and people with disabilities, which can affect their health and quality of life [3,4,5,6,7]. For instance, individuals who are deaf or hard of hearing feel less safe when navigating the pedestrian environment as they struggle to hear traffic on the road [8]. Persons living with cognitive disabilities often experience challenges with navigation of their own environment, which is heightened when communities do not integrate sufficient green spaces and landmarks (such as large shops, libraries, community centres, and senior centres) to help reduce the stress of wayfinding [9]. Moreover, people using mobility assistive devices may find it challenging to navigate the built environment, especially during rain and snow because of inadequate drainage or snow removal [5]. This aligns with the International Classification of Functioning, Disability, and Health (ICF), which posits that disability and functioning are outcomes that result from the interplay between health conditions (such as diseases, disorders, and injuries) and contextual factors, including the built environment [10].
Environmental variables that can affect the experience of being mobile in a place fall into two broad categories: macroscale variables, consisting of structural features such as street inter-connectivity and land use mix [11,12]; and microscale variables, or details such as aesthetics, sidewalk design, and maintenance [13]. While much research has concentrated on macroscale variables that define walkability [14], investigating microscale features is also valuable for understanding the mobility experience [15,16,17]. Microscale characteristics of the built environment can often be modified at a lower cost and within a shorter timeframe compared to restructuring macroscale designs [18].
A persistent challenge in this field of study revolves around developing valid and reliable micro-level metrics to assess sidewalk and street design, which can impact non-vehicular travel behaviour [19,20]. Assessment instruments, including audit tools, must demonstrate both reliability and validity for study results to be credible. Reliability refers to whether an assessment instrument yields consistent results each time it is used in the same setting with the same type of subjects, essentially indicating dependable outcomes [12,21]. Validity is an overall evaluative judgment of the degree to which empirical evidence and theoretical rationales support the adequacy and appropriateness of interpretations and actions based on test scores or other modes of assessment [22]. Thus, an instrument is considered valid when its construction and applicability allow it to accurately measure its target [23].
Various audit tools have been developed and tested to evaluate the microscale qualities of the built environment, particularly at the street level, through on-site visits [24]. The Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods (SWAN) is a microscale user-led audit tool designed to evaluate both objective and subjective aspects of the built environment that affect the lives of older adults and individuals using mobility assistive devices, people who are deaf or hard of hearing, and people living with mild cognitive impairment, including dementia [25]. Various audit tools have been developed and tested to evaluate the microscale qualities of the built environment, particularly at the street level, through on-site visits [24]. The Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods (SWAN) is a microscale user-led audit tool designed to evaluate both objective and subjective aspects of the built environment. Compared to other audit tools, the SWAN tool captures features that affect the mobility and social participation of older adults and individuals using mobility assistive devices [25]. The SWAN tool was later updated to capture other streams of disability, including mild cognitive impairment and sensory (hearing and vision) impairment [26].
Given the critical need for tools to assess the built environment’s impact on the mobility and social participation of older adults and people living with disability, this paper aims to address this gap by investigating the measurement properties of the SWAN tool. In this paper, the results for the inter-rater reliability (IRR), construct validity, and internal consistency of the SWAN tool used by individuals using mobility assistive devices, people who are deaf or hard of hearing, and people living with mild cognitive impairment, including dementia, are reported.
This paper is structured as follows: In Section 2, we describe the materials and methods used in this study, including participant recruitment, data collection tools, and the evaluation processes. Section 3 presents the results, including the IRR, construct validity, and internal consistency of the SWAN tool. In Section 4, we discuss the implications of the findings, limitations, and potential directions for future research. Finally, Section 5 concludes the paper, summarizing the key findings and their relevance for enhancing mobility and social participation in built environments for individuals with disabilities.

2. Materials and Methods

2.1. Research Design

2.1.1. Recruitment

This study was based on community-based participatory research (CBPR), in which participants were considered as co-researchers. The CBPR promotes self-advocacy among participants and facilitates policy changes that are reflective of community needs [27]. Fifty-four participants were recruited in 5 cities including Vancouver, North Vancouver, Burnaby, Richmond, and Surrey. For recruitment, the SWAN team established contact with community centres, relevant organizations, and healthcare networks to identify potential participants. In these communications, they provided a brief overview of the study and its objectives. If an organization expressed interest, research assistants proceeded to distribute flyers and put up posters in these locations. Individuals who were interested then connected with the team through email or phone to assess eligibility criteria. To ensure a streamlined participant onboarding process, we centralised the procedure by appointing a researcher as the Central Administrator (CA). When an interested person contacted the Central Administrator, the CA arranged a suitable date and time for discussing eligibility and participation. The person’s eligibility was determined by answering the following questions:
  • Do you have a mobility/hearing/cognitive disability?
    If so, are you 19 years of age or older?
    If not, are you 60 years or older?
  • Can you independently walk or wheel for four city blocks over a period of up to three to four hours?
  • Do you reside in the city of Vancouver, Burnaby, North Vancouver, Richmond, or Surrey?
  • Are you capable of providing informed consent?

2.1.2. Locations for Data Collection

Once the eligibility was confirmed, the date and location of data collection were finalised based on the participant’s preference. Locations for collecting data were identified meaningfully through undertaking a stepwise approach. In the initial phase of the study, the research team employed Geographic Information System (GIS) layers to identify problematic intersections and their adjacent areas within the Lower Mainland. These GIS layers included data on transportation hubs (locations with public transportation like SkyTrain stations or bus stops), number of collisions, presence of commercial buildings, and other relevant features. The primary outcome of this step was the creation of a map showing up to ten hotspots (intersections) within each of the five municipalities. In the next stage, an interactive forum was arranged, bringing together individuals with disabilities, professionals, community partners from senior centres, and municipal officials. The purpose of this forum was to gain a comprehensive understanding of the difficulties encountered at the selected intersections and their adjacent areas. After the forum discussions and consultations with stakeholders, the decision was made to focus data collection efforts on four intersections in each city.
On the day of data collection, two research assistants accompanied each participant. The lead research assistant provided support as needed; if the participant preferred, the lead RA would ask questions and assist them to complete the form. If the participant preferred to fill out the form independently, the lead RA was available to provide clarifications on any questions. Meanwhile, the secondary research assistant completed a separate audit form to assess the reliability of the tool. The secondary RA also took photographs, if requested by the participant, and recorded any additional comments the participant provided.

2.2. Data Collection

Data were collected using various tools in this study to assess different aspects of the built environment. First, a demographic form was used to gather participants’ demographic information. After completing the SWAN tool, three complementary tools were utilised to provide a more comprehensive assessment of the environment: the Home and Community Environment (HACE) Instrument, the Sidewalk Index (SI), and Walk Score. In the following sections, details on each of these measurements are provided.

2.2.1. Demographic Form

Demographic data were collected on age, gender identity, marital status, employment status, living situation, education level, and income. Participants were also asked to indicate their housing type (single or multi-unit housing), location of living (city or suburbs), and familiarity with the neighbourhood.

2.2.2. Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool

The SWAN is a microscale user-led audit tool that allows users to assess the facilitators of and barriers to mobility, access, and social participation in their neighbourhoods. The SWAN tool is an adaptation of the SWEAT-R tool that captures the perspective of older adults on neighbourhood accessibility [28]. Moreover, the development of the SWAN tool included a comprehensive literature review and incorporated aspects of other user-led tools, such as the Microscale Audit of Pedestrian Streetscapes (MAPS) [29,30], the Built Environment and Active Transport (B.E.A.T.) Neighbourhood Assessment [31], and Jane’s Walkability Checklist [32]. The tool asks users to assess the presence of specific design features in their environment, such as: “Is there a crosswalk?” or “Is there a pedestrian signal?”.
Previous research using the SWAN tool was primarily conducted with older adults and people using mobility assistive devices. To encompass a broader spectrum of disability experiences, the SWAN tool was updated using a Community-Based Participatory Research (CBPR) approach, allowing for the inclusion of individuals who are deaf or hard of hearing and those with mild cognitive disabilities, such as those in the early stages of dementia, to systematically assess their neighbourhoods. The new version of SWAN tool can be used for people with mobility, hearing, or cognitive disabilities. The CBPR approach involves collaboration between researchers and community members as partners throughout the research process [1]. Individuals with disabilities and other stakeholders provide valuable input in concept validation, tool adaptation, and pilot testing through the establishment of a committee (SWAN Development Committee) comprising individuals with lived and/or professional experience.
Within the SWAN tool, the assessment of walkability and wheelability extends beyond the physical infrastructure of streets and sidewalks. It encompasses a wide range of neighbourhood components that are strategically chosen to enhance the social participations of older adults and individuals living with disability.
The SWAN tool employs a structured framework that consists of 185 items spread across five distinct domains including the following: 1. functionality of (a) street crossings and (b) sidewalks; 2. safety of (a) street features and traffic and (b) personal safety of pedestrians; 3. appearance and maintenance; 4. land use and supportive features; and 5. social aspects. The significance of these domains has been verified in focus groups with people with lived experience [25,28]. To facilitate data collection, the SWAN tool utilises a presence/absence checklist to objectively record the presence or absence of specific environmental elements in a paper format.
Additionally, it employs a 5-point Likert scale for each domain and subdomain to gauge the subjective score for each domain and subdomain. This rating scale ranges from “poor” (scored as “1”) to “excellent” (scored as “5”). This allows one to comprehensively assess the neighbourhood environment from both objective and subjective perspectives.

2.2.3. Home and Community Environment Instrument

The HACE tool assesses various factors within an individual’s home and community environment. The initial HACE prototype covered five domains, including the following: Home Mobility; Community Mobility; Basic Mobility Devices; and Communication Devices, Transportation, and Attitudes. It has adequate internal consistency (α = 0.70–0.85 across subscales) and construct validity through correlations with functional outcomes in rehabilitation populations [33]. Notably, five questions from the Community Mobility domain were integrated into the data collection.

2.2.4. Sidewalk Index

The SI evaluates the performance of sidewalks and public spaces based on the needs of wheelchair users, considering comfort and safety variables. This is an efficient and easily applicable tool to identify the current infrastructural conditions of sidewalks and street crossings, as well as their design characteristics [34]. During data collection, the SI focused on evenness, maintenance, width, and surface quality, with no inquiries about the suitability of pedestrian crossings.

2.2.5. Walk Score

Walk Score measures the walkability of neighbourhoods. Analysing walking routes to nearby amenities, Walk Score points are awarded based on distance, with a decay function for more distant amenities. The scale categorises walkability into four levels based on scores, ranging from Very Walkable to Car-Dependent. A score of 70–89 indicates that most errands can be accomplished on foot, classifying the area as Very Walkable. A score of 50–69 suggests that some errands can be completed on foot, making it Somewhat Walkable. Scores between 25 and 49 mean that most errands require a car, indicating a Car-Dependent area. Finally, scores ranging from 0 to 24 signify that almost all errands necessitate a car, also classifying the area as Car-Dependent.

2.3. Data Analysis

Microsoft Excel software was used to enter and organise all data collected by SWAN and other tools. The process of coding/scoring responses based on the codebook and calculating scores for each domain were performed in the same environment (Microsoft Excel). Further analyses for IRR, tool validity, and internal consistency were performed using R programming language in RStudio (version 2023.9.1.494).
Measurement properties were assessed using the COSMIN taxonomy [35]. The reliability of the SWAN was determined by calculating inter-rater reliability (IRR) using the paired observer method. The IRR compares the objective scores of the older adults or people with disabilities and the secondary research assistant. This is calculated both in terms of the percentage agreement and Cohen’s kappa to compare the results [36]. Cohen’s kappa result was interpreted as follows: values ≤ 0 indicate no agreement, 0.01–0.20 indicate no to slight agreement, 0.21–0.40 indicate fair agreement, 0.41–0.60 indicate moderate agreement, 0.61–0.80 indicate substantial agreement, and 0.81–1.00 indicate almost perfect agreement [37].
  • The study assessed construct validity through hypotheses testing, using Pearson correlations to examine relationships between SWAN tool domains and related constructs in the Home and Community Environment (HACE) Instrument, Sidewalk Index (SI), and Walk Score. The following hypotheses were tested and we expected moderate positive correlations between SWAN domains and corresponding questions in complementary tools:
  • Sidewalk functionality in SWAN tool versus question on sidewalk evenness in SI;
  • Appearance and maintenance in SWAN tool versus question on surface condition in SI;
  • Street crossing functionality in SWAN tool versus question on intersection design in SI;
  • Pedestrian safety in SWAN tool versus question on sidewalk evenness in HACE;
  • Traffic safety in SWAN tool versus question on safety in HACE;
  • Social domain in SWAN tool versus question on places to rest in HACE;
  • Land use and supportive features in SWAN tool versus Walk Score.
To assess the internal consistency of the SWAN tool, Cronbach’s alpha is calculated. This is a statistical measure widely used in the field of psychometrics and social sciences to assess the internal consistency reliability of a set of items or questions within a questionnaire, test, or scale. It plays a crucial role in determining the extent to which these items measure a common underlying construct or dimension consistently. In essence, Cronbach’s alpha helps researchers and practitioners evaluate the reliability of a measurement instrument. Raw Cronbach’s alpha accounts for differences in item variances and is suitable for the SWAN tool’s heterogeneous domains. As a general guideline for interpreting Cronbach’s alpha, the following scale applies: values of 0.9 or higher are considered excellent; 0.8 to 0.9 are adequate; 0.7 to 0.8 are marginal; 0.6 to 0.7 are questionable; and values below 0.6 are deemed unacceptable [38]. In this analysis, missing data are addressed using pairwise deletion, allowing for the inclusion of all available cases for each item in the calculation of Cronbach’s alpha. This approach maximises the use of available data while being mindful of the potential biases introduced by missingness.

3. Results

The demographic data of the study participants are outlined in Table 1. In total, data were collected for the four groups shown below.

3.1. Inter-Rater Reliability

The IRR assessment for the SWAN tool was conducted between the secondary RA (research assistant) and the individuals with disabilities across various domains. The findings, as shown in Table 2, indicate a high level of agreement, with an overall percentage agreement of 85.22%. The Safety domain exhibits the highest agreement at 90.97%. Moderate agreement is observed in the Sidewalk Functionality and Pedestrian Safety domains, with percentages at 70.04% and 79.57%, respectively. The SWAN tool demonstrates its reliability in assessing aspects such as Land Use and Supportive Features, Appearance and Maintenance, and Social Aspects, with substantial agreement ranging from 79.79% to 81.38%. The Cohen’s Kappa coefficient ranged from 0.47 (Sidewalk Functionality) to 0.73 (Traffic Safety) across the different domains of the SWAN tool, demonstrating substantial agreement.

3.2. Construct Validity, Hypotheses, and Testing

As shown in Table 3, the Street Crossing subdomain exhibits the highest correlation with questions in the SI tool regarding intersection characteristics (0.79). The Sidewalk subdomain also shows moderate correlations (0.44) with questions in the SI tool regarding sidewalk evenness. Traffic Safety demonstrates a moderate correlation (0.29) with question regarding safe sidewalks in the HACE tool, and Pedestrian Safety is similarly correlated with questions about sidewalks in the HACE tool. The Land Use domain moderately correlates (0.28) with the Walk Score. The Social Aspects domain exhibits a moderate correlation with questions in the HACE tool concerning places to rest. Among all the correlations, the lowest is observed in the Appearance and Maintenance domain, which is weakly correlated (0.12) with questions about surface conditions in the SI tool.

3.3. Internal Consistency

As shown in Table 4, the internal consistency of the SWAN tool was assessed for each domain using the raw Cronbach’s alpha, showing varied reliability across the domains. The Functionality domain demonstrated strong internal consistency with a raw alpha of 0.87, indicating a reliable measurement of its underlying construct. The Safety domain also showed acceptable consistency with a raw alpha of 0.74, effectively capturing safety-related factors. The Land Use domain had a raw alpha of 0.69, suggesting moderate reliability. The Appearance domain exhibited lower consistency with a raw alpha of 0.55, indicating potential variability among items. The Social Aspects domain had the lowest reliability, with a raw alpha of 0.45, suggesting that its items may not cohesively measure a single construct and may need refinement.

4. Discussion

As the population continues to age and the prevalence of disability rises, mobility and social participation for these groups remain critical challenges. This study evaluated the reliability and validity of the SWAN tool, which aims to assess the impact of the built environment on the mobility and social participation of older adults and individuals with disabilities.
The SWAN tool shows a high level of IRR, with an overall agreement of 85.22% and moderate to substantial Cohen’s kappa coefficients across different domains, highlighting the tool’s reliability in this sample. Additionally, the study provides evidence of the construct validity through the hypothesis testing of the SWAN tool in terms of the correlations between its domains and well-established measures from complementary tools, such as the HACE, SI, and Walk Score. The significant correlations that are observed, particularly in areas like Street Crossings, Sidewalk Functionality, and Pedestrian Safety, confirm the SWAN tool’s ability to accurately assess neighbourhood accessibility. While the internal consistency of the SWAN tool is generally good, the Social Aspects domain may be improved (e.g., by removing or modifying existing items in that domain).
This study also has limitations that should be addressed in future research. First, while the study included participants from multiple cities in the Lower Mainland of British Columbia, the results may not be fully generalizable to other regions of Canada with different urban landscapes or infrastructure. Additionally, as this is emerging evidence on the SWAN tool’s reliability, we recommend future studies with larger sample sizes that involve a factor analysis to provide psychometrically robust results.

5. Conclusions

This study suggests that the SWAN tool is a valid and reliable measure for assessing the built environment’s impact on the mobility and social participation of older adults and individuals with disabilities. With a strong level of IRR and meaningful correlations with established measures, the SWAN tool can help identify barriers to and facilitators of neighbourhood accessibility. While the Social Aspects domain requires some adjustments to improve internal consistency, the other domains demonstrate good internal consistency.
The inclusion of individuals with mobility, hearing, and cognitive disabilities in this study broadens the scope of the SWAN tool, enabling a more comprehensive assessment of the built environment’s impact. By incorporating diverse disability experiences, this research emphasises the need for an inclusive design that caters to a range of mobility challenges, from physical barriers like uneven sidewalks to sensory limitations such as difficulty hearing traffic signals. The CBPR approach employed in this study further enhances the validity of the tool by ensuring that it reflects the real-world experiences of people with disabilities, thereby promoting the design of more inclusive environments.
This study has several limitations that should be addressed in future research. First, though the participants were recruited from multiple cities in the Lower Mainland of British Columbia, the findings may not be fully generalizable to other regions of Canada with different urban landscapes or infrastructure. Additionally, as this is emerging evidence on the reliability of the SWAN tool, we recommend future studies involve larger sample sizes and incorporate a factor analysis to provide more robust psychometric results.
Another limitation is the relatively small number of participants, underscoring the need for future research with a larger and more diverse sample. Given demographic trends in Canada, such as its aging population and the increasing prevalence of disabilities, the SWAN tool holds potential as a valuable resource for promoting more inclusive and liveable communities. By addressing environmental barriers, the tool could contribute to improving the quality of life of vulnerable populations and support more equitable urban planning and policy making.

Author Contributions

R.N. contributed to the manuscript, collected data, analysed data, contributed to the interpretation of results, and wrote the manuscript. A.M. contributed to the study design and critically revised the manuscript for important intellectual content. W.B.M. contributed to the interpretation of results and critically revised the manuscript. All authors agree to be accountable for all aspects of the work, ensuring the accuracy and integrity of the research presented. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Social Sciences and Humanities Research Council of Canada through a Partnership Grant. Project Title: Towards Barrier-Free Communities: A Partnership for Improving Mobility, Access and Participation (MAP) Among People with Disabilities. SSHRC Partnership Grant, file number 895-2020-1001.

Institutional Review Board Statement

This study has been reviewed and approved by Simon Fraser University’s and the University of British Columbia’s ethics boards (H21-01234) on 25 August 2021.

Informed Consent Statement

Informed consent was obtained from all participants involved in the study. Written informed consent has been obtained from the participants to publish this paper. To protect the participants’ identities, their names and any other information that might identify the participants were removed from the transcriptions and field notes.

Data Availability Statement

The data presented in this study are available on request from the corresponding author due to privacy reasons.

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Tremblay, M.-C.; Martin, D.H.; McComber, A.M.; McGregor, A.; Macaulay, A.C. Understanding Community-Based Participatory Research through a Social Movement Framework: A Case Study of the Kahnawake Schools Diabetes Prevention Project. BMC Public Health 2018, 18, 487. [Google Scholar] [CrossRef] [PubMed]
  2. Government of Canada, Statistics Canada. New Data on Disability in Canada, 2022. Available online: https://www150.statcan.gc.ca/n1/pub/11-627-m/11-627-m2023063-eng.htm (accessed on 2 March 2024).
  3. Bigonnesse, C.; Mahmood, A.; Chaudhury, H.; Mortenson, W.B.; Miller, W.C.; Martin Ginis, K.A. The Role of Neighborhood Physical Environment on Mobility and Social Participation among People Using Mobility Assistive Technology. Disabil. Soc. 2018, 33, 866–893. [Google Scholar] [CrossRef]
  4. Kapsalis, E.; Jaeger, N.; Hale, J. Disabled-by-Design: Effects of Inaccessible Urban Public Spaces on Users of Mobility Assistive Devices—A Systematic Review. Disabil. Rehabil. Assist. Technol. 2022, 19, 604–622. [Google Scholar] [CrossRef]
  5. Prescott, M.; Labbé, D.; Miller, W.C.; Borisoff, J.; Feick, R.; Mortenson, W.B. Factors That Affect the Ability of People with Disabilities to Walk or Wheel to Destinations in Their Community: A Scoping Review. Transp. Rev. 2020, 40, 646–669. [Google Scholar] [CrossRef]
  6. Rosso, A.L.; Auchincloss, A.H.; Michael, Y.L. The Urban Built Environment and Mobility in Older Adults: A Comprehensive Review. J. Aging Res. 2011, 2011, 816106. [Google Scholar] [CrossRef]
  7. Seetharaman, K.; Mahmood, A.; Rikhtehgaran, F.; Akbarnejad, G.; Chishtie, F.; Prescott, M.; Chung, A.; Mortenson, W.B. Influence of the Built Environment on Community Mobility of People Living with Visual Disabilities: A Scoping Review. Urban Plan. Transp. Res. 2024, 12, 2296891. [Google Scholar] [CrossRef]
  8. Ham, J.; Towle, A.; Shyng, G. Deaf and Hard of Hearing Awareness Training: A Mentor-Led Workshop. Clin. Teach. 2021, 18, 180–185. [Google Scholar] [CrossRef] [PubMed]
  9. Marquardt, G. Wayfinding for People With Dementia: A Review of the Role of Architectural Design. HERD 2011, 4, 75–90. [Google Scholar] [CrossRef] [PubMed]
  10. International Classification of Functioning, Disability and Health (ICF). Available online: https://www.who.int/standards/classifications/international-classification-of-functioning-disability-and-health (accessed on 3 August 2024).
  11. Brownson, R.C.; Hoehner, C.M.; Day, K.; Forsyth, A.; Sallis, J.F. Measuring the Built Environment for Physical Activity. Am. J. Prev. Med. 2009, 36, S99–S123.e12. [Google Scholar] [CrossRef]
  12. Sullivan, G.M. A Primer on the Validity of Assessment Instruments. J. Grad Med. Educ. 2011, 3, 119–120. [Google Scholar] [CrossRef]
  13. Sallis, J.F.; Slymen, D.J.; Conway, T.L.; Frank, L.D.; Saelens, B.E.; Cain, K.; Chapman, J.E. Income Disparities in Perceived Neighborhood Built and Social Environment Attributes. Health Place 2011, 17, 1274–1283. [Google Scholar] [CrossRef]
  14. Cain, K.L.; Millstein, R.A.; Sallis, J.F.; Conway, T.L.; Gavand, K.A.; Frank, L.D.; Saelens, B.E.; Geremia, C.M.; Chapman, J.; Adams, M.A.; et al. Contribution of Streetscape Audits to Explanation of Physical Activity in Four Age Groups Based on the Microscale Audit of Pedestrian Streetscapes (MAPS). Soc. Sci. Med. 2014, 116, 82–92. [Google Scholar] [CrossRef] [PubMed]
  15. Gibson, B.E. Parallels and Problems of Normalization in Rehabilitation and Universal Design: Enabling Connectivities. Disabil. Rehabil. 2014, 36, 1328–1333. [Google Scholar] [CrossRef]
  16. Moudon, A.V.; Lee, C. Walking and Bicycling: An Evaluation of Environmental Audit Instruments. Am. J. Health Promot. 2003, 18, 21–37. [Google Scholar] [CrossRef] [PubMed]
  17. Saelens, B.E.; Sallis, J.F.; Black, J.B.; Chen, D. Neighborhood-Based Differences in Physical Activity: An Environment Scale Evaluation. Am. J. Public Health 2003, 93, 1552–1558. [Google Scholar] [CrossRef] [PubMed]
  18. Millstein, R.A.; Cain, K.L.; Sallis, J.F.; Conway, T.L.; Geremia, C.; Frank, L.D.; Chapman, J.; Van Dyck, D.; Dipzinski, L.R.; Kerr, J.; et al. Development, Scoring, and Reliability of the Microscale Audit of Pedestrian Streetscapes (MAPS). BMC Public Health 2013, 13, 403. [Google Scholar] [CrossRef]
  19. Ewing, R.; Handy, S.; Brownson, R.C.; Clemente, O.; Winston, E. Identifying and Measuring Urban Design Qualities Related to Walkability. J. Phys. Act. Health 2006, 3, S223–S240. [Google Scholar] [CrossRef]
  20. Lovasi, G.S.; Neckerman, K.M.; Quinn, J.W.; Weiss, C.C.; Rundle, A. Effect of Individual or Neighborhood Disadvantage on the Association Between Neighborhood Walkability and Body Mass Index. Am. J. Public Health 2009, 99, 279–284. [Google Scholar] [CrossRef]
  21. Karros, D.J. Statistical Methodology: II. Reliability and Validity Assessment in Study Design, Part B. Acad. Emerg. Med. 1997, 4, 144–147. [Google Scholar] [CrossRef]
  22. Messick, S. Test Validity: A Matter of Consequence. Soc. Indic. Res. 1998, 45, 35–44. [Google Scholar] [CrossRef]
  23. De Barros Ahrens, R.; Da Silva Lirani, L.; De Francisco, A.C. Construct Validity and Reliability of the Work Environment Assessment Instrument WE-10. Int. J. Environ. Res. Public Health 2020, 17, 7364. [Google Scholar] [CrossRef] [PubMed]
  24. Ben-Joseph, E.; Lee, J.S.; Cromley, E.K.; Laden, F.; Troped, P.J. Virtual and Actual: Relative Accuracy of On-Site and Web-Based Instruments in Auditing the Environment for Physical Activity. Health Place 2013, 19, 138–150. [Google Scholar] [CrossRef]
  25. Mahmood, A.; O’Dea, E.; Bigonnesse, C.; Labbe, D.; Mahal, T.; Qureshi, M.; Mortenson, W.B. Stakeholders Walkability/Wheelability Audit in Neighbourhoods (SWAN): User-Led Audit and Photographic Documentation in Canada. Disabil. Soc. 2020, 35, 902–925. [Google Scholar] [CrossRef]
  26. Mahmood, A.; Rikhtehgaran, F.; Nasiri, R.; Hedayati, N.; Pandsheno, S.; Sharrock, A.; Mora, D.; Hosseini, S.; Routhier, F.; Mortenson, W. The Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods (SWAN): Protocol for a Mixed Methods Study. JMIR Res. Protoc. 2025, 14, e60553. [Google Scholar] [CrossRef]
  27. Tremblay, M.; Kingsley, B.; Gokiert, R. Engaging Vulnerable Youth in Community/Based Participatory Research: Opportunities and Challenges. J. Community Engagem. High. Educ. 2018, 10, 5. [Google Scholar]
  28. Mahmood, A.; Labbé, D. ‘An Accessible Route Is Always the Longest’: Older Adults’ Experience of Their Urban Environment Captured by User-Led Audits and Photovoice. In Aging People, Aging Places; Policy Press: Bristol, UK, 2021; pp. 27–44. [Google Scholar]
  29. Cain, K.L.; Millstein, R.A.; Geremia, C.M. Microscale Audit of Pedestrian Streetscapes (MAPS): Data Collection & Scoring Manual; University California San Diego: San Diego, CA, USA, 2012; Available online: http://sallis.ucsd.edu/Documents/Measures_documents/MAPS%20Manual_v1_010713.pdf (accessed on 8 August 2013).
  30. Sallis, J.F.; Cain, K.L.; Conway, T.L.; Gavand, K.A.; Millstein, R.A.; Geremia, C.M.; Frank, L.D.; Saelens, B.E.; Glanz, K.; King, A.C. Is Your Neighborhood Designed to Support Physical Activity? A Brief Streetscape Audit Tool. Prev. Chronic Dis. 2015, 12, e141. [Google Scholar] [CrossRef]
  31. Glanz, K.; Handy, S.L.; Henderson, K.E.; Slater, S.J.; Davis, E.L.; Powell, L.M. Built Environment Assessment: Multidisciplinary Perspectives. SSM Popul. Health 2016, 2, 24–31. [Google Scholar] [CrossRef] [PubMed]
  32. Hess, P.M.; Farrow, J.; Walk, J. Walkability in Toronto’s High-Rise Neighbourhoods: 2011 Final Report; Canadian Electronic Library: Ottawa, ON, Canada, 2011. [Google Scholar]
  33. Keysor, J.; Jette, A.; Haley, S. Development of the Home and Community Environment (HACE) Instrument. J. Rehabil. Med. 2005, 37, 37–44. [Google Scholar] [CrossRef]
  34. Ferreira, M.; Sanches, S. Proposal of a Sidewalk Accessibility Index. J. Urban Environ. Eng. 2007, 1, 1–9. [Google Scholar] [CrossRef]
  35. Mokkink, L.B.; Terwee, C.B.; Patrick, D.L.; Alonso, J.; Stratford, P.W.; Knol, D.L.; Bouter, L.M.; de Vet, H.C.W. The COSMIN Study Reached International Consensus on Taxonomy, Terminology, and Definitions of Measurement Properties for Health-Related Patient-Reported Outcomes. J. Clin. Epidemiol. 2010, 63, 737–745. [Google Scholar] [CrossRef]
  36. McHugh, M.L. Interrater Reliability: The Kappa Statistic. Biochem. Med. 2012, 22, 276–282. [Google Scholar] [CrossRef]
  37. Cohen, J. A Coefficient of Agreement for Nominal Scales. Educ. Psychol. Meas. 1960, 20, 37–46. [Google Scholar] [CrossRef]
  38. Flo, J.; Landmark, B.; Hatlevik, O.E.; Fagerström, L. Using a new interrater reliability method to test the modified Oulu Patient Classification instrument in home health care. Nurs. Open 2018, 5, 167–175. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
Table 1. Sample demographic data.
Table 1. Sample demographic data.
StreamNo. of ParticipantsAge (Mean)Gender Distribution (%)
People using mobility assistive devices2451Female (42%)
People who are deaf or hard of hearing1041Female (40%)
People living with cognitive impairment1070Female (30%)
Older adults aged 60+1065Female (80%)
Table 2. The inter-rater reliability (IRR) result.
Table 2. The inter-rater reliability (IRR) result.
Domain/Subdomain% AgreementK
1. Functionality84.580.69
1-1. Crossing Functionality84.580.69
1-1-1. Crossing C Functionality84.580.69
1-1-2. Crossing D Functionality83.480.67
1-2. Sidewalk Functionality70.040.47
2. Safety90.970.73
2-1. Traffic Safety90.970.73
2-2. Pedestrian Safety79.570.59
3. Land Use and Supportive Features81.380.61
4. Appearance and Maintenance79.790.66
5. Social Aspects80.640.64
Total85.220.67
Table 3. Construct validity, hypotheses, and testing results.
Table 3. Construct validity, hypotheses, and testing results.
SWAN DomainComparator MeasureCorrelation (r)
(95% CI)
Interpretation
Sidewalk FunctionalitySI (Sidewalk Evenness)0.44
(0.27, 0.58)
Moderate
Street Crossing FunctionalitySI (Intersection Design)0.79
(0.71, 0.85)
Strong
Appearance and MaintenanceSI (Surface Condition)0.12
(−0.07, 0.30)
Weak
Pedestrian SafetyHACE (Unevenness)0.31
(0.04, 0.53)
Moderate
Traffic SafetyHACE (Safety)0.29
(0.02, 0.52)
Moderate
Social AspectsHACE (Places to Rest)0.30
(0.03, 0.53)
Moderate
Land Use and Supportive FeaturesWalk Score0.28
(0.01, 0.51)
Moderate
Table 4. Internal consistency results.
Table 4. Internal consistency results.
DomainRaw Alpha
1. Functionality0.87
1.1. Street Crossing Functionality0.87
1.2. Sidewalk Functionality0.80
2. Safety0.74
2.1. Traffic Safety0.81
2.2. Pedestrian Safety0.54
3. Land Use and Supportive Features0.69
4. Appearance and Maintenance0.55
5. Social Aspects0.45
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Nasiri, R.; Mahmood, A.; Mortenson, W.B. Enhancing Urban Accessibility: Reliability and Validity Assessment of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool. Disabilities 2025, 5, 42. https://doi.org/10.3390/disabilities5020042

AMA Style

Nasiri R, Mahmood A, Mortenson WB. Enhancing Urban Accessibility: Reliability and Validity Assessment of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool. Disabilities. 2025; 5(2):42. https://doi.org/10.3390/disabilities5020042

Chicago/Turabian Style

Nasiri, Rojan, Atiya Mahmood, and W. Ben Mortenson. 2025. "Enhancing Urban Accessibility: Reliability and Validity Assessment of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool" Disabilities 5, no. 2: 42. https://doi.org/10.3390/disabilities5020042

APA Style

Nasiri, R., Mahmood, A., & Mortenson, W. B. (2025). Enhancing Urban Accessibility: Reliability and Validity Assessment of the Stakeholders’ Walkability/Wheelability Audit in Neighbourhoods Tool. Disabilities, 5(2), 42. https://doi.org/10.3390/disabilities5020042

Article Metrics

Back to TopTop