Interaction with Tactile Paving in a Virtual Reality Environment: Simulation of an Urban Environment for People with Visual Impairments
Abstract
1. Introduction
- Independence (daily activities, mobility, use of public transportation);
- Self-confidence (reduced self-esteem, decreased confidence in their abilities);
- Emotional impact (influence on social relationships, isolation, social prejudice and stereotypes, social activity, grouping).
- Outdoor navigation (safety while moving, risk of traffic accidents, navigating routes without assistance);
- Public transportation usage (inability to orient themselves at stations, difficulty accessing vehicles);
- Sensory-guided routes (tactile paving and other guidance technologies, use of tools such as GPS and navigation devices);
- Indoor orientation (difficulty navigating enclosed environments, need for voice guidance systems).
2. Related Work
3. Materials and Methods
3.1. Short Description
3.2. Software and Device
3.3. Experimental Design
3.4. Experimental Conditions
4. Results
4.1. Analysis of the Experimental Procedure Results
- A: normalized recognition rate, with values ranging between [0,1];
- T1: total interaction time in Scenario 1;
- T1min: shortest interaction time among all participants;
- b: weighting factor (we set b = 1).
- C2: task completion status, with values of 1 for completion and 0 for non-completion;
- T2: total interaction time in Scenario 2;
- T2min: fastest interaction time among participants who completed the task.
- C3: task completion status, with values 1 for completion and 0 for non-completion;
- T3: total interaction time in Scenario 3;
- T3min: fastest interaction time among participants who completed the task.
4.1.1. Scenario Comparison
4.1.2. User Performance Analysis
- High ability: User_AS_mean ≥ 0.75;
- Moderate ability: 0.50 ≤ User_AS_mean < 0.75;
- Low ability: User_AS_mean < 0.50.
4.2. Analysis of the Results of the Evaluation Questionnaire
5. Discussion
6. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Acknowledgments
Conflicts of Interest
Appendix A
Appendix A.1. USE Questionnaire
USE Sections | Question | Likert Scale (1–5) | |
Usefulness | Does it help me to be more effective? | 1 (Strongly Disagree) | 5 (Strongly Agree) |
It is useful? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Does it give me more control over the activities in my life? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Ease of Use | It is easy to use? | 1 (Strongly Disagree) | 5 (Strongly Agree) |
It is user-friendly? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Can I recover from mistakes quickly and easily? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Ease of Learning | Did I learn to use it quickly? | 1 (Strongly Disagree) | 5 (Strongly Agree) |
Can I easily remember how to use it? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Is it easy to learn to use it? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
Satisfaction | Do I feel I need to have it? | 1 (Strongly Disagree) | 5 (Strongly Agree) |
Would I recommend it to a friend? | 1 (Strongly Disagree) | 5 (Strongly Agree) | |
It is fun to use? | 1 (Strongly Disagree) | 5 (Strongly Agree) |
Appendix A.2. UEQ (Short Version)
UEQ Option A | Likert Scale (1 to 7) | UEQ Option B |
Obstructive | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Supportive |
Complicated | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Easy |
Inefficient | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Efficient |
Clear | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Confusing |
Boring | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Exciting |
Not interesting | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Interesting |
Conventional | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Inventive |
Usual | ◦ 1 ◦ 2 ◦ 3 ◦ 4 ◦ 5 ◦ 6 ◦ 7 | Leading edge |
References
- World Health Organization. Available online: https://www.who.int/ (accessed on 30 April 2025).
- Ricci, F.S.; Boldini, A.; Beheshti, M.; Rizzo, J.R.; Porfiri, M. A virtual reality platform to simulate orientation and mobility training for the visually impaired. Virtual Real. 2022, 27, 797–814. [Google Scholar] [CrossRef]
- Bonsaksen, T.; Brunes, A.; Heir, T. Quality of life in people with visual impairment compared with the general population. J. Public Health 2025, 33, 23–31. [Google Scholar] [CrossRef]
- Kim, H.-m.; Son, S.-m. Impacts of Daily Life and Job Satisfaction on Social Participation of Persons with Visual Impairment; Wiley: Hoboken, NJ, USA, 2023. [Google Scholar] [CrossRef]
- Liu, H.; Darabi, H.; Banerjee, P.; Liu, J. Survey of Wireless Indoor Positioning Techniques and Systems. IEEE Trans. Syst. Man Cybern. C 2007, 37, 1067–1080. [Google Scholar] [CrossRef]
- Rosa, M.P.; De Mello, G.S.; Morato, S. Tactile Paving Surfaces at Bus Stop. The needof Homogeneous Technical Solutions for Accessible Tourism. J. Access. Des. All 2021, 11, 259–294. [Google Scholar] [CrossRef]
- Yeo, M.S.K.; Pey, J.J.J.; Elara, M.R. Passive Auto-Tactile Heuristic (PATH) Tiles: Novel Robot-Inclusive Tactile Paving Hazard Alert System. Buildings 2023, 13, 2504. [Google Scholar] [CrossRef]
- Muhammad, J.; Aftab, M.J.; Bano, S.; Iram, U. Challenges encountered by Students with Visual Impairment in Accessing Orientation and Mobility Training Corresponding Author. Ann. Hum. Soc. Sci. 2024, 5, 514–523. [Google Scholar] [CrossRef]
- Emerson, R.W.; McCarthy, T. Orientation and Mobility for Students with Visual Impairments:Priorities for Research" International Review of Research in Mental Retardation. Int. Rev. Res. Ment. Retard. 2014, 46, 253–280. [Google Scholar] [CrossRef]
- Lo Valvo, A.; Croce, D.; Garlisi, D.; Giuliano, F.; Giarré, L.; Tinnirello, I. A Navigation and Augmented Reality System for Visually Impaired People. Sensors 2021, 21, 3061. [Google Scholar] [CrossRef]
- Navarro-Guerrero, N.; Toprak, S.; Josifovski, J.; Jamone, L. Visuo-haptic object perception for robots: An overview. Auton. Robots 2023, 47, 377–403. [Google Scholar] [CrossRef]
- Hu, Z.; Lin, L.; Lin, W.; Xu, Y.; Xia, X.; Peng, Z.; Sun, Z.; Wang, Z. Machine Learning for Tactile Perception: Advancements, Challenges, and Opportunities. Adv. Intell. Syst. 2023, 5, 2200371. [Google Scholar] [CrossRef]
- Croce, D.; Giarre, L.; La Rosa, F.G.; Montana, E.; Tinnirello, I. Enhancing tracking performance in a smartphone-based navigation system for visually impaired people. In Proceedings of the 24th Mediterranean Conference on Control and Automation (MED), Athens, Greece, 21–24 June 2016. [Google Scholar] [CrossRef]
- Weiss, M.; Chamorro, S.; Girgis, R.; Luck, M.; Kahou, S.E.; Cohen, J.P.; Nowrouzezahrai, D.; Precup, D.; Golemo, F.; Pal, C. Navigation Agents for the Visually Impaired: A Sidewalk Simulator and Experiments. In Proceedings of the Conference on Robot Learning (CoRL), Osaka, Japan, 30 October–1 November 2019; pp. 1314–1327. [Google Scholar] [CrossRef]
- Wang, M.; Dommes, A.; Renaudin, V.; Zhu, N. Analysis of Spatial Landmarks for Seamless Urban Navigation of Visually Impaired People. IEEE J. Indoor Seamless Position. Navig. 2023, 1, 93–103. [Google Scholar] [CrossRef]
- Tzimos, N.; Voutsakelis, G.; Kontogiannis, S.; Kokkonis, G. Evaluation of Haptic Textures for Tangible Interfaces for the Tactile Internet. Electronics 2024, 13, 3775. [Google Scholar] [CrossRef]
- Todd, C.; Mallya, S.; Majeed, S.; Rojas, J.; Naylor, K. Haptic-Audio Simulator for Visually Impaired Indoor Exploration. J. Assist. Technol. 2015, 9, 71–85. [Google Scholar] [CrossRef]
- Todd, C.; Mallya, S.; Majeed, S.; Rojas, J.; Naylor, K. VirtuNav: A Virtual Reality Indoor Navigation Simulator with Haptic and Audio Feedback for the Visually Impaired. In Proceedings of the IEEE Symposium on Computational Intelligence in Robotic Rehabilitation and Assistive Technologies (CIR2AT), Orlando, FL, USA, 9–12 December 2014; pp. 1–8. [Google Scholar] [CrossRef]
- Costa, S.M.; Damaceno, R.J.P.; Morimitsu, H.; Cesar, R.M., Jr. Tactile Path Guidance via Weakly Supervised Visual Attention. In Proceedings of the 4th Annual Workshop on the Future of Urban Accessibility (Urban Access), Online, 24 October 2024. [Google Scholar]
- Xu, S.; Yang, C.; Ge, W.; Yu, C.; Shi, Y. Virtual Paving: Rendering a Smooth Path for People with Visual Impairment through Vibrotactile and Audio Feedback. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 2020, 4, 1–25. [Google Scholar] [CrossRef]
- Lahav, O.; Schloerb, D.; Kumar, S.; Srinivasan, M. Virtual Environment for People Who Are Blind—A Usability Study. J. Assist. Technol. 2012, 6, 38–52. [Google Scholar] [CrossRef] [PubMed]
- Lahav, O.; Schloerb, D.; Kumar, S.; Srinivasan, M. A virtual map to support people who are blind to navigate through real spaces. J. Spec. Educ. 2011, 26, 41–56. [Google Scholar] [CrossRef]
- Kreimeier, J.; Götzelmann, T. Real World VR Proxies to Support Blind People in Mobility Training. In Proceedings of the Mensch und Computer 2018, Dresden, Germany, 2–5 September 2018. [Google Scholar] [CrossRef]
- Zhao, Y.; Bennett, C.L.; Benko, H.; Cutrell, E.; Holz, C.; Morris, M.R.; Sinclair, M. Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proceedings of the CHI 2018—Conference on Human Factors in Computing Systems, Montréal, QC, Canada, 21–26 April 2018; pp. 1–14. [Google Scholar] [CrossRef]
- Greek Government (Ministry of Environment and Energy). Gazette of the Government of the Hellenic Republic; Greek Government (Ministry of Environment and Energy): Athens, Greece, 2022; Volume 7. [Google Scholar]
- Dickson, P.E.; Block, J.E.; Echevarria, G.N.; Keenan, K.C. An Experience-based Comparison of Unity and Unreal for a Stand-alone 3D Game Development Course. In Proceedings of the International Conference on Innovation and Technology in Computer Science Education (ITiCSE), Bologna, Italy, 3–5 July 2017. [Google Scholar] [CrossRef]
- Hussain, A.; Shakeel, H.; Hussain, F.; Uddin, N.; Ghouri, T.L. Unity Game Development Engine: A Technical Survey. Univ. Sindh J. Inf. Commun. Technol. 2020, 4, 73–81. [Google Scholar]
- Silva, A.; Domínguez Ramírez, O.A.; Vega, V.P.; Ordaz Oliver, J.P. PHANToM OMNI Haptic Device: Kinematic and Manipulability. In Proceedings of the Electronics, Robotics and Automotive Mechanics Conference (CERMA), Cuernavaca, Mexico, 22–25 September 2009; pp. 193–198. [Google Scholar] [CrossRef]
- Teklemariam, H.G.; Das, A.K. A Case Study of PHANToM OMNI Force Feedback Device for Virtual Product Design. Int. J. Interact. Des. Manuf. 2015, 9, 881–892. [Google Scholar] [CrossRef]
- San Martín, J.; Trivino, G. A Study of the Manipulability of the PHANToM OMNI Haptic Interface. In Proceedings of the Third Workshop on Virtual Reality Interactions and Physical Simulations (VRIPHYS), Madrid, Spain, 6–7 November 2006; pp. 127–128. [Google Scholar] [CrossRef]
- Isaksson, M.; Horan, B.; Nahavandi, S. Low-Cost 5-DOF Haptic Stylus Interaction Using Two Phantom Omni Devices. In Proceedings of the EuroHaptics (International Conference on Haptics: Neuroscience, Devices, Modeling, and Applications), Tampere, Finland, 13–15 June 2012; pp. 139–149. [Google Scholar] [CrossRef]
- 3D Systems Haptic Devices. Available online: https://www.3dsystems.com/haptics-devices/touch (accessed on 30 April 2025).
- Hu, S.; Ma, Y.; Dong, X.; Zhang, W. Evaluating the Effectiveness of Street-Crossing Tactile Paving for People with Visual Impairment Using a Structural Equation Model. In Proceedings of the 20th COTA International Conference of Transportation Professionals (CICTP 2020), Xi’an, China, 14–16 August 2020. [Google Scholar] [CrossRef]
- Guerra, A. Craft-Based Methodologies in Human–Computer Interaction: Exploring Interdisciplinary Design Approaches. Multimodal Technol. Interact. 2025, 9, 13. [Google Scholar] [CrossRef]
- 3DSystems. Available online: https://www.3dsystems.com/ (accessed on 30 April 2025).
- Alzalabny, S.; Moured, O.; Müller, K.; Schwarz, T.; Rapp, B. Designing a Tactile Document UI for 2D Refreshable Tactile Displays: Towards Accessible Document Layouts for Blind People. Multimodal Technol. Interact. 2024, 8, 102. [Google Scholar] [CrossRef]
- Dritsas, E.; Trigka, M.; Troussas, C.; Mylonas, P. Multimodal Interaction, Interfaces, and Communication: A Survey. Multimodal Technol. Interact. 2025, 9, 6. [Google Scholar] [CrossRef]
- Alary, F.; Duquette, M.; Goldstein, R.; Chapman, C.E.; Voss, P.; La Buissonnière-Ariza, V.; Lepore, F. Tactile acuity in the blind: A closer look reveals superiority over the sighted in some but not all cutaneous tasks. Neuropsychologia 2009, 47, 2037–2043. [Google Scholar] [CrossRef] [PubMed]
- Goldreich, D.; Kanics, I.M. Tactile Acuity is Enhanced in Blindness. J. Neurosci. 2003, 23, 3439–3445. [Google Scholar] [CrossRef]
- Heuten, W.; Henze, N.; Boll, S.; Pielot, M. Tactile Wayfinder: A Non-Visual Support System for Wayfinding. In Proceedings of the 5th Nordic Conference on Human–Computer Interaction (NordiCHI 2008), Lund, Sweden, 20–22 October 2008. [Google Scholar] [CrossRef]
- Lund, A.M. Measuring Usability with the USE Questionnaire. Usability Interface 2001, 8, 3–6. Available online: https://garyperlman.com/quest/quest.cgi?form=USE (accessed on 29 June 2025).
- Laugwitz, B.; Held, T.; Schrepp, M. Construction and Evaluation of a User Experience Questionnaire. In HCI and Usability for Education and Work, Proceedings of the 4th Symposium of the Workgroup Human-Computer Interaction and Usability Engineering of the Austrian Computer Society, USAB 2008, Graz, Austria, 20–21 November 2008; Springer: Berlin/Heidelberg, Germany, 2008; pp. 63–76. [Google Scholar] [CrossRef]
- Yokoyama, N.; Ha, S.; Batra, D. Success Weighted by Completion Time: A Dynamics-Aware Evaluation Criteria for Embodied Navigation. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic, 27 September–1 October 2021; pp. 1562–1569. [Google Scholar] [CrossRef]
- Mann, H.B.; Whitney, D.R. On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 1947, 18, 50–60. [Google Scholar] [CrossRef]
- MacFarland, T.W.; Yates, J.M. Introduction to Nonparametric Statistics for the Biological Sciences Using R; Springer: Cham, Switzerland, 2016; ISBN 978-3-319-30633-9. [Google Scholar] [CrossRef]
- Nachar, N. The Mann-Whitney U: A Test for Assessing Whether Two Independent Samples Come from the Same Distribution. Tutor. Quant. Methods Psychol. 2008, 4, 13–20. [Google Scholar] [CrossRef]
Type | Function | Description | Place |
---|---|---|---|
A1(40 × 40) | Directional (parallel to the axis of movement) | Wide and thin stripes | Guide people with visual impairments on their way |
A2(40 × 40) | Imminent turn (perpendicular to the axis of movement) | Turn warning | At the points of vertical course change |
B(40 × 40) | Warning (arranged in a square canvas with an arrangement diagonal to the movement) | Scalloped with strong scales | At the beginning and end of inclined planes, at all door levels, along all landings |
C(40 × 40) | Direction change (arranged in a square canvas with an arrangement parallel to the movement) | Scalloped with denser and less pronounced scales | Points of change in direction of type A plates |
D(40 × 40) | Service (parallel to the axis of movement) | Narrow and dense stripes | Public transport stops, telephone booths, special tactile signs for people with visual disabilities, etc. |
Haptic Parameters | Tile Preset 1 | Tile Preset 2 | Tile Preset 3 |
---|---|---|---|
Tile Stiffness | 1 | 1 | 1 |
Damping | 1 | 1 | 1 |
Static Friction | 0.25 | 0.5 | 0.75 |
Dynamic Friction | 0.25 | 0.5 | 0.75 |
Collider Preset | Collider Preset 1 | Collider Preset 2 | Collider Preset 3 |
---|---|---|---|
Size | Small | Medium | Big |
Age | Number of Participants | Average Price |
---|---|---|
18–25 | 3 | (18 + 25)/2 = 21.5 |
26–35 | 3 | (26 + 35)/2 = 30.5 |
36–45 | 10 | (36 + 45)/2 = 40.5 |
46+ | 3 | 50 (an estimate) |
Scenario | Average All/Blind/Not Blind | Standard Deviation All/Blind/Not Blind | Minimum All/Blind/Not Blind | Maximum All/Blind/Not Blind |
---|---|---|---|---|
AS1 | 0.32/0.25/0.34 | 0.18/0.03/0.20 | 0.08/0.20/0.08 | 0.65/0.29/0.65 |
AS2 | 0.47/0.52/0.44 | 0.26/0.14/0.30 | 0/0.29/0 | 1/0.70/1 |
AS3 | 0.63/0.68/0.30 | 0.22/0.31/0.16 | 0/0/0 | 1/1/0.56 |
U Statistic | p-Value | Effect Size (r) | Comments | |
---|---|---|---|---|
AS1 | 37.0 | 0.898 | 0.04 | No statistically significant difference |
AS2 | 44.0 | 0.693 | 0.10 | No statistically significant difference |
AS3 | 40.0 | 0.965 | 0.02 | No statistically significant difference |
Usability Evaluation | Percentage |
---|---|
Usefulness | 88.8% |
Ease of Use | 85.6% |
Ease of Learning | 86% |
Satisfaction | 90.5% |
Question | Percentage |
---|---|
Supportive | 88.7% |
Easy | 84.2% |
Efficient | 85.7% |
Clear | 83.5% |
Exciting | 86.5% |
Interesting | 94% |
Inventive | 91.7% |
Leading edge | 92.5% |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Tzimos, N.; Kyriazidis, I.; Voutsakelis, G.; Kontogiannis, S.; Kokkonis, G. Interaction with Tactile Paving in a Virtual Reality Environment: Simulation of an Urban Environment for People with Visual Impairments. Multimodal Technol. Interact. 2025, 9, 71. https://doi.org/10.3390/mti9070071
Tzimos N, Kyriazidis I, Voutsakelis G, Kontogiannis S, Kokkonis G. Interaction with Tactile Paving in a Virtual Reality Environment: Simulation of an Urban Environment for People with Visual Impairments. Multimodal Technologies and Interaction. 2025; 9(7):71. https://doi.org/10.3390/mti9070071
Chicago/Turabian StyleTzimos, Nikolaos, Iordanis Kyriazidis, George Voutsakelis, Sotirios Kontogiannis, and George Kokkonis. 2025. "Interaction with Tactile Paving in a Virtual Reality Environment: Simulation of an Urban Environment for People with Visual Impairments" Multimodal Technologies and Interaction 9, no. 7: 71. https://doi.org/10.3390/mti9070071
APA StyleTzimos, N., Kyriazidis, I., Voutsakelis, G., Kontogiannis, S., & Kokkonis, G. (2025). Interaction with Tactile Paving in a Virtual Reality Environment: Simulation of an Urban Environment for People with Visual Impairments. Multimodal Technologies and Interaction, 9(7), 71. https://doi.org/10.3390/mti9070071