Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

remove_circle_outline

Article Types

Countries / Regions

remove_circle_outline

Search Results (1)

Search Parameters:
Keywords = KoAlpaca

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
20 pages, 6641 KB  
Article
Multi-Modal System for Walking Safety for the Visually Impaired: Multi-Object Detection and Natural Language Generation
by Jekyung Lee, Kyung-Ae Cha and Miran Lee
Appl. Sci. 2024, 14(17), 7643; https://doi.org/10.3390/app14177643 - 29 Aug 2024
Cited by 2 | Viewed by 2404
Abstract
This study introduces a system for visually impaired individuals in a walking environment. It combines object recognition using YOLOv5 and cautionary sentence generation with KoAlpaca. The system employs image data augmentation for diverse training data and GPT for natural language training. Furthermore, the [...] Read more.
This study introduces a system for visually impaired individuals in a walking environment. It combines object recognition using YOLOv5 and cautionary sentence generation with KoAlpaca. The system employs image data augmentation for diverse training data and GPT for natural language training. Furthermore, the implementation of the system on a single board was followed by a comprehensive comparative analysis with existing studies. Moreover, a pilot test involving visually impaired and healthy individuals was conducted to validate the system’s practical applicability and adaptability in real-world walking environments. Our pilot test results indicated an average usability score of 4.05. Participants expressed some dissatisfaction with the notification conveying time and online implementation, but they highly praised the system’s object detection range and accuracy. The experiments demonstrated that using QLoRA enables more efficient training of larger models, which is associated with improved model performance. Our study makes a significant contribution to the literature because the proposed system enables real-time monitoring of various environmental conditions and objects in pedestrian environments using AI. Full article
(This article belongs to the Section Biomedical Engineering)
Show Figures

Figure 1

Back to TopTop