Skip to Content

64 Results Found

  • Article
  • Open Access
250 Views
15 Pages

DyGRAV: Dynamic Grounding and Relational Reasoning for Vision–Language Navigation

  • Zain Chaudhary,
  • Zohaib Chaudhary,
  • Hammad Ahmed,
  • Prabin Bajgai and ,
  • Rabab Abdelfattah and
  • Ahmed Sherif
  • + 1 author+ 0 author

16 October 2026

Vision–Language Navigation (VLN) requires embodied agents to interpret natural-language instructions in 3D environments. While significant progress has been made, state-of-the-art agents often struggle with instructions that demand fine-grained...

(This article belongs to the Special Issue Artificial Intelligence in Autonomous Navigation and Intelligent Unmanned Systems)
  • Article
  • Open Access
2 Citations
1,485 Views
17 Pages

12 May 2026

Visually impaired users face significant challenges in navigating complex indoor environments due to limited spatial awareness and lack of real-time semantic guidance. This paper proposes a multimodal navigation system integrating environmental perce...

(This article belongs to the Special Issue Multimodal Sensing, Fusion, and VLMs for Scene Understanding and Robot Vision)
  • Review
  • Open Access
4 Citations
4,102 Views
51 Pages

24 March 2026

The ability to autonomously navigate and explore complex 3D environments in a purposeful manner, while integrating visual perception with natural language interaction in a human-like way, represents a longstanding research objective in Artificial Int...

(This article belongs to the Special Issue Autonomous Navigation for Intelligent Robots: Perception, Planning, and Control)
  • Article
  • Open Access
891 Views
18 Pages

Knowledge Graph-Driven Reinforcement Learning for Zero-Shot Vision-Language Navigation

  • Ye Zhang,
  • Yandong Zhao,
  • He Liu,
  • Tengfei Shi and ,
  • Weitao Jia and
  • Shenghong Li
  • + 1 author+ 0 author

28 April 2026

To address the limitations of zero-shot generalization in Vision-Language Navigation (VLN), this paper proposes a novel knowledge graph-driven reinforcement learning approach. Our method constructs a hierarchical, dynamically updated knowledge graph...

(This article belongs to the Special Issue New Advances in Image Processing and Computer Vision)
  • Article
  • Open Access
5 Citations
1,194 Views
22 Pages

Vertex: A Semantic Graph-Based Indoor Navigation System with Vision-Language Landmark Verification

  • Isabel Ferri-Molla,
  • Dena Bazazian,
  • Marius N. Varga,
  • Jordi Linares-Pellicer and
  • Joan Albert Silvestre-Cerdà

24 March 2026

Older adults often need guidance when visiting new buildings for the first time. However, indoor navigation remains challenging due to the lack of Global Positioning System (GPS) availability, visually repetitive corridors, and frequent location fail...

(This article belongs to the Special Issue Sensor Technologies for Mobility in Aging: Development, Validation and Application)
  • Review
  • Open Access
1,125 Views
32 Pages

12 August 2026

Vision-and-Language Navigation (VLN) is a representative task in embodied artificial intelligence, requiring agents to perceive, understand, and make navigation decisions in partially observable environments according to natural language instructions...

(This article belongs to the Section Robotics and Automation)
  • Article
  • Open Access
1 Citations
3,518 Views
19 Pages

7 October 2023

Vision and Language Navigation (VLN) is a task in which an agent needs to understand natural language instructions to reach the target location in a real-scene environment. To improve the model ability of long-horizon planning, emerging research focu...

(This article belongs to the Special Issue Representation Learning for Computer Vision and Pattern Recognition)
  • Article
  • Open Access
1 Citations
962 Views
33 Pages

11 June 2026

City-scale unmanned aerial vehicle vision-and-language navigation (UAV-VLN) requires accurate upstream target localization from an overhead map, onboard observation, and language description. Existing VLM-based methods often treat road names, landmar...

(This article belongs to the Topic Advanced Methods in Unmanned Aerial Vehicle Control, Navigation, and Safety)
  • Article
  • Open Access
7 Citations
7,700 Views
16 Pages

9 January 2025

Traditional Vision-and-Language Navigation (VLN) tasks require an agent to navigate static environments using natural language instructions. However, real-world road conditions such as vehicle movements, traffic signal fluctuations, pedestrian activi...

(This article belongs to the Special Issue Multi-Sensor Systems for Object Tracking—2nd Edition)
  • Article
  • Open Access
846 Views
25 Pages

27 June 2026

Large vision–language models have advanced embodied navigation by integrating visual perception with natural-language reasoning. However, vision-and-language navigation (VLN) for unmanned aerial vehicles in low-altitude urban airspaces remains...

(This article belongs to the Topic Advanced Technologies and Applications for Unmanned Systems)
  • Article
  • Open Access
1 Citations
4,523 Views
22 Pages

2 February 2021

Due to the development of computer vision and natural language processing technologies in recent years, there has been a growing interest in multimodal intelligent tasks that require the ability to concurrently understand various forms of input data...

(This article belongs to the Special Issue Artificial Intelligence and Sensors)
  • Article
  • Open Access
6 Citations
4,430 Views
15 Pages

Outdoor Vision-and-Language Navigation Needs Object-Level Alignment

  • Yanjun Sun,
  • Yue Qiu,
  • Yoshimitsu Aoki and
  • Hirokatsu Kataoka

29 June 2023

In the field of embodied AI, vision-and-language navigation (VLN) is a crucial and challenging multi-modal task. Specifically, outdoor VLN involves an agent navigating within a graph-based environment, while simultaneously interpreting information fr...

(This article belongs to the Special Issue Artificial Intelligence (AI) and Machine-Learning-Based Localization)
  • Article
  • Open Access
89 Views
30 Pages

Letting the Sensor Do the Geometry: Telemetry Metric Tokenization for Aerial Vision and Language Navigation

  • Ergashevich Halimjon Khujamatov,
  • Khasanov Doston,
  • Yusupov Sarvarbek Sodikovich,
  • Oybek Usmankulovich Mallaev and ,
  • Shakhnoza Muksimova,
  • Khujamatova Shakhlo,
  • Su-Mi Shin and
  • Heung Seok Jeon
  • + 3 authors+ 0 author

17 November 2026

Vision and language navigation (VLN) for unmanned aerial vehicles (UAVs) requires an agent to follow natural language instructions while perceiving scenes whose appearance changes with flight altitude and heading. Existing methods treat these variati...

(This article belongs to the Special Issue Autonomous Sensing and Perception for UAV Systems)
  • Article
  • Open Access
2 Citations
834 Views
23 Pages

STAMP: Spatial-Temporal Anchored Motion Planning for Zero-Shot Continuous Vision-and-Language Navigation

  • Tai Liu,
  • Xiaoyan Qi,
  • Liuyi Wang,
  • Jinlong Li and ,
  • Xiao Lin,
  • Minghao Zhu,
  • Yulong Cui,
  • Chengju Liu and
  • Qijun Chen
  • + 4 authors+ 0 author

10 June 2026

Vision-and-Language Navigation in continuous environments (VLN-CE) requires embodied agents to ground natural language instructions into reliable long-horizon motion decisions under partial observability. Despite their strong semantic understanding a...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
370 Views
15 Pages

1 September 2026

Goal-oriented vision-and-language navigation (VLN) requires an agent to reach a target from a high-level instruction that does not prescribe a route. Training therefore faces two problems. First, terminal and distance-based feedback leave partial tra...

(This article belongs to the Special Issue Computer Vision and Machine Learning for Autonomous Intelligent Systems)
  • Article
  • Open Access
3 Citations
1,409 Views
26 Pages

9 December 2025

Ensuring navigational safety is one of the most critical challenges in autonomous maritime navigation research, requiring accurate real-time assessment of collision risks and prompt navigational decisions based on such assessments. Traditional rule-b...

(This article belongs to the Section Ocean Engineering)
  • Review
  • Open Access
717 Views
54 Pages

22 September 2026

Air-ground collaborative systems (AGCS), in which unmanned aerial vehicles survey from above while ground vehicles navigate the terrain below, can achieve capabilities far beyond those of any single platform when they share perception and coordinate...

  • Article
  • Open Access
2 Citations
2,126 Views
25 Pages

EXAONE-VLA: A Unified Vision–Language Framework for Mobile Manipulation via Semantic Topology and Hierarchical LLM Reasoning

  • Jeong-Seop Park,
  • Yong-Jun Lee,
  • Jong-Chan Park,
  • Sung-Gil Park and ,
  • Jong-Jin Woo and
  • Myo-Taeg Lim
  • + 1 author+ 0 author

9 March 2026

This paper proposes a unified vision–language framework that translates user instructions into navigation for the mobile base and actions for the manipulator in indoor environments. In general, occupancy grid maps constructed via SLAM capture s...

(This article belongs to the Special Issue Deep Reinforcement Learning for Multiagent Systems)
  • Article
  • Open Access
1,538 Views
37 Pages

A Hierarchical VLM-to-TD3 Framework with Novel Object Coordinate Estimation and Persistent Spatial Memory for Semantically Guided Indoor Navigation

  • Yernar Akhmetbek,
  • Ayaulym Parmash,
  • Temirlan Meiramkhanov,
  • Azamat Yesmukhametov and ,
  • Aigul Meirmanova and
  • Darkhan Zholtayev
  • + 1 author+ 0 author

23 July 2026

Autonomous semantic indoor navigation requires robust low-level control and high-level understanding of objects and spatial context in cluttered and partially occluded environments. While deep reinforcement learning (DRL) methods such as twin delayed...

(This article belongs to the Special Issue AI-Powered Vision Sensing for Autonomous Driving)
  • Article
  • Open Access
352 Views
21 Pages

1 October 2026

Instance Image Navigation (IIN), an embodied navigation task, requires an agent to autonomously explore unknown environments and navigate to the vicinity of a target object indicated by an image. The core challenges are efficient semantic exploration...

(This article belongs to the Special Issue Multimodal Sensing, Fusion, and VLMs for Scene Understanding and Robot Vision)
  • Article
  • Open Access
1,461 Views
40 Pages

Energy-Aware Multilingual Vision–Language Models for Drone Smart Sensing

  • J. de Curtò,
  • Mauro Liz,
  • I. de Zarzà and
  • Carlos T. Calafate

9 May 2026

Drone-based smart sensing increasingly relies on Vision–Language Models (VLMs) for real-time scene interpretation, obstacle detection, and autonomous navigation reasoning. Deploying such systems at scale demands not only high perceptual accurac...

  • Article
  • Open Access
136 Views
19 Pages

3 November 2026

Autonomous mobile robots (AMRs) that depend on remote inference introduce communication and service availability into the navigation control path. This paper presents a cloud-independent mapless-navigation architecture integrating visual features dis...

(This article belongs to the Special Issue Signal Processing and AI Applications for Vehicles, 2nd Edition)
  • Article
  • Open Access
856 Views
18 Pages

15 June 2026

Vision-and-language navigation (VLN) traditionally relies on explicit reasoning chains, which, despite being interpretable, impose severe constraints on inference efficiency and scalability in long-range environments. Existing multimodal large langua...

(This article belongs to the Section Navigation and Positioning)
  • Article
  • Open Access
8 Citations
3,447 Views
18 Pages

13 July 2022

Vision-and-Language Navigation (VLN) is a task designed to enable embodied agents carry out natural language instructions in realistic environments. Most VLN tasks, however, are guided by an elaborate set of instructions that is depicted step-by-step...

  • Article
  • Open Access
1,462 Views
31 Pages

22 July 2026

Offline action prediction does not by itself guarantee reliable closed-loop flight for unmanned aerial vehicle (UAV) vision-language-action (VLA) models. We study a controlled AirSim Blocks waypoint task using 100 expert episodes and 3385 RGB-D, inst...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
1 Citations
2,124 Views
27 Pages

Hybrid Vision Navigation with Hierarchical VLM–LLM Decision Making

  • Rihem Farkh,
  • Ghislain Oudinet,
  • Mohamed Adjou,
  • Alaeddine Moussa and
  • Yasser Fouad

14 April 2026

This paper presents a hybrid navigation architecture for mapless navigation based on monocular vision. The system combines perception-driven affordance control with event-triggered semantic reasoning within a unified decision framework. Navigation be...

(This article belongs to the Special Issue Intelligent Control for Autonomous and Unmanned Systems)
  • Review
  • Open Access
265 Views
37 Pages

23 October 2026

Indoor navigation is fundamental to autonomous mobile robots (AMRs), yet the relationships between explicit planning, learned policies, and large model-based decision-making remain difficult to assess across heterogeneous experiments. This review est...

(This article belongs to the Special Issue A New Era of Embodiment: Cognitive Breakthroughs and Scene Adaptation in Robot Perception, Decision-Making and Autonomous Control)
  • Article
  • Open Access
3 Citations
1,385 Views
21 Pages

CA-VLN: Collaborative Agents in MLLM-Powered Visual-Language Navigation

  • Ruolin Zhu,
  • Shaobin Li,
  • Zixing Zhu,
  • Jing Jia and
  • Min Yang

14 February 2026

Generalization to unseen environments remains a fundamental challenge in Vision-Language Navigation. To tackle this issue, we propose a novel framework that leverages world knowledge embedded within Multimodal Large Language Models. We introduce Coll...

(This article belongs to the Section Navigation and Positioning)
  • Article
  • Open Access
3,037 Views
17 Pages

11 April 2025

The rise of large-scale language models and multimodal transformers has enabled instruction-based policies, such as vision-and-language navigation. To leverage their general world knowledge, we propose multimodal annotations for action options and su...

(This article belongs to the Section AI in Autonomous Systems)
  • Article
  • Open Access
2 Citations
2,135 Views
17 Pages

USV-Seg: A Vision-Language Framework for Guided Segmentation of USV with Physical Constraint Optimization

  • Wenqiang Zhan,
  • Qianqian Chen,
  • Rongkun Zhou,
  • Shenghua Chen and ,
  • Xinlong Zhang,
  • Lei Ma,
  • Yan Wang and
  • Guiyin Liu
  • + 3 authors+ 0 author

31 August 2025

Unmanned Surface Vehicles (USVs) play a critical role in maritime monitoring, environmental protection, and emergency response, necessitating accurate scene understanding in complex aquatic environments. Conventional semantic segmentation methods oft...

  • Communication
  • Open Access
1 Citations
1,487 Views
17 Pages

HSG-ON: Hierarchical Scene Graph-Based Object Navigation

  • Seokjoon Kwon,
  • Hee-Deok Jang and
  • Dong Eui Chang

10 March 2026

For a robot to operate effectively in human-centric environments, finding objects based on natural language is essential. Zero-shot object goal navigation is a significant challenge where robots must find unseen objects in new environments without pr...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
1 Citations
1,273 Views
16 Pages

MVL-Loc: Leveraging Vision-Language Model for Generalizable Multi-Scene Camera Relocalization

  • Zhendong Xiao,
  • Shan Yang,
  • Shujie Ji,
  • Jun Yin and ,
  • Ziling Wen and
  • Wu Wei
  • + 1 author+ 0 author

28 November 2025

Camera relocalization, a cornerstone capability of modern computer vision, accurately determines a camera’s position and orientation from images and is essential for applications in augmented reality, mixed reality, autonomous driving, delivery...

  • Article
  • Open Access
1 Citations
1,497 Views
17 Pages

SADAMB: Advancing Spatially-Aware Vision-Language Modeling Through Datasets, Metrics, and Benchmarks

  • Giorgos Papadopoulos,
  • Petros Drakoulis,
  • Athanasios Ntovas,
  • Alexandros Doumanoglou and
  • Dimitris Zarpalas

29 September 2025

Understanding spatial relationships between objects in images is crucial for robotic navigation, augmented reality systems, and autonomous driving applications, among others. However, existing vision-language benchmarks often overlook explicit spatia...

(This article belongs to the Topic Visual Computing and Understanding: New Developments and Trends)
  • Review
  • Open Access
735 Views
39 Pages

12 August 2026

Orchard production involves intensive labor requirements, limited operational periods, and highly dynamic and complex working environments. Consequently, the development of intelligent orchard robots has become a important approach to enhancing produ...

  • Article
  • Open Access
1 Citations
1,979 Views
25 Pages

VLM-Guided and Spatially Consistent Cross-View Matching and Localization of UGVs in UAV-Stitched Map

  • Yusheng Yang,
  • Xinxu Ma,
  • Ziluan Jiang,
  • Pengfei Sun and ,
  • Xun Zhao,
  • Yangmin Xie and
  • Wei Qian
  • + 2 authors+ 0 author

17 December 2025

In Global Navigation Satellite System (GNSS)-denied urban environments, unmanned ground vehicles (UGVs) face significant difficulties in maintaining reliable localization due to occlusion and structural complexity. Unmanned aerial vehicles (UAVs), wi...

(This article belongs to the Special Issue UAV Detection, Classification, and Tracking)
  • Review
  • Open Access
265 Views
44 Pages

20 October 2026

Deep learning-driven computer vision has become a fundamental enabling technology for agricultural robotics, providing reliable perception capabilities for precision farming and autonomous field operations. Among various object detection frameworks,...

(This article belongs to the Section Sensors and Robotics)
  • Article
  • Open Access
2 Citations
3,098 Views
20 Pages

20 September 2025

Accurate 3D semantic occupancy perception is critical for autonomous driving, enabling robust navigation in unstructured environments. While vision-based methods suffer from depth inaccuracies and lighting sensitivity, LiDAR-based approaches face cha...

(This article belongs to the Section Radar Sensors)
  • Article
  • Open Access
3,804 Views
26 Pages

Interactive Content Retrieval in Egocentric Videos Based on Vague Semantic Queries

  • Linda Ablaoui,
  • Wilson Estecio Marcilio-Jr,
  • Lai Xing Ng,
  • Christophe Jouffrais and
  • Christophe Hurter

Retrieving specific, often instantaneous, content from hours-long egocentric video footage based on hazily remembered details is challenging. Vision–language models (VLMs) have been employed to enable zero-shot textual-based content retrieval f...

  • Article
  • Open Access
10 Citations
5,765 Views
23 Pages

10 December 2024

Odor source localization (OSL) technology allows autonomous agents like mobile robots to localize a target odor source in an unknown environment. This is achieved by an OSL navigation algorithm that processes an agent’s sensor readings to calcu...

(This article belongs to the Special Issue Design and Integration of Sensors for Control, Planning and Deployment in Robotic Systems)
  • Article
  • Open Access
10 Citations
6,460 Views
22 Pages

Multimodal AI for UAV: Vision–Language Models in Human– Machine Collaboration

  • Maroš Krupáš,
  • Ľubomír Urblík and
  • Iveta Zolotová

6 September 2025

Recent advances in multimodal large language models (MLLMs)—particularly vision– language models (VLMs)—introduce new possibilities for integrating visual perception with natural-language understanding in human–machine collabo...

(This article belongs to the Section Computer Science & Engineering)
  • Review
  • Open Access
16 Citations
9,723 Views
32 Pages

Human–AI Collaboration for Remote Sighted Assistance: Perspectives from the LLM Era

  • Rui Yu,
  • Sooyeon Lee,
  • Jingyi Xie,
  • Syed Masum Billah and
  • John M. Carroll

Remote sighted assistance (RSA) has emerged as a conversational technology aiding people with visual impairments (VI) through real-time video chat communication with sighted agents. We conducted a literature review and interviewed 12 RSA users to und...

  • Article
  • Open Access
1 Citations
1,640 Views
21 Pages

ROS2-Based Low-Cost Mobile Robot for Educational Assistance with Reactive Navigation and Semantic-Cached Language Processing

  • Sebastián Alexis Aucapiña,
  • Nataly Cecilia Benalcázar,
  • José Varela-Aldás and
  • Ramiro Isa-Jara

Educational environments, particularly those with limited resources, require affordable mobile robots capable of combining human–robot interaction, autonomous assistance, and academic support without continuous dependence on cloud services. Thi...

(This article belongs to the Section Educational Robotics)
  • Article
  • Open Access
3 Citations
3,337 Views
21 Pages

Development of an Autonomous and Interactive Robot Guide for Industrial Museum Environments Using IoT and AI Technologies

  • Andrés Arteaga-Vargas,
  • David Velásquez,
  • Juan Pablo Giraldo-Pérez and
  • Daniel Sanin-Villa

1 December 2025

This paper presents the design of an autonomous robot guide for a museum-like environment in a motorcycle assembly plant. The system integrates Industry 4.0 technologies such as artificial vision, indoor positioning, generative artificial intelligenc...

(This article belongs to the Section Computer Science, Mathematics and AI)
  • Article
  • Open Access
2 Citations
2,169 Views
15 Pages

Exploring the Cognitive Capabilities of Large Language Models in Autonomous and Swarm Navigation Systems

  • Dawid Ewald,
  • Filip Rogowski,
  • Marek Suśniak,
  • Patryk Bartkowiak and
  • Patryk Blumensztajn

The rapid evolution of autonomous vehicles necessitates increasingly sophisticated cognitive capabilities to handle complex, unstructured environments. This study explores the cognitive potential of Large Language Models (LLMs) in autonomous navigati...

(This article belongs to the Special Issue Data-Centric Artificial Intelligence: New Methods for Data Processing)
  • Article
  • Open Access
48 Citations
21,421 Views
32 Pages

Vision-Based Navigation and Perception for Autonomous Robots: Sensors, SLAM, Control Strategies, and Cross-Domain Applications—A Review

  • Eder A. Rodríguez-Martínez,
  • Wendy Flores-Fuentes,
  • Farouk Achakir,
  • Oleg Sergiyenko and
  • Fabian N. Murrieta-Rico

7 July 2025

Camera-centric perception has matured into a cornerstone of modern autonomy, from self-driving cars and factory cobots to underwater and planetary exploration. This review synthesizes more than a decade of progress in vision-based robotic navigation...

(This article belongs to the Special Issue Interdisciplinary Insights in Engineering Research)
  • Review
  • Open Access
1 Citations
5,625 Views
59 Pages

26 May 2026

Vision–Language–Action (VLA) models unify visual perception, natural-language understanding, and action generation within a single foundation model, allowing a robot to follow instructions such as “fold the towel” or “fl...

(This article belongs to the Special Issue Advances in Deep Learning for Drones and Its Applications: 3rd Edition)
  • Entry
  • Open Access
3 Citations
8,261 Views
11 Pages

Media Education

  • Michele Domenico Todino and
  • Stefano Di Tore

Media Education is an educational discipline focused on critical and conscious engagement with media and their languages. Regarded as complex cultural artifacts, it serves as a preparatory phase aimed at developing interpretative and critical skills...

(This article belongs to the Collection Encyclopedia of Social Sciences)
  • Article
  • Open Access
7 Citations
3,294 Views
13 Pages

SnapStick: Merging AI and Accessibility to Enhance Navigation for Blind Users

  • Shehzaib Shafique,
  • Gian Luca Bailo,
  • Silvia Zanchi,
  • Mattia Barbieri and ,
  • Walter Setti,
  • Giulio Sciortino,
  • Carlos Beltran,
  • Alice De Luca,
  • Alessio Del Bue and
  • Monica Gori
  • + 5 authors+ 0 author

Navigational aids play a vital role in enhancing the mobility and independence of blind and visually impaired (VI) individuals. However, existing solutions often present challenges related to discomfort, complexity, and limited ability to provide det...

(This article belongs to the Section Assistive Technologies)
  • Article
  • Open Access
5 Citations
2,560 Views
32 Pages

In recent years, with the rapid development of science and technology and the substantial improvement of computing power, various deep learning research topics have been promoted. However, existing autonomous driving technologies still face significa...

(This article belongs to the Special Issue Autonomous and Connected Vehicles)
  • Article
  • Open Access
6 Citations
3,983 Views
28 Pages

Accessible IoT Dashboard Design with AI-Enhanced Descriptions for Visually Impaired Users

  • George Alex Stelea,
  • Livia Sangeorzan and
  • Nicoleta Enache-David

The proliferation of the Internet of Things (IoT) has led to an abundance of data streams and real-time dashboards in domains such as smart cities, healthcare, manufacturing, and agriculture. However, many current IoT dashboards emphasize complex vis...

(This article belongs to the Special Issue Human-Centered Artificial Intelligence)

of 2