Next Article in Journal
Time Series Forecasting Utilizing Automated Machine Learning (AutoML): A Comparative Analysis Study on Diverse Datasets
Next Article in Special Issue
Disaggregation Model: A Novel Methodology to Estimate Customers’ Profiles in a Low-Voltage Distribution Grid Equipped with Smart Meters
Previous Article in Journal
Parametric and Nonparametric Machine Learning Techniques for Increasing Power System Reliability: A Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Unmanned Autonomous Intelligent System in 6G Non-Terrestrial Network

by
Xiaonan Wang
,
Yang Guo
and
Yuan Gao
*
Institute of War Studies, Academy of Military Science of the PLA, Beijing 100091, China
*
Author to whom correspondence should be addressed.
Information 2024, 15(1), 38; https://doi.org/10.3390/info15010038
Submission received: 23 November 2023 / Revised: 14 December 2023 / Accepted: 29 December 2023 / Published: 11 January 2024

Abstract

:
Non-terrestrial network (NTN) is a trending topic in the field of communication, as it shows promise for scenarios in which terrestrial infrastructure is unavailable. Unmanned autonomous intelligent systems (UAISs), as a physical form of artificial intelligence (AI), have gained significant attention from academia and industry. These systems have various applications in autonomous driving, logistics, area surveillance, and medical services. With the rapid evolution of information and communication technology (ICT), 5G and beyond-5G communication have enabled numerous intelligent applications through the comprehensive utilization of advanced NTN communication technology and artificial intelligence. To meet the demands of complex tasks in remote or communication-challenged areas, there is an urgent need for reliable, ultra-low latency communication networks to enable unmanned autonomous intelligent systems for applications such as localization, navigation, perception, decision-making, and motion planning. However, in remote areas, reliable communication coverage is not available, which poses a significant challenge for intelligent systems applications. The rapid development of non-terrestrial networks (NTNs) communication has shed new light on intelligent applications that require ubiquitous network connections in space, air, ground, and sea. However, challenges arise when using NTN technology in unmanned autonomous intelligent systems. Our research examines the advancements and obstacles in academic research and industry applications of NTN technology concerning UAIS, which is supported by unmanned aerial vehicles (UAV) and other low-altitude platforms. Nevertheless, edge computing and cloud computing are crucial for unmanned autonomous intelligent systems, which also necessitate distributed computation architectures for computationally intensive tasks and massive data offloading. This paper presents a comprehensive analysis of the opportunities and challenges of unmanned autonomous intelligent systems in UAV NTN, along with NTN-based unmanned autonomous intelligent systems and their applications. A field trial case study is presented to demonstrate the application of NTN in UAIS.

1. Introduction

The concept of non-terrestrial networks (NTNs) that are capable of providing wireless communication coverage in complex and non-ideal environments is a popular topic, especially for conditions where a reliable means of wireless connections for time-critical tasks is urgently needed. Previously, wireless cellular communication services were designed to offer coverage to human users with smart phones or other portable devices; however, recently, machine-type communication is also in significant demand, such as with internet of things (IoT) devices and machine-type communication (MTC) devices. The demand for communication services further drives network evolution and expansion into non-traditional areas such as industry applications, remote surgery, AR/VR and so on [1,2,3,4,5,6]. Unmanned autonomous Intelligent system (UAISs), such as self-driving vehicles, multi-robot systems, unmanned aerial vehicles, and unmanned ground vehicles have experienced increasing demand in terms of ubiquitous wireless connection requirements to fulfill tasks such as perception, localization, navigation, collaboration with nearby agents in a multi-agent system, and the offload of computation-intensive tasks to back-end or resource-abundant facilities [7].
In recent years, the development of unmanned aerial vehicles (UAVs) and satellites has brought about extensive opportunities for NTN applications with low cost and deployment flexibillity. Furthermore, 4G/5G infrastructural deployments on the ground have steadily increased across the globe, with numerous cellular base stations around cites and along highways. However, in remote or unreachable regions, such as deserts and mountainous areas, ground cellular network coverage is not available due to high cost or environment limitations [8,9,10,11,12]. In addition, the use of NTNs is beneficial when ground networks are overloaded during special events like sports games or due to the sudden failure of base station infrastructure due to natural disasters in specific areas. Therefore, in the scenarios mentioned above, non-terrestrial networks (NTNs) are a promising solution for providing communication coverage in areas that are unable to be covered via traditional ground infrastructure. In some cases, especially in conditions such as power failures caused by disasters or a sudden increase in the number of users, the need for ubiquitous network access can only be met using non-terrestrial communication methods such as unmanned aerial vehicles (UAVs) or satellites [13,14,15,16,17,18].
Owing to the extensive applications of UAIS in conjunction with 6G NTN communications, ranging from autonomous self-driving vehicles, unmanned aerial vehicles to multi-purpose robots for precise agriculture and disaster rescue scenarios. Efforts have been made in research toward 6G and beyond NTN technology to provide connectivity and intelligence. Therefore, a comprehensive and in-depth review of 6G NTN technology from the perspective of unmanned autonomous intelligent systems is crucial for undertaking further research in this domain. Numerous publications concerning the challenges and opportunities of UAIS in NTNs have been presented. However, the present work mostly emphasizes NTN communication itself or applications in a particular domain, such as intelligent transportation systems, autonomous vehicles and unmanned aerial vehicles. A systematic review of the existing work related to various UAIS in 6G NTN is required. The purpose of the paper is to provide a systematic review of the current trends and state of the art of UAIS in the context of 5G/6G NTN communication. We will discuss the role of UAVs in NTN communications and provide a comprehensive summary of various UAIS applications in UAV NTN, including unmanned ground vehicles (UGVs), unmanned aerial vehicles (UAVs), and connected and automated vehicles (CAVs).
The rest of the paper is organized as follows. Firstly, in Section 2, the current status and development of NTN are analyzed. In Section 3, a comprehensive analysis of the role of UAVs in NTNs is illustrated. In addition, the challenges and research opportunities of UAVs in NTNs are thoroughly analyzed. In Section 4, we discuss UAV NTN-enabled application of UAIS in UGVs, CAVs and unmanned maritime applications. Open research topics in this particular domain that need further discussion are proposed. In Section 5, a field trial case study is presented to demonstrate the application of UAIS in NTN communications. Section 6 is the conclusion of this paper.

2. Non-Terrestrial Networks in 5G/6G

In this section, we review the general characteristics and evolution process of 5G and beyond-5G non-terrestrial networks.

2.1. The Evolution of Non-Terrestrial Networks

Non-terrestrial networks (NTNs) were first mentioned in the use case of fifth-generation (5G) communication standards, and the concept has drawn extensive attention from research scientists for the grand vision of space–air–ground–sea integrated networks (SAGSINs). The 5G ecosystems have included satellite communications as an important means of producing NTNs. The initial research of NTNs started right after the Third-Generation Partnership Project (3GPP) organization announced its first release of the 5G communication standards containing the NTN concept. Since then, a variety of research papers have been published concerning NTN technology. The evolution of 3GPP NTN standards of 5G communication is illustrated in Figure 1. In release 15 of 3GPP 5G standards, TR 38.811 was introduced as “NR Research Supporting Non-Ground Networks”, which illustrated the application scenarios of NTN communications and pointed out the unresolved problems that may have a great influence on the application of NTNs. The next evolutionary step of 5G NTN was finished with release-16 of 3GPP, which put forward solutions for supporting NTNs, in which satellite communications were listed as a priority for NTN applications. In release 17 of the 3GPP 5G standards, LEO (low Earth orbit) and GEO (geostationary transfer orbit) satellite applications were emphasized, while high-altitude platform station (HAPS) applications were also taken into account. Finally, 3GPP froze the release 17 standards at its 96th plenary session. A practical architecture of a NTN communication network is shown in Figure 2, which can be divided into space, air, and ground layers. The top part of the NTN network architecture is the space network, which is usually made up of a number of inter-connected satellites, while the middle part of the network is composed of HAPS (high-altitude platform stations), LAPS (low-altitude platform stations), and air-to-ground networks utilizing UAVs and airships. The ground part is the conventional terrestrial network [18,19,20,21,22,23].
NTN technology represents new prospects in wireless communication applications such as satellite communications and low-altitude communication utilizing unmanned aerial vehicles and airships for internet of things devices or autonomous systems. UAVs and airships acting as radio access network infrastructure are capable of providing lower-latency services than satellites, which is crucial for time-critical applications. NTN communication expands the application of 5G communication from terrestrial communication to space/air communication. The transformative advancement in communication technology promoted the shift from fifth-generation communication to sixth-generation, which highlights the vision of ubiquitous networks and space–air–ground coverage [24,25,26,27].

2.2. The Role of UAVs in NTNs

In sixth-generation (6G) communication networks, space–air–ground–sea integrated networks will satisfy communication demands around the globe, whether in deserts, mountains, or islands. In contrast to common network users like cell phones and other portable devices, UAIS have faced great challenges in terms of network connectivity, throughput, and reliability since platforms such as robots, self-driving cars, or unmanned boats might be unevenly distributed in remote areas and in high-speed maneuvers, which demand flexible and ubiquitous network coverage. In this case, few existing ground network infrastructure is available for the urgent demand for a task-critical and time-sensitive network using conventional terrestrial methods. Considering this challenge, it is beneficial to employ non-terrestrial infrastructures, including satellites and unmanned aerial vehicles (UAVs), HAPS, and LAPS, for wide-area communication coverage for UAIS.
In particular, NTN is a flexible means to provide on-demand coverage for machines and adapt to the nature of the uneven distribution of UAIS in practical fields; thus, the architecture of the NTN should be designed within a cell-free architecture [24]. In addition, driven by the requirements of time-sensitive missions of UAIS, massive data generated from UAIS must be processed as quickly as possible. Therefore, non-terrestrial communications-based multi-access edge computing is essential and requires the help of UAVs to build high-speed links between UAIS users and UAVs [25,26,27]. Depending on the role of UAIS platforms in NTNs, the architecture of NTNs can be defined as follows:
(1)
UAV platform as an NTN user: In this use case, UAV platforms are utilized as network users in an NTN architecture, which is a primary form of UAIS in NTNs. For instance, UAVs and satellites can be considered as NTN users serviced by other platforms.
(2)
UAV platform as an NTN relay: In this use case, UAVs are considered mobile relays for scenarios in which direct links cannot be achieved due to geographic obstacles or extended communication ranges.
(3)
UAV platform as an NTN base station: In this case, UAVs are equipped with base stations for connectivity coverage. Sometimes, UAV platforms with abundant payload capabilities are further utilized for multi-edge computing.
Unmanned aerial vehicles (UAVs) are ideal operation platforms for flying base stations, relays, access points and other non-terrestrial communication infrastructure, which fully leverage the advantages of the high maneuverability and flexibility of the platform. Therefore, UAVs are preferred when performing network coverage missions in dangerous or communication-congested areas where reliable communication does not exist or has been corrupted. In the past, UAV-based systems have been designed and used for military operations and disaster rescue applications. Such applications include surveillance, inspection, personnel searches, and dangerous situation alerts. Nowadays, UAVs have evolved into platforms for non-terrestrial network coverage for ubiquitous network applications supporting the communication demand of users in various applications. With the constant innovations in the domain of mobile communications, UAV NTN communication coverage for UAIS on the ground, in the air or in the ocean is drawing much attention. Advancements in NTN communications hold potential driving factors for supporting UAIS with low-latency, high-bandwidth and multi-access edge computing in complex environments [28,29].

3. UAV-Assisted Non-Terrestrial Networks

Unmanned aerial vehicles (UAV) have been widely utilized in military operations, disaster relief tasks, and wild-area monitoring for perception, surveillance, material delivery and communication purposes due to their high mobility, flexibility, and relatively low-cost characteristics. In 6G scenarios, the role of UAVs is irreplaceable, serving as aerial network nodes providing ubiquitous network connections in the lower-altitude airspace between terrestrial networks and satellite networks. For the future vision of 6G networks that have extended coverage on the ground, in the air, and in space, realizing a space–air–ground integrated communication network by means of utilizing UAVs and other low-altitude aerial platforms is of the utmost significance.
In 6G NTN scenarios, UAVs are capable of performing various communication tasks, which include serving as base stations, communication relays, and user equipment (Figure 3. When mounted with communication equipment, UAVs can be employed as flying base stations or communication relays to maintain communication services to ground users in case of crippled or congested ground base stations. In contrast, from the recent literature, UAVs can also be considered as aerial nodes, connecting to ground and non-terrestrial networks, referred to as cellular-connected UAVs, which have drawn more and more attention from research scientists. Cellular-connected UAVs are promising in a number of applications such as surveillance, autonomous driving, parcel delivery, post-disaster rescue, and communication enhancement. Previous works have placed great emphasis on UAV-assisted cellular communications. However, in recent studies, UAVs connected to communication infrastructure serving as cellular-connected platforms are also drawing attention.
In addition, in scenarios that require wide-area communication coverage, a swarm of interconnected UAVs through Flying Ad Hoc Networks (FANETs) are utilized to integrate with terrestrial infrastructure to extend network coverage, as has been studied by a variety of researchers. UAV communications have a variety of advantages, ranging from line-of-sight links to dynamic deployment, which is promising in terms of enabling space–air–ground–sea connections. However, a variety of common problems still need in-depth investigation to support all kinds of UAV applications concerning NTN communications. In UAV NTN communication, place deployment, flight trajectory optimization, and resource allocation in mobile edge computing are hot topics under profound discussion.

3.1. UAV Path Planning and Control in NTN Communications

Integrating unmanned aerial vehicles (UAVs) as flying base stations, relays or user equipment is expected to be an important topic in the context of beyond-5G/6G non-terrestrial networks. Multiple operational aspects of UAV-assisted 5G/6G networks have been investigated in various studies, which include UAV place of deployment, ground interference cancellation, antenna orientation optimization and cell partition [30,31].
From the perspective of unmanned autonomous intelligent systems, the motion control of UAV platforms in communication scenarios is a multi-disciplinary problem that requires knowledge relating to autonomous control, wireless spectrum environment perception, cellular user communication quality awareness, and so on. Thus, trajectory optimization in NTNs has been widely studied. In recent years, UAV trajectory optimization and path planning have drawn extensive attention from research scientists due to the inter-discipline knowledge and sophisticated models involved in the trajectory planning of UAV communication. Efficient trajectory optimization or path planning is conducive to maneuvering according to UAV communication performance and ground user requirements. Although path planning is a basic problem in UAV control, the synergy between UAV path planning and the performance of the wireless communication systems poses new challenges that are not covered by traditional UAV navigation and trajectory optimization paradigms. Deep reinforcement learning (DRL)-based algorithms and other non-convex optimization methods are utilized to solve dynamic path planning and control problems [32,33,34,35,36,37,38,39,40,41,42,43,44,45,46].
(1)
UAV Path Planning for Flying Base Stations Scenario
The deployment position and motion trajectory of UAVs have an impact on the ground communication coverage and capacity when UAVs are used as flying base stations. In general, UAV deployment and trajectory optimization are challenging problems due to the extensive number of parameters involved, such as UAV air-to-ground channel model, inter-UAV interference avoidance, UAV power consumption, motion constraints, and so on.
To address the challenges caused by joint optimization for UAV motion control and wireless communication in NTN communications [32], investigated a distributed framework based on DRL to control and optimize UAV base stations when considering ground users’ fairness. This work considered flight time as the main constraint to optimize overall throughput during a fixed flight time. In order to deal with real-time path planning problems for UAV base stations, a variety of research works have been published [33,34,35]. In traditional UAV control schemes, ground operating stations have limited knowledge of ground users’ status, and thus real-time online trajectory planning is challenging to perform. Moreover [32], considered UAV maneuver curvature for received signal strength optimization in a multi-base station scenario. This problem is challenging since the UAVs are maneuvering at high speed, making it impossible to optimize the coverage of SNR in advance when using terrestrial base stations. The authors of this work emphasized the fairness of service of users since the numbers and coverage of the UAV base station are quite limited in practical applications. By constructing it as described, the user fairness using received signal strength, a multi-agent-based control scheme was implemented for distributed path optimization. Moreover [33], proposed a flow level model for a UAV base station network and a DRL-optimizing method for network traffic balancing based on a realistic UAV radio model. The contribution of the study is the first introduction of a traffic flow model to describe UAV base station communication performance, which was later used as input for DRL-based trajectory control.
Furthermore [34], demonstrated a circle trajectory setup for multiple-ground-user coverage. The trajectory problem was converted to a Euclidean k supplier location problem that minimizes the maximum distance of any ground users to the nearby UAV base station facility. Moreover [35], designed a deep Q learning network and greedy algorithm-based UAV trajectory optimization paradigm for unevenly distributed ground users. In [36], the authors emphasized a multi-target coverage dynamic trajectory optimization scheme utilizing a knowledge-incorporated approach considering inter-UAV connectivity maintenance. The study showed promising applications in both UAV base station communication coverage and monitoring coverage tasks.
(2)
UAV Path Planning for Aerial Mobile Relay
Recently, UAVs have been considered popular platforms for communication relay purposes due to their deployment flexibility and maneuverability. In contrast to satellite communications, UAV relay systems hold the potential advantages of high-volume and low-latency communication through line-of-sight links. A UAV-aided mobile relay is utilized to transmit information from ground users to terrestrial or non-terrestrial base stations, which is of great importance in scenarios such as disaster management for extending communication ranges over mountainous terrain. The placement and trajectory of UAV mobile relays have a significant influence on communication distance and the quality of service for wireless users.
Typical application scenarios involving UAV relays include movable robotic platforms, wireless sensor nodes and internet of things devices. In such cases, the transiting power of the ground nodes is relatively low compared to UAV relays, indicating that deployment location and flight trajectory have a major impact on the relay link, thus requiring the careful optimization of the motion parameters. From the literature [37,38,39,40,41,42,43], investigated trajectory optimization methods concerning the condition of the ground user.
Furthermore [37], proposed an iterative solution for joint optimization of UAV trajectory, power consumption, and time-slot assignment, which is modeled as a non-convex problem. The joint optimization of trajectory and power is the foundation of communication resource allocation. Therefore [38], considered a path planning and power consumption optimization paradigm for a space–air–ground integrated relay network in a non-orthogonal multiple access scheme. The results of the proposed paradigm outperformed that of a fixed circle trajectory. Moreover [39], investigated a novel solution for trajectory design and transmitting power minimization for a UAV-assisted relay system. The study considered a cognitive relay scenario in which the trajectory was designed according to the speed and altitude constraints of the relay system.
In [40], an efficient algorithm was designed for a UAV relay’s three-dimensional trajectory optimization in order to achieve a higher-throughput network in the case of the interference of ground users of the same frequency band. The trajectory optimization was conducted considering the influence of intentional jamming. Similarly [41], studied a multi-UAV trajectory optimization framework in which UAVs acted as both aerial base stations and wireless relays. The study is of great significance for large-scale communication coverage scenarios in which UAV base stations and UAV relays collaborate to complete the network coverage task.
(3)
UAV Path Planning for Cellular-Connected UAV User Equipment
Except for the fact that UAVs have been successfully utilized as flying base stations and relay nodes, recently, UAVs performing practical tasks tend to be connected to ground cellular base stations as user equipment, which brings about the issue of optimal path finding considering connectivity constraints and ground interference [42,43].
A study [44] proposed an analytical model to demonstrate the influence of trajectory and altitude on the quality of service in relation to UAV cellular users. From the study, we can see that with the UAV moving from the center to the edge area of the base station coverage, the minimum constrained altitude decreases. The study indicated that the motion parameters should be well considered for better UAV user equipment quality of service. Moreover [45], investigated an iterative method for trajectory planning to minimize the time required to fulfill the task and overall power consumption for UAV aerial users. The proposed method considered a minimum task fulfillment time under the signal-to-noise ratio requirements. Furthermore [46], proposed an online trajectory-optimizing scheme for minimal power consumption based on an outage probability map reconstructed from sparse sampling. The contribution of this work was the introduction of an outage probability map through which a trajectory planning method considering power consumption dramatically reduced the outage of connection between the UAV user and the base stations. However, the reconstruction of the outage probability map database cannot be constructed in advance and are energy-consuming, which are major drawbacks of the method. However, in [47], a DRL-based UAV user optimization method was utilized considering the impact factors of UAV power, flight trajectory, antenna pattern, interference from other ground base stations, and other environmental factors. The optimization scheme was converted to a Markov decision process, which can be solved via the deep Q-learning method. Researchers [48] considered a cellular-connected UAV for synthetic aperture radar sensing tasks using the successive convex approximation method. Integrating communication and sensing is a major aspect of future 6G technology, while the proposed trajectory optimization method considered the sensing resolution requirements and converted the non-convex problem to a convex one using the successive convex approximation (SCA) method. Researchers [49] proposed a dynamic programming algorithm to optimize trajectories of cellular-connected UAVs for communication enhancement with considerations in terms of flight altitude. The trajectory planning process considers flight path and altitude at the same time since the altitude of the UAV affects the backhaul performance of the cellular-connected UAV to a great extent.
The authors in [50] reported a path-planning method for task-critical missions in which connectivity maintenance is of utmost importance. The signal map of the ground base station was constructed in advance to support the DRL-based algorithm for the optimal UAV path. Similarly [51], reported a UAV curvature design for UAV users with a fixed start and final locations. This work was designated to minimize the flight duration time of the cellular-connected UAV, which has a constrained outage duration upper bound during flight. Researchers [52] emphasized the role of path planning in the effort of interference cancellation. The joint optimization method applying trajectory adjustment and interference cancellation distinguished the UAV users from the ground users to achieve better performance.
The existing works on UAV trajectory/path planning in NTN communication is summarized in Table 1. Apart from DRL-based UAV joint trajectory and communication optimization methods, other non-convex optimization paradigms have been utilized to solve the problem. Researchers in [53] investigated a coordinate multi-point transmission method-based mobility control method considering both the displacement and vertical movement of cellular-connected UAVs. In addition, multi-UAV path planning is also considered a major issue in UAV NTN communication. A study in [54] considered a mixed-integer linear program scheme for multi-UAV base station motion optimization. Furthermore, reference [55] proposed an iterative single-head attention approach for path planning and communication optimization for a group of UAVs through distributed control. Moreover, reference [56] introduced a method for maintaining the freshness of information received by base stations while optimizing the UAV trajectory at the same time in a wireless sensor information collection scenario.
Recently, reconfigurable intelligent reflection surfaces (IRSs) and UAVs have been combined together to achieve communication coverage enhancement in challenging environments [57]. In [58], the trajectory planning of the UAV with IRS onboard is addressed using the DRL method. Ref. [59] proposed UAV optimal path planning for maximizing the reflecting rate considering the UAV motion limit by means of a heuristic method.

3.2. UAV Mobile Edge Computing in NTN Communications

In real-world applications, users such as IoT devices have limited batteries and relatively low computation resources, posing challenges for IoT devices in terms of executing computation-intensive applications. UAVs with onboard computation capabilities are promising in terms of supporting mobile edge computing (MEC) to solve the problem. In UAV-aided non-terrestrial networks, IoT devices with limited commutation resources can offload their computation-intensive tasks to a UAV with abundant computation resources at the edge of the network, resulting in reduced energy consumption and communication overhead to back-end cloud servers. Compared to terrestrial stationary base stations acting as MEC infrastructure, UAV-aided MEC has the potential to serve the users on demand, which also poses challenges to these systems. However, owing to the limited payload capacity and energy, UAVs have limited capabilities when serving as MEC servers. Therefore, MEC systems supported by UAVs have urgent requirements in terms of motion control and energy consumption optimization.
Many existing studies utilized a centralized strategy to optimize the offloading process, which is inefficient in multi-UAV/user scenarios. To resolve the computing resource allocation problem in UAV-aided MEC, the authors of [60] proposed a decentralized multi-agent reinforcement learning-based method to minimize computation latency for a number of users. To minimize power consumption in a multi-UAV MEC scenario [61], proposed a multi-layer strategy utilizing UAV deployment location optimization and offloading task prediction based on a long short-term memory mechanism.
Considering the complicated UAV-aided MEC system, the optimization of UAV motion control, energy consumption, and computation resources cannot be fulfilled using conventional convex methods, which is challenging. For trajectory design of UAV MEC systems [62], proposed a DRL paradigm to control UAV trajectory and maximize the system’s stability at the same time. In a multiple-input single-output (MISO) UAV MEC scenario, the authors of [63] studied the energy-saving strategy considering beam-forming and UAV trajectory.
Owing to the line-of-sight connections between UAV MEC platforms and ground users, the data offloading task can be achieved at high speed. However, this also brings about security issues since the line-of-sight links are prone to attacks by other platforms. Nevertheless, the data links usually work in a broadcast manner, which might be used by eavesdroppers to intercept the data.
For secure MEC processes [64], considered UAV placement and RF power to comprehensively solve the maximum security capacity problem. Non-orthogonal multiple access (NOMA)-based UAV MEC have advantages in channel efficiency, thus enabling more users in scenarios of limited resources. To resolve the secure communication of the NOMA-based UAV MEC problem [65] proposed an optimizing paradigm for maximizing secure capacity through jointly optimizing UAV trajectory and resource allocation. Furthermore, the authors of [66] proposed a security enhancement method emphasizing an airborne eavesdropper scenario in NOMA UAV MEC systems.

3.3. Unmanned Aerial Vehicles Application in NTNs

With the assistance of NTN communication, UAVs are capable of supporting a variety of tasks, including material delivery, air traffic control, and disaster relief operations.
(1)
Delivery
Reference [67] proposed a vaccine delivery scheme called SanJeeVni, which utilized blockchain and 6G communication in vaccine delivery to ensure trusted logistics within strict delivery time constraints. The scheme proposes a UAV swarm network in which the delivery trajectory design and motion control of a UAV swarm are achieved through intelligent edge computing. With 6G-empowered eRLLC (Extremely Reliable and Low-Latency Communications) technology, the flight time of UAVs was strictly limited, ensuring timely delivery of vaccines to users in need. Furthermore [68], introduced a blockchain-based secure drone delivery system for medical equipment logistic missions using ground-based station networks.
(2)
UAV traffic management
With the development of 5G/B5G communication technology, UAV traffic management (UTM) has recently garnered significant attention from research scientists [69,70,71]. This is due to the dramatic evolution of UAV applications such as parcel delivery, precise agriculture, and survey mapping, which usually operate beyond the visual line of sight mode. As a result, efficient and secure traffic management is urgently required. In the future, UAV traffic will become even denser and busier, making UTM essential for coordinating multiple autonomous UAVs beyond the visual line of sight (BVLoS) in complex UAV traffic environments. The UTM requires an efficient communication backup to handle complex airborne communication in environments with heavy air traffic, as opposed to relying on existing cellular networks for terrestrial communication. Researchers in [70] introduced a 6G-enabled UTM paradigm in a highly dense and urban air traffic scenario emphasizing non-terrestrial communications, including aerial and satellite communication.
(3)
Disaster Relief and Management:
Communication reconstruction is crucial in disaster relief scenarios because road destruction, power interruptions, and the paralysis of terrestrial base stations will isolate the affected area, leading to an “information island” phenomenon. Unmanned aerial vehicles are extensively utilized in disaster scenarios to offer communication coverage for ground user equipment (UE), including affected residents and first responder rescue teams, when ground network infrastructure is disconnected from the power supply or destroyed by sudden disaster events [72,73,74,75]. UAVs employed as aerial communication nodes are essential for disaster management, facilitating communication recovery and information exchange. In reference [72], a proposal for stochastic geometry-based UAV-assisted wireless communication in disaster scenarios was presented, considering partial ground failure. Furthermore [73], investigated an aerial communication scheme utilizing multi-UAVs for multi-purpose disaster relief operations, with a focus on device-to-device communication and energy efficiency. Moreover [74], examined the fairness of service provision in a post-disaster millimeter-wave communication system. Researchers [75] highlighted the topological challenges in UAV-assisted communication during post-disaster rescue operations.
Figure 4 illustrates a real-world senario of wildfire detection and early warning in mountainous regoins. A group of unmanned helicopters equipped with 5G base stations and mesh communication payloads is deployed to provide network coverage for firefighters in mountainous areas. Images containing fire point information, collected via optical and thermal sensors on board the UAVs, are then transmitted to the ground command truck via a UAV 5G network. After image processing and recognition, fire point locations are distributed to individual firefighters via the non-terrestrial 5G network and displayed on their helmet-mounted AR devices or cellphones. UAV-assisted networks have facilitated a variety of applications, such as post-disaster area assessment, personnel search, and information collection [76,77,78].
With the emergence of new technologies in the domain of UAVs, UAV-assisted non-terrestrial networks demonstrate significant flexibility and mobility. However, there is still a need for further study on issues such as UAV-to-UAV or UAV-to-satellite collaboration communication, device-to-device communication, and UAV optical communication [79].

4. Application of UAV-Aided Non-Terrestrial Networks in UAIS

An unmanned autonomous intelligent system (UAIS) [80,81,82,83,84,85,86,87,88] is defined as a mechatronic system capable of fulfilling universal tasks without or with limited human involvement. Typical UAIS include connected autonomous vehicles [89], swarm robot systems [90], unmanned aerial vehicles [91], unmanned ground vehicles, unmanned maritime vehicles [92], smart manufacturering systems [93,94,95,96], agricultural robots [97,98,99,100,101], service robots, and medical robots [102,103,104]. These systems are increasingly dependent on the comprehensive application of artificial intelligence, data science, ubiquitous networks, and distributed computing to fulfill complex tasks and adapt to ever-changing environments. Compared to traditional rule-based automation systems, UAIS offers advanced capabilities such as autonomy, intelligence, and collaboration. It supports general-purpose tasks such as perception, autonomous decision making, reasoning, and collaboration [105,106].
One of the key factors that facilitate the UAIS ecosystem is the development of low-latency, ultra-reliable, and high-volume wireless communication, supporting a growing range of unmanned ground vehicles, self-driving cars, maritime unmanned vehicles, mobile robotics, and more. UAIS has demonstrated a growing need for ubiquitous network connectivity to facilitate the exchange of information and the offloading of computational tasks to edge computing devices or cloud servers. In some instances, network connections may be unavailable due to inadequate communication infrastructure or communication congestion. The emergence of the NTN communication concept sheds new light on UAIS by providing ubiquitous network connection and mobile edge computing. On the other hand, UAIS can also be utilized to support NTN communication in a variety of ways. UAVs are typical UAIS platforms used to support NTN communication, while UGVs, USVs, and CAVs are all promising in performing communication coverage tasks in 6G NTN.
The rise of artificial intelligence (AI) has played an important role in providing UAIS with advanced autonomy and decision-making capabilities. AI is utilized to enable systems that can learn from experience and adapt to diverse and complex environments, which is vital to applications of UAIS. With the rapid advancement of software and hardware, various deep learning/reinforcement learning algorithms along with computing platforms offer sufficient computation resources to UAIS applications. In addition, the emergence of multi-access edge computing and distributed computation offloading has greatly boosted the development of AI-based applications, especially UAIS, which can fulfill specific tasks, such as object detection/reorganization, decision-making, and autonomous navigation. While in practical applications of UAIS, massive computation resources and low latency connections are not always available and have many limitations in real-world scenarios [107,108,109,110]. Typical communication requirements of the UAIS in NTN is illustrated in Table 1, which pose significant challenges for NTN communication.
With the assistance of artificial intelligence, UAIS can become an organic part of the future intelligent NTN communication. Advancements in UAIS are increasingly emphasizing decentralization, ubiquitous connectivity, and collective intelligence, which are vital for supporting an elastic and self-adaptive network architecture. The new trend of UAIS development has put forward higher requirements for autonomous capabilities, as illustrated in the Table 2, which will support the ubiquitous coverage of wide areas.
The various applications of UAIS in NTN communication scenarios will be discussed in detail in the following part of the paper. From the perspective of 6G communication, network coverage will extend beyond current boundaries and cover multi-dimensions: on the ground, in the air, space, underwater, and underground. Thus, an integrated communication coverage method utilizing both terrestrial and non-terrestrial infrastructure will be beneficial for UAIS in terms of quality of service (QoS), resilience, and sustainability of the networks. Unmanned aerial vehicles (UAVs) and satellites will play vital roles in enabling UAIS applications.

4.1. Unmanned Ground Vehicle in UAV-Aided NTN Communication

Unmanned ground vehicles (UGVs) are popular in the research of unmanned autonomous intelligent systems and have a variety of applications, including military operations, anti-terrorism, smart agriculture, logistics, delivery, and mining. UGVs are capable of fulfilling complex tasks such as environment perception, data collection, data transmission, decision making, motion control. However, UGVs are usually compact and have limited computation resources which can restrict their ability to fulfill massive computation tasks due to the size and energy limit of the platform. Therefore, the support of extensive computation resources is crucial for the application of UGVs. Sometimes, UGVs are designed for applications away from cities where there is no network infrastructure. In case of power interruptions caused by natural disasters, UGV communications supported by terrestrial network infrastructures may break down or result in a loss of control, leading to the failure of time-sensitive tasks. To address these challenges and equip UGVs with sufficient communication capabilities for control instructions, real-time data exchange, and computation tasks offloading. Non-terrestrial network platforms, such as airships and unmanned aerial vehicles, can complement the blind sectors of terrestrial base stations to extend network coverage in remote areas.

4.1.1. Communication Requirements of Unmanned Ground Vehicle in NTN Communication

Currently, there are three primary modes of operating the UGVs: remote-controlled, semi-autonomous, and fully autonomous. The first mode is further divided into visual line of sight (VLOS) and beyond visual-line-of-sight (BVLOS) control, respectively. Although UGVs in the VLOS mode can be controlled using direct wireless links, and semi-autonomous UGVs require higher bandwidth to transmit real-time images and perceptual information. For semi-autonomous UGVs capable of situation awareness, object detection, and navigation, the communication requirements include the following [111]:
  • Communication for uploading work scenarios and updating the knowledge base;
  • Remote communication for offloading the local processing tasks of the UGV to the edge server or cloud server;
  • Command and control (C2) of UGV, including the transmission of first-person view (FPV) video information and real-time control instructions to the UGV operator or supervisor.
The communication peak service requirement of UGV above is further calculated using methods derived from the 3GPP standardization documents [112], as illustrated in Table 3 below.
As shown in Table 3 above, command and control, offloading processing tasks, and video streaming of the FPV use case require a network with very low delay and high reliability, which is challenging to achieve using conventional communication methods. In satellite communication, propagation delay is relatively high due to the communication distance between the satellite and the ground user, which poses signifiant challenges to UGV application in NTN scenarios. In the meantime, UAV and LAPS platforms tend to be much more flexible when deployed in challenging terrains, adapting to ground users to provide ultra-reliable and low-latency communication links for time-sensitive UGV tasks.

4.1.2. NTN Communication in Unmanned Ground Vehicle Control

In the future, 6G network ultra-reliable and low-latency communication (URLLC) will be essential for UGVs, which are indispensable for real-time applications such as smart agriculture [113,114,115], intelligent industry, and various other applications. To accurately control the UGV, tactile feedback and interactive virtual reality (VR) can stimulate the human brain, aiding users in adjusting operation time, pressure, and gestures. These factors are crucial for remote operations. The tactile feedback and interactivity of VR applications require low-latency and broadband networks. URLLC is necessary to deliver extremely low latency for real-time feedback for operators, based on short-length packets. To address this challenge, ref. [113] proposed an approach that utilized UAVs as forward relays to transmit short URLLC control packets between a control station and multiple ground mobile vehicles in smart agriculture scenarios. Researchers [116] proposed a radar-aided millimeter-wave communication method for UAV-UGV cooperation in a disaster scenario where ground network infrastructure is available. In addition, the UAV–UGV cooperation networks were further investigated in terms of bandwidth allocation [117], data collection [118], navigation [118,119,120], and other related aspectes.
When UGVs are utilized for surveillance or disaster relief missions in less populated areas lacking terrestrial infrastructure, UAV-aided networks are valuable for controlling UGVs and directing them to the target area. For high-speed maneuvering platforms, achiveing high-speed communication presents a challenging problem. Researchers in [116] proposed a mm-wave radar-aided communication scheme for UAV-UGV cooperation. The worst-case QoS maintain method for UGVs was developed using QoS-awareness power distribution. However, in reference [121], a software-defined radio method was utilized to extend the communication range between UAV and UGV using OFDM. The study enhanced UAV UGV communication by introducing a new waveform based on OFDM to increase the likelihood of line-of-sight links.
Researchers of [122] considered the target perception and tracking problem utilizing a UAV-UGV group. The study involved a heterogeneous communication scenario in which consensus control was achieved in the case of changing topology. Furthermore, the authors of [123] introduced a novel communication protocol for the collaboration of air–ground platforms. The cooperative communication scheme allowed inter-communication between UAVs and UGVs through a client–server architecture. In [124], a joint path optimization scheme was proposed to enable the optimal recharging location of the UAVs for wireless communication. Ref. [125] considered a path optimal problem of one UAV and multiple UGVs wherein the UAVs provide communication coverage and share information with the UGVs. A sequence strategy was utilized to determine the access sequence of the UGVs.
UGVs are also promising platforms for extending network coverage to expand service availability and provide network connectivity for other ground users. In reference [126], a graph-based optimization method for virtual resource allocation of slices was proposed in ground vehicle-assisted networks. A system modeling procedure inspired by graph theory was used to model networks and the energy cost of vehicle-assisted B5G networks. The rapid advancements in autonomous technologies have also promoted the development of vehicular networks. Vehicular Ad hoc Network (VANET) shows promise for future intelligent transportation systems. Vehicle-to-vehicle communication is utilized to collect and share information. For UGV applications supported by NTN, a variety of security issues remain challenging [127,128,129].

4.2. Connected and Automated Vehicles in UAV-Aided NTNs

Connected and automated vehicles (CAVs) and autonomous driving are popular subject in the realm of smart cities, where there have been significant advancements in both academic and industrial settings in the past few years. CAVs are systems that are equipped with advanced perception, cognition, planning, and control capabilities, allowing them to operate autonomously by sensing traffic via onboard sensors and exchanging information with roadside unit devices. Autonomous driving is a popular field of research that builds the foundation of intelligent transportation system (ITS). In complex road traffic and challenging weather conditions, the collection of multiple pieces of information from various sensors may be ambiguous, resulting in a failure to accurately acquire environmental information. Therefore, it is increasingly important for CAVs to communicate with other vehicles, pedestrians, and roadside facilities in order to establish a more intelligent and safe transportation system [130,131].

4.2.1. Vehicle-to-Everything Communication via NTN

The autonomous driving capabilities of CAVs rely on information from both onboard sensors and external connections. Cameras, Global Positioning Systems (GPS), and Light Detection and Ranging (LIDAR) are typical sensors onboard CAVs. The external connections of vehicles include Vehicle-to-Infrastructure (V2I), Vehicle-to-Vehicle (V2V), Vehicle-to-Cloud (V2C), and finally Vehicle-to-Everything (V2X), which are established via communication methods like cellular or direct communication [130,131,132,133]. The future development of 6G technology holds promise for enabling the V2X prospects through an advanced communication network that is flexible, high-speed, ultra-reliable, and has low-latency for information interactions between CAVs and other infrastructure. This will be achieved through the comprehensive integration of terrestrial and non-terrestrial networks. It is believed that 6G communication technology will better satisfy the requirements of the next-generation V2X in remote and uncovered areas via satellite and UAV communication. Furthermore, in the case of cloud/edge-based real-time tasks for CAVs, a reliable and low-latency connection is of extreme importance. With NTN communication technology, the data transmitting and offloading between CAVs and external devices can achieve an ultra-low latency of less than 1 ms [134,135,136].
To enable autonomous driving in intelligent transportation systems, CAVs must maintain connections with various vehicles and roadside units (RSUs) in a real-time manner. This connection is vital for accurate traffic perception, automatic navigation, and collision avoidance of CAVs. With the advancement of cellular-vehicle-to-everything (C-V2X) technology, the utilization of V2X present high demands for extensive network coverage, offloading computation-intensive task, low latency, and stringent reliability. This presents new challenges for communication systems. Due to the high deployment cost and strict location selection requirements, conventional terrestrial base stations cannot guarantee wide area coverage of V2X applications. Therefore, UAV-assisted V2X was introduced as a non-terrestrial means with flexibility and ease of deployment to support CAV wireless communication.
Non-terrestrial networks tend to be an effective means for V2X communications. UAV non-terrestrial networks show promise for estabilishing V2X connections scenarios where signal blockage occurs due to buildings and challenging terrains. However, UAV-based V2X communication still faces underlying challenges, including ultra-low latency communication, limited battery life, high volume communication, and low access efficiency. A variety of studies have been published on non-terrestrial UAV V2X communication for CAVs, addressing issues such as low-latency vehicle-to-vehicle communication, energy consumption optimization, and channel prediction. Researchers [137] analyzed rotary-wing and fixed-wing unmanned aerial vehicles as CAV network access points, using millimeter-wave technology for high-speed connectivity to CAVs (Figure 5). Based on the study results, UAV HAPS systems outperformed low Earth orbit satellites (LEOs) in terms of lower latency. To address the latency issues of CAV V2X communication [138], explored a scheme involving UAV-assisted deployment of roadside units, with a focus on minimizing CAV latency while also optimizing CAV energy consumption. To address the requirements of vehicular platooning or formation control issues, a study in [139] evaluated a UAV-V2X network in the context of UAV unstable motion. The evaluation involved the use of association probability for a vehicular-to-UAV link, while vehicular-to-vehicular links were modeled using the Poisson point process. In V2X connections, data dissemination is essential for sharing information between CAVs. In reference [140], a novel dynamic path-planning method for a UAV base station was employed to optimize the data dissemination process by minimizing communication overhead. This method aimed to enable efficient data caching in V2X networks.

4.2.2. 6G NTN-Enabled CAV Capabilities

The autonomous driving of CAVs is a major application of 6G NTN communication and will facilitate fully automated CAV applications in a variety of ways. In the future, with ubiquitous 6G communication coverage, CAVs will be capable of interconnecting with nearby vehicles, RSUs, pedestrians, and other elements. This capability is essential for achiveing fully automated self-driving and enhancing the safety of intelligent transportation systems. NTN-enabled V2X communication holds potential in various scenarios for fully automated CAVs, including vehicle localization, navigation, environment perception, platoon formation, and real-time control. For example, UAVs can function as flying base stations or RSUs, capable of sending accident broadcasts and early warnings to vehicles on highways through reliable line-of-sight links, thereby enhancing road safety.
From the perspective of upcoming 6G technology, edge computing plays an increasingly important role in the context of CAVs. Due to limited computing and storage resources, external resources are necessary to provide data storage and computing offloading services [141]. In dynamic road intersections, vehicular edge computing systems need to be much more flexible, intelligent, and adaptive than stationary systems [142]. To tackle this problem, in [141], the potential for implementing vehicular edge computing using NTN was explored. This approach would allow connected autonomous vehicles to transfer large computing tasks to UAVs or HAPS. In the past few years, UAV and HAPS platforms have been widely used to enhance the communication and computation capabilities of ground vehicles in applications such as traffic monitoring in complex environments. The authors in [143] proposed a dynamic topology optimization method for transmitting traffic monitoring information using UAVs. In [144], a systematic approach was implemented to optimize the computation offloading for traffic data collected by UAVs. The aforementioned approach dealt with the the issues of UAV computation task offloading utilizing a game-based model.
The autonomous navigation of CAVs is based on precise position and orientation information relative to high-definition maps, which is crucial to autonomous driving. The emergence of NTN V2X communication technology presents new opportunities for improved vehicular localization and navigation. In remote areas such as mountains and deserts, terrestrial cellular networks are not always available. Therefore non-terrestrial networks, such as UAVs and satellites, can be utilized to achieve the localization of CAVs [145,146,147]. Researchers in [145] proposed a relative localization method for CAVs using UAVs. This method involves making time delay measurements with multiple nodes to determine the relative position of CAVs. Furthermore [146], addressed the optimal UAV swarm configuration problem in vehicle localization They utilized reinforcement deep Q-learning was utilized to optimize localization based on signal strength.
Platoon formation coordination is widely discussed in applications of CAVs to improve control robustness and reduce fuel consumption. In a UAV V2X scenario, the dynamic motion of vehicles and changing road situation brings about great challenges for continuous vehicle-to-vehicle communication. In [148], UAV platforms were utilized as mobile communication relays to assist with inter-vehicle communication. To avoid the failure of multi-user detection caused by obstacles, the power allocation in non-orthogonal multiple access (NOMA) system was optimized with a low signal overhead strategy. Taking into account the maneuverability of CAVs [149,150], used comprehensive joint methods considering mobility, communication, and energy consumption problems to establish V2X connections for vehicle platoon tasks.
Table 4. Summary of previous work concerning CAVs in 6G NTN communication.
Table 4. Summary of previous work concerning CAVs in 6G NTN communication.
LiteratureTopicsContributionsLimitations
[143]Traffic monitoring in complex environmentsUtilizing blockchain-based UAV/HAPS communication to assist traffic perception data transmissionThe architecture of internet of drones need further study.
[144]Traffic monitoring in complex environmentsOffloading/sharing decision making using a sequential game methodThe edge computing architecture was not mentioned in detail
[145]LocalizationUtilizing UAV-based method to assist localizationThe moving vehicles and terrain blockage severely impact UAV–vehicle communication
[146]Localization Achieve vehicle localization with signal strength with a swarm of UAVsThe interference and uncertainty of wireless channel hindered the reliability of communication.
[147]Vehicle platoon controlA sliding mode controller was proposed based on the observed vehicle states for longitudinal cooperation of CAVsInter vehicle information was not discussed.
[148]Vehicle platoonPower allocation of uplink NOMA in vehicle platoonThe platoon method needs in-depth discussion
[149]Vehicle platoonJoint resource optimization and mobility control of UAV-aided vehicles platoonThe role of vehicle platoon in MEC require in-depth study
[150]Vehicle platoonJoint Communication and Computation Resource Scheduling of a UAV-Assisted Mobile Edge Computing System for Platooning VehiclesThe wireless power transmission mechanism of vehicles require investigation.
[151]Vehicle platoonAn energy consumption minimization-based resource management paradigm was proposedThe platoon method of the ground vehicle was not covered
The existing literature on NTN V2X applications is summarized in Table 4, along with the challenges and unresolved issues of the mentioned works. As shown in Table 4, the use of NTN-based V2X technology can enhance tasks such as localization, perception and object detection through NTN communication. CAVs can maintain reliable and high-throughput connections through NTN V2X communications in areas with insufficient terrestrial infrastructure for real-time traffic information interactions. This significantly enhances the safety and reliability of fully automated transportation systems. Based on data from V2X communications, CAVs are capable of controlling themselves in a safer manner, thereby avoiding accidents and road damage that occur beyond the line of sight of onboard sensors. However, the growing complexity of V2X communication systems also raise concers about security problems, particularly in UAV air-to-ground channels. With the advancement of CAVs and NTN communication technologies, the realization of an autonomous transportation system will be established in both cities and remote areas. With the support of UAVs, the overall safety of intelligent transportation systems will be enhaced through early warning and air-to-ground cooperation [152,153,154,155,156].
Intelligent Reflection Surfaces (IRS) are an emerging field that has drawn much attention from researchers in the 6G mobile communications field. In addition to the successful implementation of UAVs in V2X connections, IRS shows promise as a communication relay in V2X scenarios. It can be deployed as an aerial IRS with UAVs or other aerial vehicles serving as payload platforms. Researchers [153] proposed a case study of a UAV-assisted network for CAVs V2X network utilizing random scattering by an IRS. Researchers [157] proposed a 5G-based IRS communication for secure V2X to enable applications such as advanced self-driving and extended sensing in the case of a UAV–V2X scenario. Open issues, such as the placement of UAV–IRS platforms, optimization of beamforming and IRS supported edge computing, are promising directions for further investigation [156,157].

4.3. Unmanned Maritime Vehicles in UAV-Aided NTN Communication

Maritime network traffic has grown rapidly in the past few years due to the significant expansion development of manned and unmanned platforms utilized for national defense, scientific research, oceanic surveys, and international shipments [158]. In the new era of 6G communications, the vision of ubiquitous wireless coverage has brought new insight into the full-dimensional network architecture that integrates space, air, ground, and sea networks. Compared to terrestrial networks, maritime communication is far from satisfactory and requires thorough investigation.
Non-terrestrial networks have created new opportunities for maritime applications, particularly unmanned maritime vehicles, which have critical communication needs due to the challenges of deploying terrestrial communication infrastructure in ocean areas. Unmanned Maritime Vehicles enconpass unmanned surface vehicles (USVs) and unmanned underwater vehicles (UUVs) [158,159,160,161]. An unmanned surface vessel is a promising platform capable of performing hazardous and labor-intensive tasks typically carried out by manned vessels. With advanced control, perception, and communication systems, Unmanned Maritime Vehicles (UMVs) are capable of performing various military and civil tasks, such as search and rescue, reconnaissance, transportation, waste clearance, and resource survey. With the advancements in integrating high-capacity and ultra-reliable non-terrestrial network technologies, ubiquitous maritime connectivity can be achieved to support UMV applications.

4.3.1. Unmanned Surface Vessels in NTN Communication

Currently, maritime communication heavily relies on satellite and radio communications which are unable to meet the growing demand for broadband communication in maritime unmanned autonomous intelligent systems. However, satellite communication cannot support real-time maritime applications because of high propagation delays. On the other hand, radio communications, such as very high-frequency (VHF) communication, typically only support voice services, with limited bandwidth for high data rate communication.
(1)
UAV-Aided Maritime Communication for USVs
Thanks to the successful application of UAV air-to-ground non terrestrial network, the maritime communication have seen possibilities of adopting UAVs for oceanic communication. The ultra-low latency feature of UAV-assisted networks will shed new light on the maritime UAIS applications such as control and coordination of multiple USVs. However, there is a long way to go for applying UAVs to maritime communication since the limitation of endurance, power consumption and all weather capabilities of UAVs. The UAVs usually are not designed for the salty and misty environments and long time of operation over the sea may cause mechanical and electrical failures. Secondly, the energy of UAVs is quite limited which prevent it from operating for long time network coverage for typical long endurance maritime applications. In addition, in extreme weather conditions, such as tornadoes and storms, very few kinds of UAVs are capable of normal operation. Thus, various obstacles appear in the path of UAV maritime communication applications. However, maritime radio channels are complicated and are seriously affected by adverse weather conditions, tide movements, ocean current activity and other factors, causing problems in air-to-sea channel modeling in oceanic communication [162].
Topology optimization: Due to the continuous maneuvering of oceanic nodes such as USVs, the design and maintenance of their topology is also challenging. Topology design is a fundamental issue that needs to be addressed, given the constantly changing nature of the maritime environment. In [163], an integrated communication framework for terrestrial, sea and HAP is proposed for multi-USV control. The authors of the paper considered the inter-USV distance and channel interference to maintain the stable handover of the network while USVs are maneuvering at high speed. The authors of [163] proposed an integrated network architecture for terresstrial, maritime, and high altitude platform for UAV and USV cooperative communication. The proposed architecture considered the switching cost caused by node mavuering and link interference using a reinforcement-learning-based whale optimization method. Furthermore [164], proposed a multi-USV group communication scheme in which the total communication cost was minimized using a nested-ring algorithm for topology optimization that considered the factor of occlusion, weather, and inter USV distance.
Formation control: Formation control is a critical issue because multi-USV systems can accomplish complex tasks that a single USV cannot achieve. The main challenge of formation control is the need for dependable and low-latency communication for collaboration between USVs. In the USV group network, the interval distance between USVs and interference from nearby nodes tend to increase time delays and decrease network throughput. Therefore, unmanned aerial vehicles (UAVs) are introduced as effective means to support cooperative communication with USVs, building a combined network of air and sea using UAVs [165].
To create a secure and efficient network for UAV-USV formation, cooperative communication was employed, taking into account the time-varying topology and node locations [166]. The efficiency of formation tasks was severely affected by the communication between UAV and USV. Therefore, a communication scheme based on ad-hoc network architecture with node position information for UAV-USV communication was investigated. Researchers of [167] proposed a self-adapted synchronized event-triggered formation control strategy aimed at decreasing communication burden. A formation control method for under-actuated USVs was studied using dynamic surface control. Inspired by the event-triggered mechanism, the authors of [168] also proposed a formation control scheme utilizing sliding mode control protocols within a fixed time. By employing the dynamic event-triggered approach, the system updated the controller status less frequently, thereby reducing the consumption of communication resources
Cooperative task coordination: In cooperative tasks such as maritime rescue, surveillance, and harbor security, the UAV-USV cooperative mechanism heavily relies on reliable communications between them. A variety of studies have focused on the challenges of communication during UAV-USV cooperative operation since the oceanic environments have major impact on the communication system due to adverse weather and challenging channel conditions.
The end-to-end delay, network throughput, and packet loss probability should be carefully optimized [169,170]. The authors of reference [169] introduced a communication framework between UAVs and USVs for time-critical applications. According to previous research [171,172], the communication range of UAV significantly affects the cooperation efficiency of the UAV–USV system. The authors of reference [173] proposed a UAV–USV cooperative perception scheme for coastal monitoring utilizing UAV–UGV cooperative platforms as communication relays. Additionally, a joint object detection algorithm was proposed using an enhanced CenterNet model. For UAV–USV cooperation, mobile edge computing schemes have also been applied to the maritime Internet of Things (MIoT) [174].
(2)
USV-assisted maritime communications
The limited flight duration time and inability to operate in adverse weather conditions severely impacted the usability of UAVs in maritime communication. With its long endurance and all-weather operation capability, USV is a promising solution for providing three-dimensional and ubiquitous network coverage for oceanic operations in maritime NTNs. The use of USVs for maritime communication is a promising research area that can be integrated with UAV non-terrestrial networks to expand communication coverage for unmanned maritime platforms. In contrast to ground or air communications, maritime communications advancements are far from satisfactory in achieving ubiquitous wireless connectivity. USV with autonomous maneuverability and self-determination abilities offer a promising solution for extending oceanic network connectivity and improving quality of service.
In [175], a novel method is introduced for mobile relaying assisted by USVs to demonstrate the application of utilizing USVs in maritime non-terrestrial wireless communications. On the other hand, USVs can be utilized for data collection purposes to collect seabed-based data, in support of the underwater internet of things (UIoT) [176,177]. Ref. [178] utilized MIoT for maritime transportation systems. However, in [179], by combining the satellite network and USV-assisted wireless communication, a hybrid communication scheme was proposed to maximize the communication throughput and coverage.
The recent advancement of NTN in maritime are sumarized in Table 5. However, maritime NTN communications are still in the early stages of research, and several problems still need further investigation in the field of maritime communication applications, which include maritime channel conditions, maritime mobile edge computing, data security, and UAV–USV–satellite communication coordination [179]. For instance, MIoT is a vital issue in maritime information exchange and is worth in-depth investigation.

4.3.2. Unmanned Underwater Vehicles in Underwater Communications

Unmanned underwater vehicles have much potential in fulfilling sophisticated missions that are dangerous or impossible for humans to accomplish. For applications of unmanned underwater vehicles (UUVs) or autonomous underwater vehicles (AUVs), communication is even more sophisticated, as underwater communication channels have been barely investigated by research scientists. The rapid development of wireless communications has extended from terrestrial to aerial spaces to enhance user connectivity in NTN. However, the underwater wireless communications are rarely discussed, despite being an essential component of 6G NTN networks.
Underwater communication is achieved via multiple means including radio signals, acoustic communication, lasers, and cabled communication. However, due to physical constrains, underwater communication cannot be achieved using a straightforward means, since radio communication is nearly impossible in the underwater scenario. Underwater communication is typically achieved using USV and buoys, which serve as gateway for radio communication and various underwater communication methods. Ref. [180] proposed a hybrid underwater communication scheme integrating acoustic, optical, and fiber optic communications to support underwater applications. Cabled communication is a traditional method because conventional radio transmission is nearly impossible in underwater environments. An applicable network architecture was investigated by [181] utilizing a hybrid network between cable-assisted communications and wireless underwater communications in which cable-based sink nodes and tethered cable UUVs were utilized to provide short-distance communication for autonomous underwater vehicles.
Formation Control: With the advancement of underwater communication in the 6G era, AUVs are widely utilized as nodes in underwater communication network, posing challenges related to formation control and collision avoidance of AUVs in complex underwater scenarios. The stable formation and safe operation of AUVs in underwater environments is beneficial for network topology management and network robustness. Ref. [182] investigated a formation control paradigm with a heterogeneous underwater communication method for AUVs under communication constraints. Ref. [183] proposed a framework utilizing a fusion control method with a distributed mechanism to accomplish real-time formations in underwater wireless communication environments. The authors of [184] considered the formation control and collision avoidance problem in a multi-agent system involving UAVs, USVs, and UUVs. In this work, to fulfill the formation control task, the communication between USVs and UUVs were achieved using moving buoys to maintain the cross-media communication topology.
Localization and Navigation: Localization is a critical issue for AUVs in underwater NTN networks. However, the conventional satellite positioning method might be unsuitable for deep-water applications. The localization method can be divided into stand-alone and cooperative positioning methods. For the stand-alone localization method, AUVs estimate their position based on globally collected information. A simple cost-efficient method is proposed to globally estimate the AUV position in [185]. In [186], the authors emphasized on the angle of arrival model for cooperatively extracting positions of multiple targets. The proposed scheme evaluated three-dimensional position information through D-optimality criterion. The authors of [187] examined the impact of changes in propagation speed relative to water depth and clock synchronization on achieving improved accuracy of position estimation. In [188], the proposed approach combined maximum likelihood estimation and the Gaussian belief method to mitigate the effects of noise and non-linearity in the formula.
USV-AUV Cooperation: Form recent literature, AUVs are typically utilized in coordination with USVs or other platforms to collectively fulfill tasks as USVs have stronger communication and perception capabilities compared to AUVs. Furthermore, USVs are also considered as communication hubs for accessing maritime radio networks and underwater communication simultaneously, performing the role of air-to-underwater gateway. Researchers [189] emphasized the influence of the random wave fluctuation in underwater acoustic communication for USVs in underwater node communication. Ref. [190] proposed an AUV–USV system for search tasks in which acoustic communication is used for the USVs to transmit perception information to AUVs, while wireless radio was utilized among a group of USVs. In this application, satellite communication was also introduced to assist USV localization, thereby forming a space-sea-underwater network architecture. In reference [191], a communication scheme for UAVs and underwater drones was introduced, and the pros and cons of multiple underwater communication methods were summarized.
Open issues still exist in the domain of underwater unmanned autonomous system communication, such as cross-medium communication, visible light communication (VLC) [192], software-defined underwater networks [193], and information security. Cross-medium communication is derived from the challenge of directly merging underwater access networks with contemporary terrestrial networks with water–air signal conversion. Acoustic millimeter-wave communication is realized as the water–air interface [194]. Ref. [195] proposed a blockchain-enabled secure underwater communication system for unmanned underwater drones in oceanic special classification. Nevertheless, the aforementioned issues require further discussion.

5. A Case Study of UAV NTN Airborne Network in Mountainous Area

Unmanned aerial vehicles are ideal platforms for carrying network equipment, such as cellular base stations, to provide communication network coverage to ground users. They serve as flying base station platforms in an NTN use case. Cellular networks utilizing UAVs as airborne base stations have shown great potential to expand the service area for users as needed.. For multiple UAV base stations, it is worth noting that an effective and efficient handover scheme is crucial for ensuring the quality of service (QoS).
In rural or mountainous areas, wireless communication coverage is not always accessible due to cost-inefficiency or the impossibility of building the terrestrial infrastructure required. Due to environmental factors such as inclement weather, rugged terrain and diverse vegetation, communication coverage is unstable. The unreliable information transmission network coverage result in service interruptions, signifcantly impacting the daily lives of the residents living in those areas and hindering tasks such as disaster management.
To tackle this issue, utilizaing UAV airborne NTNs is a feasible approach for providing wireless communication services in this particular scenario. The UAV planning of UAV in NTN communication service and data transmission optimization architecture is a crucial issue that necessitates the use of technologies such as network coding, multi-path transmission, and real-time task offloading to greatly enhance the real-time operation and reliability of communication networks [196,197,198].

5.1. Design of Field Trial of UAV NTN Network System

To assess the practicality of a UAV NTN airborne network in mountainous regoins for disaster relief operations and natural resource exploration, a thorough field trial is planned and executed. Here, we introduce the experimental system component and conduct a more in-depth study of the proposed case.
In this case, a group of UAVs are utilized to provide airborne network coverage for mountainous regoins (Figure 6). To provide emergency coverage and service using NTN communication, UAVs are considered flexible and easy-to-deploy platforms for carrying base stations. In Figure 6, we illustrate the setup of multiple UAVs achieving NTN emergency communication coverage. As for the platform, we select the rainbow CH-4 fixed-wing UAV as the carrier platform for NTN communication, which is developed and manufactured by the China Academy of Aerospace Aerodynamics, an entity under the China Aerospace Science and Technology Corporation (CASC). The take-off weight of CH-4 UAV is 1330 kg with a payload up to 345 kg and the flight endurance is over 40 h. The CH-4 platform is utilized to install 5G base stations and other equipment. In our solution, to support the wireless link from UAVs to the control center/nearby UAV, a satellite transceiver is also installed at the back of the UAV with a transmitting speed of 2 Mbps.
Non-terrestrial networks have gained significant attention due to the expansion of large-scale wireless communication networks coverage facilitated by the use of airborne platforms like satellites and UAVs. The network architecture of our field trial is divided into three layers. The top layer consists of a high-capacity communication satellite, which is used to transmit status information from UAVs to the remote control center and to send control instructions to the UAVs. In addition, satellite links are also utilized to maintain communications between UAVs. The middle layer of the network is composed of three interconnected fixed-wing CH-4 UAVs with 5G base stations onboard. The base stations onboard the UAVs are commercial base stations that operate at a frequency of 2.6 GHz, creating a multi-UAV coverage network. This setup is useful for verifying the performance of multi-UAV coverage in different applications and validating the multi-platform use case scenario, as interference may occur at certain radio frequencies in practical applications. The three fixed-wing UAVs are interconnected to each other via satellite networks. The ground layer of the network is utilized for the backhaul of UAV base stations. The UAV equipped with a the base station operating at the frequency of 2.6 GHz, is connected to a ground base station connecting to the UAV ground control center in the airport by means of a fiber optic transmission cable. Furthermore, MEC servers can also be integrated into the UAVs and robots offering low latency task offloading for end users.
The purpose of the field trial was to validate the usability of NTN communications for robotics and other applications in mountainous areas for post-disaster relief and rescue scenarios. The UAV NTN network is designed to provide ground communication coverage when ground communication infrastructure is crippled or unavailable. Various kinds of ground user equipment is needed to access the UAV network in disaster relief operations. In the field trials, the selected ground user equipment (UE) of the air-to-ground network include quadruped locomotion robots, rotary wing UAVs and cell phones. Robots are widely used in scientific studies and industry for surveillance, area perception, and other autonomous tasks, while in disaster management scenarios, multi-spectral cameras are mounted on the robot to spot the locations of wildfire points or people trapped after earthquakes. Multi-spectral images collected by cameras of relatively high-resolution require high data rates to be transmitted to cloud servers or disaster headquarters in order to post early warnings and identify victims. In mountainous disaster rescue scenarios, it is impossible for wheeled or tracked vehicles to move freely, and quadrupedal locomotion robots are utilized for rescue operations. Customer Premise Equipment (CPE) is mounted on the robot to provide access capabilities to the UAV 5G network. Cell phones are connected to a UAV base station with a frequency of 2.6 GHz, which is supported by most commercial operators.

5.2. Field Trial Results

5.2.1. Parameters

The field experiments were conducted on 11 January 2023 with several measurement points in the coverage area of the UAV on the ground. We managed to conduct the field trial with one rainbow CH-4 fixed-wing UAV to provide ground communication coverage. In the field trial test, a commercial 5G base station is mounted on the CH-4 fixed-wing UAV with a frequency of 2.6 GHz. The transmission power of the base station is 260 W with a 64 TR massive MIMO antenna. The trajectory of the UAV is designed as a circle with a radius of 3 km with a ground speed of 180 km/h and the flight height is set to 2 km above the ground (Figure 7). The map of field trial is shown in Figure 7 above with three test points marked red on the map. The trajectory of the UAV is shown in a black circle.

5.2.2. Results and Analysis

The images in Figure 8 show the scenes of field trials in mountainous and desert areas in the western part of China. To test the quality of service (QoS) of the communication network for the ground UEs, we establish three different measurement points near the center of the flight trajectory of UAVs. The experiments have successfully verified the ability of various kinds of UEs to access the network, edge computing resources, and intelligent services without the support of ground network infrastructure. The test results of the field trial are shown in Table 6 below. At measure point A, the user equipment is in a stationary setup, 3400 m away from the UAV. The downlink is stable with RSRP above −90 dBm with a maximum downlink speed of 17 Mbps and a maximum uplink of 756 Mbps. Additionally, the time delay is about 30 ms without offline phenomenon.
In terms of UAV communication coverage applications, this field trial has successfully validated the UAV NTN networks for mountainous area coverage with a network edge rate of 17 Mbps, a peak rate of 756 Mbps, an average delay of 21 ms, and a total system bandwidth of 240 MHz. In order to verify network flexibility, this field trial achieved on-demand coverage of 36 square kilometers and a peak coverage of approximately 180.3 square kilometers along a mountainous area. The collaborative networking provided by three UAVs in the airspace supported broadband transmissions for 41 users, with a system outage probability of less than 0.04% (Table 7).
Various application is verified through the UAV NTN communication, including text messages, video streams, robot operation system (ROS), and so on. With the support of NTN communication, a multi-robot collaboration experiment is also conducted with quadrupedal locomotion robots. Quadrupedal locomotion robot is a novel platform that is able to move in challenging terrain from the inspiration of locomotion of legged animals, which is effective in mountainous disaster rescue scenarios. Quadrupedal locomotion robot is a useful tool for disaster relief and area surveillance in complex environments such as mountainous or remote areas. In the field trial, a group of four robots equipped with multi-spectrum image sensors and customer premise equipment (CPE) is utilized to test coordination capabilities with collective behaviour under the support of the UAV NTN airborne network. During the field trial, the robots were connected to the UAV base station to maintain data links to the operator and nearby robots. The operator-to-robot control instruction delay is less than 20 ms, which is sufficient to support inter-robot collaboration tasks such as joint environmental perception, formation control, and collision avoidance. The above-mentioned capabilities are crucial in successful emergency management scenarios ranging from earthquake victims searching to dangerous item detection. During the field trial, a group of four quadrupedal locomotion robots formed a team to perform joint environmental perception tasks while maintaining fixed formation and collision avoidance via the UAV network. (Figure 9)
On the other hand, a long-range teleoperation experiment was also conducted during the test. The robot and the control terminal are all connected to the UAV base station, and the operator controls the robot via 5G UAV communication using the terminal equipment. It has been proven in the experiment that the robot can be teleoperated through a UAV network from a distance of up to 50 km. The result is show in Table 8.

5.3. Discussion

The field trial successfully demonstrated the feasibility of NTN in support of UAIS in a mountainous area with no preexisting communication network infrastructure. However, there are still technological challenges with the UAV NTN network for providing coverage in remote mountainous areas, which will be discussed below from different perspectives.
Firstly, intelligent service switching and network transmission coding optimization are required to address the issue of service interruption caused by dynamic changes in the UAV posture in complex on-site network environments. When multiple UAVs carrying 5G base stations transverse various terrains, user terminals will frequently switch between UAV 5G base stations, resulting in service interruptions and poor quality of service (QoS) in this scenario. The handover paradigm between base stations is of great importance, and further effort is required to investigate this issue.
The application of edge computing server onboard the UAV enables the perception of connection status, facilitating intelligent prediction and active planning of the base station handover paradigm. This ensures the continuity of the command and dispatching service during the base station handover. A network acceleration device utilizing forward error correction coding has been designed and implemented in a 5G multi-access environment. This device can simultaneously utilize multiple available communication links in a complex network environments to achieve efficient data transmission. In weak network environments with fluctuating wireless links, reducing the end-to-end packet loss rate and increasing the rate of multi-link aggregation transmission can address the challenges of poor reliability and the difficulty in ensuring stable services in mountainous communication environments.
Secondly, real-time computation offloading technology based on optimal transmission theory is urgently needed to solve the real-time response problem of unmanned aerial vehicles. Using the new technology of edge computing, different services with different requirements for computing resources and time limitations can be satisfied. In addition, global situation awareness needs to rely on the high-performance computing power of the rear cloud computing center, integrate image data, weather, and other multi-modal data for centralized computing, while control and dispatching applications with high real-time requirements such as trajectory planning need to be accomplished with low latency is processed on edge computing nodes. An intelligent task offloading algorithm that integrates optimal transmission theory and unmanned aerial vehicle control needs in-depth investigation. Considering the capabilities of the front and rear computing nodes and network bandwidth, the strategy can perform intelligent allocation and dynamic scheduling of computing tasks, maximizing the utilization of on-site computing and communication resources, improving data processing efficiency, and reducing the communication service response latency.
Finally, the field trial has revealed the problem of a lack of UAV online trajectory adjustment capabilities according to user QoS. In the field trial test, the trajectory of the UAV is controlled manually by human operators in the control center. The operator has no idea of user-end QoS status; therefore, they are unable to adjust the trajectory to enhance the performance of the user equipment. To handle this issue, an intelligent UAV trajectory control scheme considering user equipment QoS and channel status would benefit overall system performance, which is vital for improving users’ experience, especially at the cell edge. A heat map of user QoS might be a useful input for the online trajectory adjustment algorithm. In the next stage of research, we will consider the UAV trajectory adjustment method based on a QoS heat map to improve the user communication quality in UAV NTN for better practical usability.

6. Conclusions

While there has been notable progress in the development of UAIS and wireless mobile communication technology in recent years, the current focus of UAIS is primarily on applications that depend on terrestrial network infrastructure. To resolve the challenge of ubiquitous network coverage for various UAIS applications, we proposed insights into 6G UAV NTN communication-enabled UAIS capabilities, which is a promising inter-discipline field for future research in distributed computation, human-machine interaction, and multi-agent cooperation. The 6G NTN concept along with edge/fog/cloud computing and artificial intelligence will be a major driving force for the evolution of unmanned autonomous intelligent systems. Integrating 6G NTN capabilities, UAIS is capable of enabling a variety of applications including intelligent transportation system in smart city, disaster relief and management, smart agriculture, oceanic surveys and other intelligent applications to come. In this paper, we proposed a comprehensive review of the challenges and opportunities that non-terrestrial networks may bring about in the field of unmanned autonomous intelligent systems. A case study of UAV NTN communication was presented to demonstrate the application of UAV NTN technology for UAIS in regions where terrestrial network infrastructure is unavailable. From the literature review and case study, we can conclude that UAIS in non-terrestrial network technology is an emerging field that holds great potential in enabling space–air–ground–sea integrated ubiquitous coverage, which holds various application prospects and research opportunities. Much research effort and industrial implementation work are urgently needed to promote the realization of more efficient, human-friendly, self-organized UAIS integrated with non-terrestrial network concepts and technologies.

Author Contributions

Conceptualization, X.W. and Y.G. (Yang Guo); investigation, Y.G. (Yang Guo); resources, Y.G. (Yuan Gao); writing, original draft preparation, X.W.; writing, review and editing, Y.G. (Yuan Gao); funding acquisition, Y.G. (Yuan Gao). All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the National Natural Science Foundation of China (grant No. 62222121 and grant No. 62341110).

Conflicts of Interest

The authors declare no conflicts of interest.

References

  1. Kota, S.; Giambene, G. 6G Integrated Non-Terrestrial Networks: Emerging Technologies and Challenges. In Proceedings of the 2021 IEEE International Conference on Communications Workshops (ICC Workshops), Montreal, QC, Canada, 14–23 June 2021; pp. 1–6. [Google Scholar]
  2. Araniti, G.; Iera, A.; Pizzi, S.; Rinaldi, F. Toward 6G Non-Terrestrial Networks. IEEE Netw. 2022, 36, 113–120. [Google Scholar] [CrossRef]
  3. Hong, E.-K.; Lee, I.; Shim, B.; Ko, Y.-C.; Kim, S.-H.; Pack, S.; Lee, K.; Kim, S.; Kim, J.-H.; Shin, Y.; et al. 6G R&D vision: Requirements and candidate technologies. J. Commun. Netw. 2022, 24, 232–245. [Google Scholar]
  4. Beniiche, A.; Rostami, S.; Maier, M. Robonomics in the 6G Era: Playing the Trust Game with On-Chaining Oracles and Persuasive Robots. IEEE Access 2021, 9, 46949–46959. [Google Scholar] [CrossRef]
  5. Miao, Y.; Xu, J.; Chen, M.; Hwang, K. Drone enabled Smart Air-Agent for 6G Network. In Proceedings of the ICC 2022—IEEE International Conference on Communications, Seoul, Republic of Korea, 16–20 May 2022; pp. 1–6. [Google Scholar]
  6. Srinivasu, P.N.; Ijaz, M.F.; Shafi, J.; Woźniak, M.; Sujatha, R. 6G Driven Fast Computational Networking Framework for Healthcare Applications. IEEE Access 2022, 10, 94235–94248. [Google Scholar] [CrossRef]
  7. Sharma, G.P.; Sharma, G.P.; Patel, D.; Sachs, J.; De Andrade, M.; Farkas, J.; Harmatos, J.; Varga, B.; Bernhard, H.-P.; Muzaffar, R.; et al. Toward Deterministic Communications in 6G Networks: State of the Art, Open Challenges and the Way Forward. IEEE Access 2023, 11, 106898–106923. [Google Scholar] [CrossRef]
  8. Grieco, L.A.; Piro, G.; Petrosino, A.; Morosi, S.; Guidotti, A.; Tarchi, D.; Vanelli-Coralli, A.; Cianca, E.; Ruggieri, M.; Salvo, P.; et al. Integration of Terrestrial and Non-Terrestrial Networks for Automotive: Challenges and perspectives within the S11 RESTART project. In Proceedings of the 2023 AEIT International Conference on Electrical and Electronic Technologies for Automotive (AEIT AUTOMOTIVE), Modena, Italy, 17–19 July 2023; pp. 1–6. [Google Scholar]
  9. Mishra, D.; Vegni, A.M.; Loscrí, V.; Natalizio, E. Drone Networking in the 6G Era: A Technology Overview. IEEE Commun. Stand. Mag. 2021, 5, 88–95. [Google Scholar] [CrossRef]
  10. Birabwa, D.J.; Ramotsoela, D.; Ventura, N. Multi-agent deep reinforcement learning for user association and resource allocation in integrated terrestrial and non-terrestrial networks. Comput. Netw. 2023, 231, 109827. [Google Scholar] [CrossRef]
  11. Li, D.; Bao, N. Delay-Doppler Robust Spectrum Sharing of UAV and Terrestrial Systems Aided by Assistive Slots. IEEE Trans. Veh. Technol. 2021, 70, 7692–7704. [Google Scholar] [CrossRef]
  12. Ovatman, T.; Kurt, G.K.; Yanikomeroglu, H. An Accurate Model for Computation Offloading in 6G Networks and a HAPS-Based Case Study. IEEE Open J. Commun. Soc. 2022, 3, 1963–1977. [Google Scholar] [CrossRef]
  13. Vrind, T.; Rao, S.; Pathak, L.; Das, D. Deep Learning-based LAP Deployment and Aerial Infrastructure Sharing in 6G. In Proceedings of the 2020 IEEE International Conference on Electronics, Computing and Communication Technologies (CONECCT), Bangalore, India, 2–4 July 2020; pp. 1–5. [Google Scholar] [CrossRef]
  14. Jiang, W.; Han, B.; Habibi, M.A.; Schotten, H.D. The Road Towards 6G: A Comprehensive Survey. IEEE Open J. Commun. Soc. 2021, 2, 334–366. [Google Scholar] [CrossRef]
  15. Giordani, M.; Zorzi, M. Non-Terrestrial Networks in the 6G Era: Challenges and Opportunities. IEEE Netw. 2021, 35, 244–251. [Google Scholar] [CrossRef]
  16. Lu, H.; Zeng, Y.; Jin, S.; Zhang, R. Aerial Intelligent Reflecting Surface: Joint Placement and Passive Beamforming Design with 3D Beam Flattening. IEEE Trans. Wirel. Commun. 2021, 20, 4128–4143. [Google Scholar] [CrossRef]
  17. Vaezi, M.; Azari, A.; Khosravirad, S.R.; Shirvanimoghaddam, M.; Azari, M.M.; Chasaki, D.; Popovski, P. Cellular, Wide-Area, and Non-Terrestrial IoT: A Survey on 5G Advances and the Road Toward 6G. IEEE Commun. Surv. Tutor. 2022, 24, 1117–1174. [Google Scholar] [CrossRef]
  18. Gustavsson, U.; Frenger, P.; Fager, C.; Eriksson, T.; Zirath, H.; Dielacher, F.; Studer, C.; Parssinen, A.; Correia, R.; Matos, J.N.; et al. Implementation Challenges and Opportunities in Beyond-5G and 6G Communication. IEEE J. Microw. 2021, 1, 86–100. [Google Scholar] [CrossRef]
  19. Wang, Y.; Feng, W.; Wang, J.; Quek, T.Q.S. Hybrid Satellite-UAV-Terrestrial Networks for 6G Ubiquitous Coverage: A Maritime Communications Perspective. IEEE J. Sel. Areas Commun. 2021, 39, 3475–3490. [Google Scholar] [CrossRef]
  20. Azari, M.M.; Solanki, S.; Chatzinotas, S.; Kodheli, O.; Sallouha, H.; Colpaert, A.; Montoya, J.F.M.; Pollin, S.; Haqiqatnejad, A.; Mostaani, A.; et al. Evolution of Non-Terrestrial Networks From 5G to 6G: A Survey. IEEE Commun. Surv. Tutor. 2022, 24, 2633–2672. [Google Scholar] [CrossRef]
  21. 5G Non Terrestrial Networks White Paper. Available online: https://www.5gamericas.org/wp-content/uploads/2022/01/5G-Non-Terrestrial-Networks-2022-WP-Id.pdf (accessed on 29 December 2023).
  22. Cui, H.; Zhang, J.; Geng, Y.; Xiao, Z.; Sun, T.; Zhang, N.; Liu, J.; Wu, Q.; Cao, X. Space-air-ground integrated network (SAGIN) for 6G: Requirements, architecture and challenges. China Commun. 2022, 19, 90–108. [Google Scholar] [CrossRef]
  23. Waqar, N.; Hassan, S.A.; Mahmood, A.; Dev, K.; Do, D.-T.; Gidlund, M. Computation Offloading and Resource Allocation in MEC-Enabled Integrated Aerial-Terrestrial Vehicular Networks: A Reinforcement Learning Approach. IEEE Trans. Intell. Transp. Syst. 2022, 23, 21478–21491. [Google Scholar] [CrossRef]
  24. Hokazono, Y.; Kohara, H.; Kishiyama, Y.; Asai, T. Extreme Coverage Extension in 6G: Cooperative Non-terrestrial Network Architecture Integrating Terrestrial Networks. In Proceedings of the 2022 IEEE Wireless Communications and Networking Conference (WCNC), Austin, TX, USA, 10–13 April 2022; pp. 138–143. [Google Scholar] [CrossRef]
  25. Ozger, M.; Godor, I.; Nordlow, A.; Heyn, T.; Pandi, S.; Peterson, I.; Viseras, A.; Holis, J.; Raffelsberger, C.; Kercek, A.; et al. 6G for Connected Sky: A Vision for Integrating Terrestrial and Non-Terrestrial Networks. In Proceedings of the 2023 Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit), Gothenburg, Sweden, 6–9 June 2023; pp. 711–716. [Google Scholar] [CrossRef]
  26. Qi, W.; Wang, H.; Xia, X.; Mei, C.; Liu, Y.; Xing, Y. Research on Novel Type of Non Terrestrial Network Architecture for 6G. In Proceedings of the 2023 International Wireless Communications and Mobile Computing (IWCMC), Marrakesh, Morocco, 19–23 June 2023; pp. 1281–1285. [Google Scholar] [CrossRef]
  27. Hokazono, Y.; Kohara, H.; Kishiyama, Y.; Asai, T. 3D-Cell Control Technology for Frequency Sharing between HAPS and Terrestrial Systems. In Proceedings of the 2022 IEEE International Workshop on Electromagnetics: Applications and Student Innovation Competition (iWEM), Narashino, Japan, 29–31 August 2022; pp. 99–100. [Google Scholar] [CrossRef]
  28. Cody, T.; Beling, P.A. Applying Learning Systems Theory to Model Cognitive Unmanned Aerial Vehicles. In Proceedings of the 2023 IEEE Cognitive Communications for Aerospace Applications Workshop (CCAAW), Cleveland, OH, USA, 20–22 June 2023; pp. 1–4. [Google Scholar]
  29. Zakharin, F.; Ponomarenko, S. Unmanned aerial vehicle integrated navigation complex with adaptive tuning. In Proceedings of the 2017 IEEE 4th International Conference Actual Problems of Unmanned Aerial Vehicles Developments (APUAVD), Kiev, Ukraine, 17–19 October 2017; pp. 23–26. [Google Scholar]
  30. Wan, N.; Jia, X.; Lv, Y.; Jing, L. Antenna tilt optimization scheme of UAV base station in multi-cell millimeter wave communication system. In Proceedings of the 2021 International Conference on Electronics, Circuits and Information Engineering (ECIE), Zhengzhou, China, 22–24 January 2021; pp. 196–199. [Google Scholar] [CrossRef]
  31. Hwang, S.; Seo, B.-S.; Kim, D.H. UAV Position & Cell Partition Optimization Considering User Distribution and Data Rate in UAV Network. In Proceedings of the 2022 13th International Conference on Information and Communication Technology Convergence (ICTC), Jeju Island, Republic of Korea, 19–21 October 2022; pp. 533–535. [Google Scholar] [CrossRef]
  32. Qin, Z.; Liu, Z.; Han, G.; Lin, C.; Guo, L.; Xie, L. Distributed UAV-BSs Trajectory Optimization for User-Level Fair Communication Service with Multi-Agent Deep Reinforcement Learning. IEEE Trans. Veh. Technol. 2021, 70, 12290–12301. [Google Scholar] [CrossRef]
  33. Saxena, V.; Jaldén, J.; Klessig, H. Optimal UAV Base Station Trajectories Using Flow-Level Models for Reinforcement Learning. IEEE Trans. Cogn. Commun. Netw. 2019, 5, 1101–1112. [Google Scholar] [CrossRef]
  34. Yang, M.; Jeon, S.-W.; Kim, D.K. Optimal Trajectory for Curvature-Constrained UAV Mobile Base Stations. IEEE Wirel. Commun. Lett. 2020, 9, 1056–1059. [Google Scholar] [CrossRef]
  35. Bhandarkar, A.B.; Jayaweera, S.K. Optimal Trajectory Learning for UAV-Mounted Mobile Base Stations using RL and Greedy Algorithms. In Proceedings of the 2021 17th International Conference on Wireless and Mobile Computing, Networking and Communications (WiMob), Bologna, Italy, 11–13 October 2021; pp. 13–18. [Google Scholar] [CrossRef]
  36. Wu, S.; Pu, Z.; Liu, Z.; Qiu, T.; Yi, J.; Zhang, T. Multi-target Coverage with Connectivity Maintenance using Knowledge-incorporated Policy Framework. In Proceedings of the 2021 IEEE International Conference on Robotics and Automation (ICRA), Xi’an, China, 30 May–5 June 2021. [Google Scholar]
  37. Jiang, X.; Wu, Z.; Yin, Z.; Yang, W.; Yang, Z. Trajectory and Communication Design for UAV-Relayed Wireless Networks. IEEE Wirel. Commun. Lett. 2019, 8, 1600–1603. [Google Scholar] [CrossRef]
  38. Zhang, S.; Zhang, H.; He, Q.; Bian, K.; Song, L. Joint Trajectory and Power Optimization for UAV Relay Networks. IEEE Wirel. Commun. Lett. 2018, 22, 161–164. [Google Scholar] [CrossRef]
  39. Wang, Z.; Zhou, F.; Wang, Y.; Wu, Q. Joint 3D trajectory and resource optimization for a UAV relay-assisted cognitive radio network. China Commun. 2021, 18, 184–200. [Google Scholar] [CrossRef]
  40. Wu, Y.; Yang, W.; Guan, X.; Wu, Q. UAV-Enabled Relay Communication Under Malicious Jamming: Joint Trajectory and Transmit Power Optimization. IEEE Trans. Veh. Technol. 2021, 70, 8275–8279. [Google Scholar] [CrossRef]
  41. Lee, J.; Friderikos, V. Trajectory Planning for Multiple UAVs in UAV-aided Wireless Relay Network. In Proceedings of the ICC 2022—IEEE International Conference on Communications, Seoul, Republic of Korea, 16–20 May 2022; pp. 1–6. [Google Scholar] [CrossRef]
  42. Prasad, N.L.; Ramkumar, B. 3-D Deployment and Trajectory Planning for Relay Based UAV Assisted Cooperative Communication for Emergency Scenarios Using Dijkstra’s Algorithm. IEEE Trans. Veh. Technol. 2023, 72, 5049–5063. [Google Scholar] [CrossRef]
  43. Yin, D.; Yang, X.; Yu, H.; Chen, S.; Wang, C. An Air-to-Ground Relay Communication Planning Method for UAVs Swarm Applications. IEEE Trans. Intell. Veh. 2023, 8, 2983–2997. [Google Scholar] [CrossRef]
  44. Senadhira, N.; Durrani, S.; Zhou, X.; Yang, N.; Ding, M. Uplink NOMA for Cellular-Connected UAV: Impact of UAV Trajectories and Altitude. IEEE Trans. Commun. 2020, 68, 5242–5258. [Google Scholar] [CrossRef]
  45. Yang, D.; Dan, Q.; Xiao, L.; Liu, C.; Cuthbert, L. An efficient trajectory planning for cellular-connected UAV under the connectivity constraint. China Commun. 2021, 18, 136–151. [Google Scholar] [CrossRef]
  46. Hao, Q.; Zhao, H.; Huang, H.; Gui, G.; Ohtsuki, T.; Adachi, F. Deep Reinforcement Learning Aided Online Trajectory Optimization of Cellular-Connected UAVs with Offline Map Reconstruction. In Proceedings of the 2023 IEEE 97th Vehicular Technology Conference (VTC2023-Spring), Florence, Italy, 20–23 June 2023; pp. 1–5. [Google Scholar] [CrossRef]
  47. Zhan, C.; Zeng, Y. Energy Minimization for Cellular-Connected UAV: From Optimization to Deep Reinforcement Learning. IEEE Trans. Wirel. Commun. 2022, 21, 5541–5555. [Google Scholar] [CrossRef]
  48. Hu, S.; Yuan, X.; Ni, W.; Wang, X. Trajectory Planning of Cellular-Connected UAV for Communication-Assisted Radar Sensing. IEEE Trans. Commun. 2022, 70, 6385–6396. [Google Scholar] [CrossRef]
  49. Chowdhury, M.M.U.; Maeng, S.J.; Bulut, E.; Güvenç, İ. 3-D Trajectory Optimization in UAV-Assisted Cellular Networks Considering Antenna Radiation Pattern and Backhaul Constraint. IEEE Trans. Aerosp. Electron. Syst. 2020, 56, 3735–3750. [Google Scholar] [CrossRef]
  50. Chen, Y.J.; Huang, D.Y. Joint Trajectory Design and BS Association for Cellular-Connected UAV: An Imitation-Augmented Deep Reinforcement Learning Approach. IEEE Internet Things J. 2022, 9, 2843–2858. [Google Scholar] [CrossRef]
  51. Zhang, S.; Zhang, R. Trajectory Design for Cellular-Connected UAV Under Outage Duration Constraint. In Proceedings of the ICC 2019—2019 IEEE International Conference on Communications (ICC), Shanghai, China, 20–24 May 2019. [Google Scholar]
  52. Li, P.; Xie, L.; Yao, J.; Xu, J. Cellular-Connected UAV with Adaptive Air-to-Ground Interference Cancellation and Trajectory Optimization. IEEE Commun. Lett. 2022, 26, 1368–1372. [Google Scholar] [CrossRef]
  53. Amer, R.; Saad, W.; Marchetti, N. Mobility in the Sky: Performance and Mobility Analysis for Cellular-Connected UAVs. IEEE Trans. Commun. 2020, 68, 3229–3246. [Google Scholar] [CrossRef]
  54. Lee, J.; Friderikos, V. Interference-aware path planning optimization for multiple UAVs in beyond 5G networks. J. Commun. Netw. 2022, 24, 125–138. [Google Scholar] [CrossRef]
  55. Shiri, H.; Seo, H.; Park, J.; Bennis, M. Attention-Based Communication and Control for Multi-UAV Path Planning. IEEE Wirel. Commun. Lett. 2022, 11, 1409–1413. [Google Scholar] [CrossRef]
  56. Eldeeb, E.; Perez, D.E.; Sant'Ana, J.M.d.S.; Shehab, M.; Mahmood, N.H.; Alves, H.; Latva-Aho, M. A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks. In Proceedings of the 2022 Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit), Grenoble, France, 7–10 June 2022; pp. 172–177. [Google Scholar] [CrossRef]
  57. Mohsan, S.A.H.; Khan, M.A.; Alsharif, M.H.; Uthansakul, P.; Solyman, A.A.A. Intelligent Reflecting Surfaces Assisted UAV Communications for Massive Networks: Current Trends, Challenges, and Research Directions. Sensors 2022, 22, 5278. [Google Scholar] [CrossRef]
  58. Ahmed, S.; Kamal, A.E. Sky’s the Limit: Navigating 6G with ASTAR-RIS for UAVs Optimal Path Planning. In Proceedings of the 2023 IEEE Symposium on Computers and Communications (ISCC), Gammarth, Tunisia, 9–12 July 2023; pp. 582–587. [Google Scholar] [CrossRef]
  59. Eskandari, M.; Savkin, A.V. AI-based Navigation and Communication Control for a Team of UAVs with Reconfigurable Intelligent Surfaces Supporting Mobile Internet of Vehicles. In Proceedings of the 2023 IEEE Conference on Control Technology and Applications (CCTA), Bridgetown, Barbados, 16–18 August 2023; pp. 234–238. [Google Scholar] [CrossRef]
  60. Zhang, X.X.; Wang, Y.C. DeepMECagent: Multi-agent computing resource allocation for UAV-assisted mobile edge computing in distributed IoT system. Appl. Intell. 2023, 53, 1180–1191. [Google Scholar] [CrossRef]
  61. Wu, G.; Miao, Y.; Zhang, Y.; Barnawi, A. Energy efficient for UAV-enabled mobile edge computing networks: Intelligent task prediction and offloading. Comput. Commun. 2020, 150, 556–562. [Google Scholar] [CrossRef]
  62. Zhang, L.; Zhang, Z.-Y.; Min, L.; Tang, C.; Zhang, H.-Y.; Wang, Y.-H.; Cai, P. Task Offloading and Trajectory Control for UAV-Assisted Mobile Edge Computing Using Deep Reinforcement Learning. IEEE Access 2021, 9, 53708–53719. [Google Scholar] [CrossRef]
  63. Liu, B.; Wan, Y.; Zhou, F.; Wu, Q.; Hu, R.Q. Resource Allocation and Trajectory Design for MISO UAV-Assisted MEC Networks. Ieee Trans. Veh. Technol. 2022, 71, 4933–4948. [Google Scholar] [CrossRef]
  64. Han, D.; Shi, T. Secrecy Capacity Maximization for a UAV-Assisted MEC System. China Commun. 2020, 17, 64–81. [Google Scholar] [CrossRef]
  65. Gao, Y.; Guo, Y.; Wang, P.; Yang, S.; Wang, J.; Wang, X.; Ding, Y.; Lu, W.; Zhang, Y.; Huang, G.; et al. Secure Enhancement in NOMA-based UAV-MEC Networks. In Proceedings of the IEEE Infocom 2022—IEEE Conference on Computer Communications Workshops (Infocom Wkshps), New York, NY, USA, 2–5 May 2022. [Google Scholar]
  66. Lu, W.; Ding, Y.; Gao, Y.; Chen, Y.; Zhao, N.; Ding, Z.; Nallanathan, A. Secure NOMA-Based UAV-MEC Network Towards a Flying Eavesdropper. IEEE Trans. Commun. 2022, 70, 3364–3376. [Google Scholar] [CrossRef]
  67. Verma, A.; Bhattacharya, P.; Saraswat, D.; Tanwar, S.; Kumar, N.; Sharma, R. SanJeeVni: Secure UAV-Envisioned Massive Vaccine Distribution for COVID-19 Underlying 6G Network. IEEE Sens. J. 2023, 23, 955–968. [Google Scholar] [CrossRef]
  68. Cheema, M.A.; Ansari, R.I.; Ashraf, N.; Hassan, S.A.; Qureshi, H.K.; Bashir, A.K.; Politis, C. Blockchain-based secure delivery of medical supplies using drones. Comput. Netw. 2022, 204, 108706. [Google Scholar] [CrossRef]
  69. Shan, L.; Miura, R.; Matsuda, T.; Koshikawa, M.; Li, H.-B.; Matsumura, T. Vehicle-to-Vehicle Based Autonomous Flight Coordination Control System for Safer Operation of Unmanned Aerial Vehicles. Drones 2023, 7, 669. [Google Scholar] [CrossRef]
  70. Shrestha, R.; Bajracharya, R.; Kim, S. 6G Enabled Unmanned Aerial Vehicle Traffic Management: A Perspective. IEEE Access 2021, 9, 91119–91136. [Google Scholar] [CrossRef]
  71. Kumar, A.; Yadav, A.S.; Gill, S.S.; Pervaiz, H.; Ni, Q.; Buyya, R. A secure drone-to-drone communication and software defined drone network-enabled traffic monitoring system. Simul. Model. Pract. Theory 2022, 120, 102621. [Google Scholar] [CrossRef]
  72. Matracia, M.; Kishk, M.A.; Alouini, M.-S. UAV-Aided Post-Disaster Cellular Networks: A Novel Stochastic Geometry Approach. IEEE Trans. Veh. Technol. 2023, 72, 9406–9418. [Google Scholar] [CrossRef]
  73. Saif, A.; Dimyati, K.; Noordin, K.A.; Mosali, N.A.; Deepak, G.C.; Alsamhi, S.H. Skyward bound: Empowering disaster resilience with multi-UAV-assisted B5G networks for enhanced connectivity and energy efficiency. Internet Things 2023, 23, 100885. [Google Scholar] [CrossRef]
  74. Jin, N.; Gui, J.; Zhou, X. Equalizing service probability in UAV-assisted wireless powered mmWave networks for post-disaster rescue. Comput. Netw. 2023, 225, 109644. [Google Scholar] [CrossRef]
  75. Matracia, M.; Kishk, M.A.; Alouini, M.-S. On the Topological Aspects of UAV-Assisted Post-Disaster Wireless Communication Networks. IEEE Commun. Mag. 2021, 59, 59–64. [Google Scholar] [CrossRef]
  76. Bushnaq, O.M.; Mishra, D.; Natalizio, E.; Akyildiz, I.F. Chapter 9—Unmanned aerial vehicles (UAVs) for disaster management. In Micro and Nano Technologies, Nanotechnology-Based Smart Remote Sensing Networks for Disaster Prevention; Elsevier: Amsterdam, The Netherlands, 2022; pp. 159–188. [Google Scholar]
  77. Ejaz, W.; Ahmed, A.; Mushtaq, A.; Ibnkahla, M. Energy-efficient task scheduling and physiological assessment in disaster management using UAV-assisted networks. Comput. Commun. 2020, 155, 150–157. [Google Scholar] [CrossRef]
  78. Wu, K.-S.; He, Y.-R.; Chen, Q.-J.; Zheng, Y.-M. Analysis on the damage and recovery of typhoon disaster based on UAV orthograph. Microelectron. Reliab. 2020, 107, 113337. [Google Scholar] [CrossRef]
  79. Rodríguez-Piñeiro, J.; Liu, W.; Wang, Y.; Yin, X.; Lee, J.; Kim, M.-D. Deep Learning-Based Joint Communication and Sensing for 6G Cellular-Connected UAVs. In Proceedings of the 2022 16th European Conference on Antennas and Propagation (EuCAP), Madrid, Spain, 27 March–1 April 2022; pp. 1–2. [Google Scholar]
  80. Zheng, H.; Hong, H.; Tang, S. Model Predictive Static Programming Rendezvous Trajectory Generation of Unmanned Aerial Vehicles. In Proceedings of the 2019 IEEE International Conference on Unmanned Systems (ICUS), Beijing, China, 17–19 October 2019; pp. 415–420. [Google Scholar]
  81. Castelin, S.; Bernstein, P. A notional scenario for the use of unmanned system groups in littoral warfare. In Proceedings of the 2004 IEEE/OES Autonomous Underwater Vehicles, Sebasco, ME, USA, 17–18 June 2004; pp. 14–19. [Google Scholar]
  82. Lochtefeld, J.; Schlager, S.; Bryan, S.; Harbour, S.; Colter, J. Human Vs. Autonomous Agents: Drone racing and Obstacle Avoidance. In Proceedings of the 2022 IEEE/AIAA 41st Digital Avionics Systems Conference (DASC), Portsmouth, VA, USA, 18–22 September 2022; pp. 1–5. [Google Scholar]
  83. Monica, L. Low-Cost System Architecture Solutions for Small Unmanned Aircraft Traffic Management. In Proceedings of the 2021 IEEE/AIAA 40th Digital Avionics Systems Conference (DASC), San Antonio, TX, USA, 3–7 October 2021; pp. 1–6. [Google Scholar]
  84. Gao, Q.; Lei, T.; Yao, W.; Zhang, X.; Zhang, X. A health-aware energy management strategy for fuel cell hybrid electric UAVs based on safe reinforcement learning. Energy 2023, 283, 129092. [Google Scholar] [CrossRef]
  85. Zhang, W.; Zhai, C. Coverage Control of Unmanned Aerial Vehicles for Periodical Monitoring of Geohazards. In Proceedings of the 2021 IEEE International Conference on Unmanned Systems (ICUS), Beijing, China, 15–17 October 2021; pp. 293–298. [Google Scholar]
  86. Hakan, S.; Metin, C. Defining the Variables of a Remote Operation Monitoring Systems Onboard Unmanned Surface Vessels. In Proceedings of the 2022 6th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE), Yogyakarta, Indonesia, 13–14 December 2022; pp. 591–594. [Google Scholar]
  87. Meng, X. Reliability Allocation Method for Unmanned Underwater System Based on Intuitionistic Fuzzy. In Proceedings of the 2019 IEEE International Conference on Unmanned Systems and Artificial Intelligence (ICUSAI), Xi’an, China, 22–24 November 2019; pp. 67–70. [Google Scholar]
  88. Kumar MM, S.; Yadav, H.; Soman, D.; Kumar, A. Acoustic Localization for Autonomous Unmanned Systems. In Proceedings of the 2020 14th International Conference on Innovations in Information Technology (IIT), Al Ain, United Arab Emirates, 17–18 November 2020; pp. 69–74. [Google Scholar]
  89. Kubyshkin, E.P.; Petukhov, P.E.; Vishnyakov, D.Y. Simulation of Network Traffic of the Information Exchange and Control System of a Group of Unmanned Aerial Vehicles. In Proceedings of the 2022 Systems of Signal Synchronization, Generating and Processing in Telecommunications (SYNCHROINFO), Arkhangelsk, Russia, 29 June–1 July 2022; pp. 1–4. [Google Scholar]
  90. Janssen, R.; van de Molengraft, R.; Bruyninckx, H.; Steinbuch, M. Cloud based centralized task control for human domain multi-robot operations. Intell. Serv. Robot. 2016, 9, 63–77. [Google Scholar] [CrossRef]
  91. Scola, I.R.; Reyes, G.A.G.; Carrillo, L.R.G.; Hespanha, J.P.; Burlion, L. A Robust Control Strategy with Perturbation Estimation for the Parrot Mambo Platform. IEEE Trans. Control. Syst. Technol. 2021, 29, 1389–1404. [Google Scholar] [CrossRef]
  92. Collins, G.; Clausse, A.; Twining, D. Enabling technologies for autonomous offshore inspections by heterogeneous unmanned teams. In Proceedings of the OCEANS 2017—Aberdeen, Aberdeen, UK, 19–22 June 2017; pp. 1–5. [Google Scholar]
  93. Zhang, J.; Cui, H.; Yang, A.L.; Gu, F.; Shi, C.; Zhang, W.; Niu, S. An intelligent digital twin system for paper manufacturing in the paper industry. Expert Syst. Appl. 2023, 230, 120614. [Google Scholar] [CrossRef]
  94. Mourtzis, D. Smart Manufacturing and Tactile Internet Powered by 5G: Investigation of Current Developments, Challenges, and Future Trends. Procedia CIRP 2021, 104, 1960–1969. [Google Scholar] [CrossRef]
  95. Qiao, L.; Li, Y.; Chen, D.; Serikawa, S.; Guizani, M.; Lv, Z. A survey on 5G/6G, AI, and Robotics. Comput. Electr. Eng. 2021, 95, 107372. [Google Scholar] [CrossRef]
  96. Shojaeinasab, A.; Charter, T.; Jalayer, M.; Khadivi, M.; Ogunfowora, O.; Raiyani, N.; Yaghoubi, M.; Najjaran, H. Intelligent manufacturing execution systems: A systematic review. J. Manuf. Syst. 2022, 62, 503–522. [Google Scholar] [CrossRef]
  97. Glaroudis, D.; Iossifides, A.; Chatzimisios, P. Survey, comparison and research challenges of IoT application protocols for smart farming. Comput. Netw. 2020, 168, 107037. [Google Scholar] [CrossRef]
  98. Charania, I.; Li, X. Smart farming: Agriculture’s shift from a labor intensive to technology native industry. Internet Things 2020, 9, 100142. [Google Scholar] [CrossRef]
  99. Boursianis, A.D.; Papadopoulou, M.S.; Diamantoulakis, P.; Liopa-Tsakalidi, A.; Barouchas, P.; Salahas, G.; Karagiannidis, G.; Wan, S.; Goudos, S.K. Internet of Things (IoT) and Agricultural Unmanned Aerial Vehicles (UAVs) in smart farming: A comprehensive review. Internet Things 2022, 18, 100187. [Google Scholar] [CrossRef]
  100. Cavalaris, C. Chapter 9—Challenges and opportunities for cost-effective use of unmanned aerial system in agriculture. In Unmanned Aerial Systems in Agriculture; Academic Press: Cambridge, MA, USA, 2023; pp. 197–229. [Google Scholar]
  101. Debauche, O.; Trani, J.-P.; Mahmoudi, S.; Manneback, P.; Bindelle, J.; Mahmoudi, S.A.; Guttadauria, A.; Lebeau, F. Data management and internet of things: A methodological review in smart farming. Internet Things 2021, 14, 100378. [Google Scholar] [CrossRef]
  102. Yang, C.; Guo, S.; Guo, Y. Development of a Novel Remote Controller for Interventional Surgical Robots. In Proceedings of the 2019 IEEE International Conference on Mechatronics and Automation (ICMA), Tianjin, China, 4–7 August 2019; pp. 1964–1968. [Google Scholar]
  103. Seo, J.; Cho, J.H.; Cha, J.; Kim, C.; Kwon, O. Design and experimental evaluations of robot-assisted tele-echography system for remote ultrasound imaging. In Proceedings of the 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Jeju, Republic of Korea, 28 June–1 July 2017; pp. 592–594. [Google Scholar]
  104. Geng, C.; Xie, Q.; Chen, L.; Li, A.; Qin, B. Study and Analysis of a Remote Robot-assisted Ultrasound Imaging System. In Proceedings of the 2020 IEEE 4th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China, 12–14 June 2020; pp. 389–393. [Google Scholar]
  105. Xue, Z.; Zeng, J. Formation Control Numerical Simulations of Geometric Patterns for Unmanned Autonomous Vehicles with Swarm Dynamical Methodologies. In Proceedings of the 2009 International Conference on Measuring Technology and Mechatronics Automation, Zhangjiajie, China, 11–12 April 2009; pp. 477–482. [Google Scholar]
  106. Jin, Z.; Wang, C.; Liang, D.; Liang, Z.; Li, S. Robust cooperative output regulation for heterogeneous nonlinear multi-agent systems with an unknown exosystem subject to jointly connected switching networks. ISA Trans. 2023, 143, 59–78. [Google Scholar] [CrossRef]
  107. Mello, R.C.; Scheidegger, W.M.; Múnera, M.C.; Cifuentes, C.A.; Ribeiro, M.R.; Frizera-Neto, A. The PoundCloud framework for ROS-based cloud robotics: Case studies on autonomous navigation and human–robot interaction. Robot. Auton. Syst. 2022, 150, 103981. [Google Scholar] [CrossRef]
  108. Wang, Z.; Yang, S.; Xiang, X.; Vasilijević, A.; Mišković, N.; Nađ, Ð. Cloud-based remote control framework for unmanned surface vehicles. IFAC-Pap. 2020, 53, 14564–14569. [Google Scholar] [CrossRef]
  109. Dawarka, V.; Bekaroo, G. Building and evaluating cloud robotic systems: A systematic review. Robot. Comput.-Integr. Manuf. 2022, 73, 102240. [Google Scholar] [CrossRef]
  110. Bodkhe, U.; Tanwar, S. Network management schemes for IoT environment towards 6G: A comprehensive review. Microprocess. Microsyst. 2023, 103, 104928. [Google Scholar] [CrossRef]
  111. Tomaszewski, L.; Kołakowski, R. Mobile Services for Smart Agriculture and Forestry, Biodiversity Monitoring, and Water Management: Challenges for 5G/6G Networks. Telecom 2023, 4, 67–99. [Google Scholar] [CrossRef]
  112. 3GPP. Service Requirements for the 5G System; Stage 1; Technical Standard TS 22.261, ver. 19.1.0, 3rd Generation Partnership Project; Sophia Antipolis: Valbonne, France, 2022; Available online: https://portal.3gpp.org/desktopmodules/Specifications/SpecificationDetails.aspx?specificationId=3107 (accessed on 29 December 2023).
  113. Ranjha, A.; Kaddoum, G.; Dev, K. Facilitating URLLC in UAV-Assisted Relay Systems with Multiple-Mobile Robots for 6G Networks: A Prospective of Agriculture 4.0. IEEE Trans. Ind. Inform. 2022, 18, 4954–4965. [Google Scholar] [CrossRef]
  114. Polymeni, S.; Plastras, S.; Skoutas, D.N.; Kormentzas, G.; Skianis, C. The Impact of 6G-IoT Technologies on the Development of Agriculture 5.0: A Review. Electronics 2023, 12, 2651. [Google Scholar] [CrossRef]
  115. Zhu, A.; Zeng, Z.; Guo, S.; Lu, H.; Ma, M.; Zhou, Z. Game-theoretic robotic offloading via multi-agent learning for agricultural applications in heterogeneous networks. Comput. Electron. Agric. 2023, 211, 108017. [Google Scholar] [CrossRef]
  116. Xu, X.; Zhang, R.; Qian, Y. Location-Based Hybrid Precoding Schemes and QoS-Aware Power Allocation for Radar-Aided UAV–UGV Cooperative Systems. IEEE Access 2022, 10, 50947–50958. [Google Scholar] [CrossRef]
  117. Ying, B.; Su, Z.; Xu, Q.; Ma, X. Game Theoretical Bandwidth Allocation in UAV-UGV Collaborative Disaster Relief Networks. In Proceedings of the 2021 IEEE 23rd Int Conf on High Performance Computing & Communications, HPCC 2021, Haikou, China, 20–22 December 2021. [Google Scholar]
  118. Messaoudi, K.; Oubbati, O.S.; Rachedi, A.; Bendouma, T. UAV-UGV-Based System for AoI minimization in IoT Networks. In Proceedings of the ICC 2023—IEEE International Conference on Communications, Rome, Italy, 28 May–1 June 2023. [Google Scholar]
  119. Wei, Y.; Qiu, H.; Liu, Y.; Du, J.; Pun, M.O. Unmanned aerial vehicle (UAV)-assisted unmanned ground vehicle (UGV) systems design, implementation and optimization. In Proceedings of the 2017 3rd IEEE International Conference on Computer and Communications (ICCC), Chengdu, China, 13–16 December 2017. [Google Scholar]
  120. Cheng, C.; Li, X.; Xie, L.; Li, L. A Unmanned Aerial Vehicle (UAV)/Unmanned Ground Vehicle (UGV) Dynamic Autonomous Docking Scheme in GPS-Denied Environments. Drones 2023, 7, 613. [Google Scholar] [CrossRef]
  121. Blümm, C.; Heller, C.; Weigel, R. SDR OFDM Waveform Design for a UGV/UAV Communication Scenario. J. Signal Process. Syst. Signal Image Video Technol. 2012, 69, 11–21. [Google Scholar] [CrossRef]
  122. Shen, Y.; Wei, C. Target tracking and enclosing via UAV/UGV cooperation using energy estimation pigeon-inspired optimization and switchable topology. Aircr. Eng. Aerosp. Technol. 2023, 95, 768–783. [Google Scholar] [CrossRef]
  123. Chang, B.R.; Tsai, H.-F.; Lyu, J.-L.; Huang, C.-F. IoT-connected Group Deployment of Unmanned Vehicles with Sensing Units: iUAGV System. Sens. Mater. 2021, 33, 1485–1499. [Google Scholar] [CrossRef]
  124. Wang, Q.; Chen, H.; Tian, J.; Wang, J.; Su, Y. Biobjective UAV/UGV Collaborative Rendezvous Planning in Persistent Intelligent Task-Based Wireless Communication. Wirel. Commun. Mob. Comput. 2021, 9578783. [Google Scholar] [CrossRef]
  125. Yulong, D.; Bin, X.; Jie, C.; Hao, F.; Yangguang, Z.; Guanqiang, G.; Lihua, D. Path Planning of Messenger UAV in Air-ground Coordination. Ifac Pap. 2017, 50, 8045–8051. [Google Scholar] [CrossRef]
  126. Cao, H.; Zhao, H.; Jindal, A.; Aujla, G.S.; Yang, L. Gagangeet Singh Aujla and Longxiang Yang. Energy-Efficient Virtual Resource Allocation of Slices in Vehicles-Assisted B5G Networks. IEEE Trans. Green Commun. Netw. 2022, 6, 1408–1417. [Google Scholar] [CrossRef]
  127. Raja, G.; Manaswini, Y.; Vivekanandan, G.D.; Sampath, H.; Dev, K.; Bashir, A.K. AI-Powered Blockchain—A Decentralized Secure Multiparty Computation Protocol for IoV. In Proceedings of the IEEE INFOCOM 2020—IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS), Toronto, ON, Canada, 6–9 July 2020; pp. 865–870. [Google Scholar]
  128. Gad, A.R.; Nashat, A.A.; Barkat, T.M. Intrusion Detection System Using Machine Learning for Vehicular Ad Hoc Networks Based on ToN-IoT Dataset. IEEE Access 2021, 9, 142206–142217. [Google Scholar] [CrossRef]
  129. Gao, Y.; Wu, H.; Song, B.; Jin, Y.; Luo, X.; Zeng, X. A Distributed Network Intrusion Detection System for Distributed Denial of Service Attacks in Vehicular Ad Hoc Network. IEEE Access 2019, 7, 154560–154571. [Google Scholar] [CrossRef]
  130. Noor-A-Rahim, M.; Liu, Z.; Lee, H.; Khyam, M.O.; He, J.; Pesch, D.; Moessner, K.; Saad, W.; Poor, H.A. 6G for Vehicle-to-Everything (V2X) Communications: Enabling Technologies, Challenges, and Opportunities. Proc. IEEE 2022, 110, 712–734. [Google Scholar] [CrossRef]
  131. Yang, J.; Liu, S.; Su, H.; Tian, Y. Driving assistance system based on data fusion of multisource sensors for autonomous unmanned ground vehicles. Comput. Netw. 2021, 192, 108053. [Google Scholar] [CrossRef]
  132. Lv, H.; Wen, M.; Lu, R.; Li, J. An Adversarial Attack Based on Incremental Learning Techniques for Unmanned in 6G Scenes. IEEE Trans. Veh. Technol. 2021, 70, 5254–5264. [Google Scholar] [CrossRef]
  133. Liu, R.; Liu, A.; Qu, Z.; Xiong, N.N. An UAV-Enabled Intelligent Connected Transportation System with 6G Communications for Internet of Vehicles. IEEE Trans. Intell. Transp. Syst. 2023, 24, 2045–2059. [Google Scholar] [CrossRef]
  134. Németh, B.; Antal, Z.; Marosi, A.C.; Lovas, R.; Fazekas, M.; Gáspár, P. Vehicle Control with Cloud-aided Learning Feature: An Implementation on Indoor Platform. IFAC-Pap. 2022, 55, 227–232. [Google Scholar] [CrossRef]
  135. Chen, H.; Liu, J.; Wang, J.; Xun, Y. Towards secure intra-vehicle communications in 5G advanced and beyond: Vulnerabilities, attacks and countermeasures. Veh. Commun. 2023, 39, 100548. [Google Scholar] [CrossRef]
  136. Su, Y.-S.; Huang, H.; Daim, T.; Chien, P.-W.; Peng, R.-L.; Akgul, A.K. Assessing the technological trajectory of 5G-V2X autonomous driving inventions: Use of patent analysis. Technol. Forecast. Soc. Change 2023, 196, 122817. [Google Scholar] [CrossRef]
  137. Alamgir, M.S.; Kelley, B. Fixed Wing UAV-based Non-Terrestrial Networks for 5G millimeter wave Connected Vehicles. In Proceedings of the 2023 IEEE 13th Annual Computing and Communication Workshop and Conference (CCWC), Las Vegas, NV, USA, 8–11 March 2023; pp. 1167–1173. [Google Scholar]
  138. Demir, U.; Toker, C.; Ekici, Ö. Energy-Efficient Deployment of UAV in V2X Network Considering Latency and Backhaul Issues. In Proceedings of the 2020 IEEE International Black Sea Conference on Communications and Networking (BlackSeaCom), Odessa, Ukraine, 26–29 May 2020; pp. 1–6. [Google Scholar]
  139. Arif, M.; Hasna, M.O. Analysis of fluctuations of antenna pattern in U-V2X communications. Phys. Commun. 2023, 58, 102066. [Google Scholar] [CrossRef]
  140. Zhang, R.; Lu, R.; Cheng, X.; Wang, N.; Yang, L. Caching and File Sharing in V2X Networks. IEEE Trans. Commun. 2021, 69, 3930–3942. [Google Scholar] [CrossRef]
  141. Traspadini, A.; Giordani, M.; Zorzi, M. UAV/HAP-Assisted Vehicular Edge Computing in 6G: Where and What to Offload? In Proceedings of the 2022 Joint European Conference on Networks and Communications & 6G Summit (EuCNC/6G Summit), Grenoble, France, 7–10 June 2022; pp. 178–183. [Google Scholar]
  142. Hakak, S.; Gadekallu, T.R. Praveen Kumar Reddy Maddikunta, Swarna Priya Ramu, Parimala M, Chamitha De Alwis, Madhusanka Liyanage, Autonomous vehicles in 5G and beyond: A survey. Veh. Commun. 2023, 39, 100551. [Google Scholar]
  143. Singh, M.P.; Singh, A.; Aujla, G.S.R.; Bali, S.; Jindal, A. Referenced Blockchain Approach for Road Traffic Monitoring in a Smart City using Internet of Drones. In Proceedings of the ICC 2022—IEEE International Conference on Communications, Seoul, Republic of Korea, 16–20 May 2022; pp. 1–6. [Google Scholar]
  144. Alioua, A.; Djeghri, H.-e.; Cherif, M.E.T.; Senouci, S.-M.; Sedjelmaci, H. UAVs for traffic monitoring: A sequential game-based computation offloading/sharing approach. Comput. Netw. 2020, 177, 107273. [Google Scholar] [CrossRef]
  145. Liu, Y.; Li, W.; Lu, Q.; Wang, J.; Shen, Y. Relative Localization of Ground Vehicles Using Non-Terrestrial Networks. In Proceedings of the 2019 IEEE/CIC International Conference on Communications Workshops in China (ICCC Workshops), Changchun, China, 11–13 August 2019; pp. 93–97. [Google Scholar]
  146. Testi, E.; Favarelli, E.; Giorgetti, A. Reinforcement Learning for Connected Autonomous Vehicle Localization via UAVs. In Proceedings of the 2020 IEEE International Workshop on Metrology for Agriculture and Forestry (Metroagrifor), Trento, Italy, 4–6 November 2020; pp. 13–17. [Google Scholar]
  147. Wang, X.; Bian, Y.; Qin, X.; Hu, M.; Xu, B.; Xie, G. Finite-time Platoon Control of Connected and Automated Vehicles with Mismatched Disturbances. In Proceedings of the 2020 39th Chinese Control Conference (CCC), Shenyang, China, 27–29 July 2020; pp. 5613–5618. [Google Scholar]
  148. Sun, Y.; Zheng, K.; Tang, Y. Control Efficient Power Allocation of Uplink NOMA in UAV-Aided Vehicular Platooning. IEEE Access 2021, 9, 139473–139488. [Google Scholar] [CrossRef]
  149. Liu, Y.; Zhou, J.; Tian, D.; Sheng, Z.; Duan, X.; Qu, G.; Zhao, D. Joint Optimization of Resource Scheduling and Mobility for UAV-Assisted Vehicle Platoons. In Proceedings of the 2021 IEEE 94th Vehicular Technology Conference (Vtc2021-Fall), Norman, OK, USA, 27–30 September 2021. [Google Scholar]
  150. Liu, Y.; Zhou, J.; Tian, D.; Sheng, Z.; Duan, X.; Qu, G.; Leung, V.C.M. Joint Communication and Computation Resource Scheduling of a UAV-Assisted Mobile Edge Computing System for Platooning Vehicles. IEEE Trans. Intell. Transp. Syst. 2022, 23, 8435–8450. [Google Scholar] [CrossRef]
  151. Zhao, J.; Nie, Y.; Zhang, H.; Yu, F.R. A UAV-Aided Vehicular Integrated Platooning Network for Heterogeneous Resource Management. IEEE Trans. Green Commun. Netw. 2023, 7, 512–521. [Google Scholar] [CrossRef]
  152. Spampinato, L.; Tarozzi, A.; Buratti, C.; Marini, R. DRL Path Planning for UAV-Aided V2X Networks: Comparing Discrete to Continuous Action Spaces. In Proceedings of the ICASSP 2023—2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece, 4–10 June 2023; pp. 1–5. [Google Scholar] [CrossRef]
  153. Cao, Y.; Xu, S.; Liu, J.; Kato, N. Toward Smart and Secure V2X Communication in 5G and Beyond: A UAV-Enabled Aerial Intelligent Reflecting Surface Solution. IEEE Veh. Technol. Mag. 2022, 17, 66–73. [Google Scholar] [CrossRef]
  154. Liu, Y.; Wang, H.; Dong, C.; Chen, Y. A centralized relaxation strategy for cooperative lane change in a connected environment. Phys. A: Stat. Mech. Its Appl. 2023, 624, 128934. [Google Scholar] [CrossRef]
  155. Benyahya, M.; Collen, A.; Nijdam, N.A. Analyses on standards and regulations for connected and automated vehicles: Identifying the certifications roadmap. Transp. Eng. 2023, 14, 100205. [Google Scholar] [CrossRef]
  156. Mokhtarian, A.; Kampmann, A.; Lueer, M.; Kowalewski, S.; Alrifaee, B. A Cloud Architecture for Networked and Autonomous Vehicles. IFAC-Pap. 2021, 54, 233–239. [Google Scholar] [CrossRef]
  157. Haider, S.I.; Tan, S. V2X Reliability Enhancement Through NLOS Links from IRS Random Scattering. In Proceedings of the 2023 International Applied Computational Electromagnetics Society Symposium (ACES-China), Hangzhou, China, 15–18 August 2023; pp. 1–3. [Google Scholar]
  158. Saafi, S.; Vikhrova, O.; Fodor, G.; Hosek, J.; Andreev, S. AI-Aided Integrated Terrestrial and Non-Terrestrial 6G Solutions for Sustainable Maritime Networking. IEEE Netw. 2022, 36, 183–190. [Google Scholar] [CrossRef]
  159. Zhao, C.; Thies, P.; Lars, J.; Cowles, J. ROV launch and recovery from an unmanned autonomous surface vessel—Hydrodynamic modelling and system integration. Ocean. Eng. 2021, 232, 109019. [Google Scholar] [CrossRef]
  160. Cui, Z.; Guan, W.; Luo, W.; Zhang, X. Intelligent navigation method for multiple marine autonomous surface ships based on improved PPO algorithm. Ocean. Eng. 2023, 287 Pt 1, 115783. [Google Scholar] [CrossRef]
  161. Zhao, W.; Xia, Y.; Zhai, D.-H.; Cui, B. Adaptive event-triggered coordination control of unknown autonomous underwater vehicles under communication link faults. Automatica 2023, 158, 111277. [Google Scholar] [CrossRef]
  162. Nomikos, N.; Gkonis, P.K.; Bithas, P.S.; Trakadas, P. A Survey on UAV-Aided Maritime Communications: Deployment Considerations, Applications, and Future Challenges. IEEE Open J. Commun. Soc. 2023, 4, 56–78. [Google Scholar] [CrossRef]
  163. Cao, H.; Yang, T.; Yin, Z.; Sun, X.; Li, D. Topological optimization algorithm for HAP assisted multi-unmanned ships communication. In Proceedings of the 2020 IEEE 92nd Vehicular Technology Conference (VTC2020-Fall), Victoria, BC, Canada, 15 February 2021; pp. 1–5. [Google Scholar]
  164. Huang, Z.; Xue, K.; Wang, P.; Xu, Z. A nested-ring exact algorithm for simple basic group communication topology optimization in Multi-USV systems. Ocean. Eng. 2022, 266 Pt 5, 113239. [Google Scholar] [CrossRef]
  165. Zhang, B.; Wang, D.; Wang, J. Formation control for multiple heterogeneous unmanned aerial vehicles and unmanned surface vessels system. In Proceedings of the 2019 Chinese Automation Congress (CAC), Hangzhou, China, 22–24 November 2019; pp. 4920–4925. [Google Scholar]
  166. Ma, Y.; Zhao, Y.J.; Qi, X.; Zheng, Y.Z.; Gan, R.Z. Cooperative communication framework design for the unmanned aerial vehicles-unmanned surface vehicles formation. Adv. Mech. Eng. 2018, 10, 1687814018773668. [Google Scholar] [CrossRef]
  167. Zhang, G.; Bian, W.; Li, J.; Zhang, W. Robust adaptive synchronized event-triggered formation control of USVs with the fault amendment strategy. Ocean. Eng. 2023, 281, 114832. [Google Scholar] [CrossRef]
  168. Liu, H.; Weng, P.; Tian, X.; Mai, Q. Distributed adaptive fixed-time formation control for UAV-USV heterogeneous multi-agent systems. Ocean. Eng. 2023, 267, 113240. [Google Scholar] [CrossRef]
  169. Xue, K.; Rodríguez-Piñeiro, J.; Yu, Y.; Hong, J.; Yin, X.; Shunqin, X. Performance and Reliability of 5G Communications for USV-UAV Critical Applications. In Proceedings of the 2023 17th European Conference on Antennas and Propagation (EuCAP), Florence, Italy, 26–31 March 2023; pp. 1–5. [Google Scholar]
  170. Li, W.; Ge, Y.; Guan, Z.; Gao, H.; Feng, H. NMPC-based UAV-USV cooperative tracking and landing. J. Frankl. Inst. 2023, 360, 7481–7500. [Google Scholar] [CrossRef]
  171. Deng, T.; Xu, X.; Ding, Z.; Xiao, X.; Zhu, M.; Peng, K. Automatic collaborative water surface coverage and cleaning strategy of UAV and USVs. Digit. Commun. Netw. 2022. [Google Scholar] [CrossRef]
  172. Wang, Y.; Liu, W.; Liu, J.; Sun, C. Cooperative USV–UAV marine search and rescue with visual navigation and reinforcement learning-based control. ISA Trans. 2023, 137, 222–235. [Google Scholar] [CrossRef] [PubMed]
  173. Wu, J.; Li, R.; Li, J.; Zou, M.; Huang, Z. Cooperative unmanned surface vehicles and unmanned aerial vehicles platform as a tool for coastal monitoring activities. Ocean. Coast. Manag. 2023, 232, 106421. [Google Scholar] [CrossRef]
  174. Wang, Y.; Zheng, Y.; Liu, J. Secure Task Offloading and Resource Scheduling in Maritime Edge Computing Systems. In Proceedings of the 2023 IEEE/CIC International Conference on Communications in China (ICCC), Dalian, China, 10–12 August 2023; pp. 1–6. [Google Scholar]
  175. Wang, J.-B.; Zeng, C.; Ding, C.; Zhang, H.; Lin, M.; Wang, J. Unmanned Surface Vessel Assisted Maritime Wireless Communication Toward 6G: Opportunities and Challenges. IEEE Wirel. Commun. 2022, 29, 72–79. [Google Scholar] [CrossRef]
  176. Sun, X.; Zhang, L.; Song, D.; Wu, Q.M.J. A novel path planning method for multiple USVs to collect seabed-based data. Ocean. Eng. 2023, 269, 113510. [Google Scholar] [CrossRef]
  177. Zhao, L.; Bai, Y. Data harvesting in uncharted waters: Interactive learning empowered path planning for USV-assisted maritime data collection under fully unknown environments. Ocean. Eng. 2023, 287, 115781. [Google Scholar] [CrossRef]
  178. Yang, Y.; He, D.; Vijayakumar, P.; Gupta, B.B.; Xie, Q. An Efficient Identity-Based Aggregate Signcryption Scheme with Blockchain for IoT-Enabled Maritime Transportation System. IEEE Trans. Green Commun. Netw. 2022, 6, 1520–1531. [Google Scholar] [CrossRef]
  179. Zeng, C.; Wang, J.-B.; Ding, C.; Zhang, P.; Zhang, H.; Min, L. Joint Optimization of Trajectory and Beamforming for USV-Assisted Maritime Wireless Network Coexisting with Satellite Network. In Proceedings of the ICC 2022—IEEE International Conference on Communications, Seoul, Republic of Korea, 16–20 May 2022; pp. 1865–1870. [Google Scholar] [CrossRef]
  180. Yin, H.; Li, Y.; Xing, F.; Wu, B.; Zhou, Z.; Zhang, W.; Acoustic, H. Wireless Optical and Fiber-optic Underwater Cellular Mobile Communication Networks. In Proceedings of the 2018 IEEE 18th International Conference on Communication Technology (ICCT), Chongqing, China, 8–11 October 2018; pp. 721–726. [Google Scholar] [CrossRef]
  181. Dao, N.-N.; Tu, N.H.; Thanh, T.T. Vo Nguyen Quoc Bao, Woongsoo Na, Sungrae Cho, Neglected infrastructures for 6G—Underwater communications: How mature are they? J. Netw. Comput. Appl. 2023, 213, 103595. [Google Scholar] [CrossRef]
  182. Yang, Y.; Xiao, Y.; Li, T. A Survey of Autonomous Underwater Vehicle Formation: Performance, Formation Control, and Communication Capability. IEEE Commun. Surv. Tutor. 2021, 23, 815–841. [Google Scholar] [CrossRef]
  183. Chen, Y.-L.; Ma, X.-W.; Bai, G.-Q.; Sha, Y.; Liu, J. Multi-autonomous underwater vehicle formation control and cluster search using a fusion control strategy at complex underwater environment. Ocean. Eng. 2020, 216, 108048. [Google Scholar] [CrossRef]
  184. Yang, X.; Wang, W.; Huang, P. Distributed optimal consensus with obstacle avoidance algorithm of mixed-order UAVs–USVs–UUVs systems. ISA Trans. 2020, 107, 270–286. [Google Scholar] [CrossRef] [PubMed]
  185. Yuan, M.; Li, Y.; Li, Y.; Pang, S.; Zhang, J. A fast way of single-beacon localization for AUVs. Appl. Ocean. Res. 2022, 119, 103037. [Google Scholar] [CrossRef]
  186. Xu, B.; Fei, Y.; Wang, X.; Tang, J.; Razzaqi, A.A. Optimal topology design of multi-target AUVs for 3D cooperative localization formation based on angle of arrival measurement. Ocean. Eng. 2023, 271, 113758. [Google Scholar] [CrossRef]
  187. Qiu, F.; Zhang, W. AUV-Aided joint time synchronization and localization of underwater target with propagation speed uncertainties. Ocean. Eng. 2023, 283, 115060. [Google Scholar] [CrossRef]
  188. Jiang, L.; Gao, W.; Li, Y.; Pan, M.; Mu, S. Cooperative localization for master–salve multi-AUVs based on range measurements. Phys. Commun. 2023, 61, 102217. [Google Scholar] [CrossRef]
  189. Lv, Z.; Bai, Y.; Jin, J.; Wang, H.; Ren, C. Analysis of wave fluctuation on underwater acoustic communication based USV. Appl. Acoust. 2021, 175, 107820. [Google Scholar] [CrossRef]
  190. Li, C.; Li, J.; Zhang, G.; Chen, T. IROA-based LDPC-Lévy method for target search of multi AUV–USV system in unknown 3D environment. Ocean. Eng. 2023, 286, 115648. [Google Scholar] [CrossRef]
  191. Deebak, B.D.; Al-Turjman, F. Chapter One—Aerial and underwater drone communication: Potentials and vulnerabilities. In Drones in Smart-Cities, Al-Turjman, F., Ed.; Elsevier: Amsterdam, The Netherlands, 2020; pp. 1–26. [Google Scholar]
  192. Li, Y.; Qiu, H.; Chen, X.; Fu, J.; Musa, M.; Li, X. Spatial correlation analysis of imaging MIMO for underwater visible light communication. Opt. Commun. 2019, 443, 221–229. [Google Scholar] [CrossRef]
  193. IF, A.; Wang, P.; Lin, S.-C. SoftWater: Software-defined networking for next-generation underwater communication systems. Ad Hoc Netw. 2016, 46, 1–11. [Google Scholar]
  194. Qu, F.; Qian, J.; Wang, J.; Lu, X.; Zhang, M.; Bai, X.; Ran, Z.; Tu, X.; Liu, Z.; Wei, Y. Cross-Medium Communication Combining Acoustic Wave and Millimeter Wave: Theoretical Channel Model and Experiments. IEEE J. Ocean. Eng. 2022, 47, 483–492. [Google Scholar] [CrossRef]
  195. Kumar, A.; Ahuja, N.J.; Thapliyal, M.; Dutt, S.; Kumar, T. Diego Augusto De Jesus Pacheco, Charalambos Konstantinou, Kim-Kwang Raymond Choo, Blockchain for unmanned underwater drones: Research issues, challenges, trends and future directions. J. Netw. Comput. Appl. 2023, 215, 103649. [Google Scholar] [CrossRef]
  196. Liu, X.; Chai, Z.-Y.; Li, Y.-L.; Cheng, Y.-Y.; Zeng, Y. Multi-objective deep reinforcement learning for computation offloading in UAV-assisted multi-access edge computing. Inf. Sci. 2023, 642, 119154. [Google Scholar] [CrossRef]
  197. Hassan, S.S.; Tun, Y.K.; Saad, W.; Han, Z.; Hong, C.S. Blue Data Computation Maximization in 6G Space-Air-Sea Non-Terrestrial Networks. In Proceedings of the 2021 IEEE Global Communications Conference (GLOBECOM), Madrid, Spain, 7–11 December 2021; pp. 1–6. [Google Scholar]
  198. Shi, J.; Li, C.; Guan, Y.; Cong, P.; Li, J. Multi-UAV-assisted computation offloading in DT-based networks: A distributed deep reinforcement learning approach. Comput. Commun. 2023, 210, 217–228. [Google Scholar] [CrossRef]
Figure 1. The evolution of 3GPP NTN standards.
Figure 1. The evolution of 3GPP NTN standards.
Information 15 00038 g001
Figure 2. The illustration of 3GPP NTN network architecture [22].
Figure 2. The illustration of 3GPP NTN network architecture [22].
Information 15 00038 g002
Figure 3. Illustration of UAV applications in NTNs.
Figure 3. Illustration of UAV applications in NTNs.
Information 15 00038 g003
Figure 4. Illustration of UAV fire detection architecture.
Figure 4. Illustration of UAV fire detection architecture.
Information 15 00038 g004
Figure 5. The illustration of UAV-assisted V2X scenario.
Figure 5. The illustration of UAV-assisted V2X scenario.
Information 15 00038 g005
Figure 6. Overview of UAV airborne network in the case study.
Figure 6. Overview of UAV airborne network in the case study.
Information 15 00038 g006
Figure 7. Field Trial Map of UAV: The cirlce trajectory on the map indicate the flight path of the UAV; A, B, and C denote the three measurement point under the coverage of UAV base station.
Figure 7. Field Trial Map of UAV: The cirlce trajectory on the map indicate the flight path of the UAV; A, B, and C denote the three measurement point under the coverage of UAV base station.
Information 15 00038 g007
Figure 8. Field trial scene of UAV airborne NTN: (a) quadrupedal locomotion robot with Customer Premise Equipment (CPE) on board; (b) CH-4 UAV equipped with 5G base station and satellite antenna preparing to take off.
Figure 8. Field trial scene of UAV airborne NTN: (a) quadrupedal locomotion robot with Customer Premise Equipment (CPE) on board; (b) CH-4 UAV equipped with 5G base station and satellite antenna preparing to take off.
Information 15 00038 g008
Figure 9. Field trial of quadrupedal locomotion robot formation: (a) quadrupedal locomotion robot formation control; (b) perspective of the robot in the group.
Figure 9. Field trial of quadrupedal locomotion robot formation: (a) quadrupedal locomotion robot formation control; (b) perspective of the robot in the group.
Information 15 00038 g009
Table 1. Summary of existing work on UAV trajectory/path planning in NTN communication.
Table 1. Summary of existing work on UAV trajectory/path planning in NTN communication.
LiteratureTopicsContributionsYear
[32]UAV Base StaionInvestigated a distributed framework based on DRL to control and optimize UAV base stations considering ground users’ fairness2021
[33]UAV Base StaionProposed a flow-level model for UAV base station network and a DRL-optimizing method for network traffic balancing based on the realistic UAV radio model.2019
[34]UAV Base StaionDemonstrated a circle trajectory setup for multiple ground uses coverage. 2020
[35]UAV Base StaionDesigned a deep Q learning network and greedy algorithm-based UAV trajectory optimization paradigm for unevenly distributed ground users.2021
[36]UAV Base StaionEmphasized a multi-target coverage dynamic trajectory optimization scheme utilizing knowledge-incorporated approach2021
[37]UAV RelayProposed an iterative solution for joint optimization of UAV trajectory, power consumption and time-slot assignment.2019
[38]UAV RelayConsidered a path planning and power consumption optimization paradigm for a space-air-ground integrated relay network in a non-orthogonal multiple access scheme2018
[39]UAV RelayInvestigated a novel solution for trajectory design and transmitting power minimization for a UAV-assisted relay2021
[40]UAV RelayThe paper proposed an efficient algorithm designed for UAV relay’s three-dimensional trajectory optimization in order to achieve higher throughput.2021
[41]UAV RelayThe paper studied a multi-UAV trajectory optimization framework in which UAVs acted as both aerial base stations and wireless relays.2022
[44]UAV User EquipmentThe paper proposed an analytical model to demonstrate the influence of trajectory and altitude on the quality of service in UAV aerial cellular users2020
[45]UAV User EquipmentThe paper investigated an iterative method for trajectory planning to minimize the time to fulfill the task and overall power consumption for UAV aerial users2021
[46]UAV User EquipmentThe paper proposed an online trajectory optimizing scheme for minimal power consumption based on outage probability map reconstructed from sparse sampling.2023
[47]UAV User EquipmentThe paper considered a DRL-based UAV user optimization method considering impact factors of UAV power, flight trajectory, and antenna pattern.2022
[48]UAV User EquipmentThe paper considered a cellular-connected UAV for synthetic aperture radar sensing tasks using successive convex approximation.2022
[49]UAV User EquipmentThe paper proposed a dynamic programming algorithm to optimize trajectories of cellular-connected UAVs for communication enhancement2020
[50]UAV User EquipmentThe paper reported a path-planning method for task-critical missions in which connectivity maintenance is of utmost importance. 2022
[51]UAV User EquipmentThis work reported a UAV curvature design for UAV users with fixed start and final locations.2019
[52]UAV User EquipmentThis study emphasized the role of path planning in the effort of interference cancellation.2022
Table 2. Typical communication requirement of UAIS in NTN.
Table 2. Typical communication requirement of UAIS in NTN.
Unmanned Autonomous Intelligent SystemApplicationCommunication Requirements
UGVCommand and ControlUltra-low latency
Perception High data rate
Data OffloadingHigh data rate
Low latency
UAVFlight Control Ultra-low latency
UAV Traffic ManagementLow latency
Object DeliveryLow latency
Mobile Edge ComputingLow latency
High data rate
othersMonitor and SurveyHigh data rate
ReconnaissanceHigh data rate
Swarm CoordinationLow latency
Formation ControlLow latency
Table 3. Peak service requirements for UGV use cases in NTN communication.
Table 3. Peak service requirements for UGV use cases in NTN communication.
Use CaseParameters
Exchange IntensityExchange TypeData RateMax. DelayReliability
Command and controlhighstream28 kbps20 ms99.9%
Video streaming of FPVhighstream120 Mbps40 ms99.99%
Offloading processing taskshighburst1.1 Gbps2 ms99.9%
Table 5. Summary of previous work concerning USV in NTN communication.
Table 5. Summary of previous work concerning USV in NTN communication.
LiteratureTopicsContributionsNTN Communication Type
[162]Multi-USV ControlAn integrated communication framework for terrestrial, sea and HAP for multi-USV control.HAP–USV
[164]Multi-USV CommunicationMulti-USV group communication scheme with nested topologyUSV–USV
[166]USV Formation ControlCooperative communication framework design considering varying topologyUAV–USV
[167]USV Formation ControlEvent-triggered formation controller for lower communication power consumptionUAV–USV
[168]USV Formation ControlDynamic event-triggered control scheme for fixed time formation consensus.UAV–USV
[169]UAV-USV CooperationPerformance and reliability evaluation of communications for USV–UAV cooperation tasksUAV–USV
[170]UAV-USV CooperationUAV–USV cooperative tracking and landing scheme using model-based control.UAV–USV
[171]UAV-USV Cooperation Collaborative surface coverage of oceanic area utilizing UAV and USV UAV–USV
[172]UAV-USV CooperationUSV–UAV marine cooperative search and control by means of visual informationUAV–USV
Table 6. Ground UE test results of UAV NTN network field trial.
Table 6. Ground UE test results of UAV NTN network field trial.
MeasurementPointTypeDistance to UAV
(M)
Throughput
(Mbps)
Downlink RSRP
(dBm)
Downlink SINR
(dB)
Time Delay
(ms)
AUplink3490.1726.99−88.1328.81/
Ping3707.13/−97.6322.31323
Uplink3705.5010.82−101.8114.81/
Downlink3654.38697.34−83.1333.69/
Ping3473.81/−94.5024.6923
Uplink3418.6617.23−91.5025.19/
Ping3500.57/−85.3826.3131
Downlink3418.87756.49−84.0635.81/
BPing3815.15/−82.2334.3727
Downlink3600.85707.65−85.7328.99/
Uplink3570.0340.60−76.8939.07/
CUplink3415.9722.02−78.2939.34/
Downlink3744.77362.91−99.4124.50/
Ping4049.63/−98.6925.0616
Table 7. UAV airborne network coverage field trial results.
Table 7. UAV airborne network coverage field trial results.
ApplicationItemResults
Multi frequency integrationNetwork edge rate14 Mbps
Peak rate744 Mbps
Average delay21 ms
Total system bandwidth240 MHz
UE coverageCoverage36 km2 (on demand)
Number of UEs41 (>10 Mbps)
System outage probabilityLess than 0.04%
Table 8. Robot application of UAV airborne network coverage field trial results.
Table 8. Robot application of UAV airborne network coverage field trial results.
ApplicationItemResults
Multi robot controlRobot control instruction delayless than 20 ms
Robot control range50 km
High-definition video streamingChannels supported of 4k video stream16
Video stream delayless than 70 ms
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, X.; Guo, Y.; Gao, Y. Unmanned Autonomous Intelligent System in 6G Non-Terrestrial Network. Information 2024, 15, 38. https://doi.org/10.3390/info15010038

AMA Style

Wang X, Guo Y, Gao Y. Unmanned Autonomous Intelligent System in 6G Non-Terrestrial Network. Information. 2024; 15(1):38. https://doi.org/10.3390/info15010038

Chicago/Turabian Style

Wang, Xiaonan, Yang Guo, and Yuan Gao. 2024. "Unmanned Autonomous Intelligent System in 6G Non-Terrestrial Network" Information 15, no. 1: 38. https://doi.org/10.3390/info15010038

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop