Search Results (20)

This study presents a new intelligent aquatic farming surveillance system that tackles real-time monitoring challenges in the industry. The main technical break-throughs of this system are evident in four key aspects: First, it achieves the smooth integration of remotely operated vehicles (ROVs), sensors, and real-time data transmission. Second, it uses a mobile communication architecture with buoy relay stations for distributed edge computing. This design supports future upgrades to Beyond 5G and satellite networks for deep-sea applications. Third, it features a multi-terminal control system that supports computers, smartphones, smartwatches, and centralized hubs, effectively enabling monitoring anytime, anywhere. Fourth, it incorporates a cost-effective modular design, utilizing commercial hardware and innovative system integration solutions, making it particularly suitable for farms with limited resources. The data indicates that the system’s 4G connection is both stable and reliable, demonstrating excellent performance in terms of data transmission success rates, control command response delays, and endurance. It has successfully processed 324,800 data transmission events, thoroughly validating its reliability in real-world production environments. This system integrates advanced technologies such as the Internet of Things, mobile communications, and multi-access control, which not only significantly enhance the precision oversight capabilities of marine farming but also feature a modular design that allows for future expansion into satellite communications. Notably, the system reduces operating costs while simultaneously improving aquaculture efficiency, offering a practical and intelligent solution for small farmers in resource-limited areas. Full article

The rapid expansion in unmanned aerial vehicles (UAVs) across various sectors, such as surveillance, agriculture, disaster management, and infrastructure inspection, highlights the growing need for robust navigation systems. However, this growth also exposes critical vulnerabilities, particularly in UAV package delivery operations, where intentional electromagnetic interference (IEMI) poses significant security and safety threats. This paper addresses IEMI attacks targeting inertial measurement units (IMUs) in UAVs, focusing on their susceptibility to medium-power electromagnetic interference. Our approach combines a comprehensive literature review and QuickField simulation with experimental validation using a commercially available 6-degree-of-freedom (DOF) IMU sensor. We propose a hardware-based electromagnetic shielding solution using mu-metal to mitigate IEMI’s impact on sensor performance. The study combines experimental testing with simulations to evaluate the shielding effectiveness under controlled conditions. The results of the measurements showed that medium-power IEMI significantly distorted IMU sensor readings, but our proposed shielding method effectively reduces the impact, improving sensor reliability. We demonstrate the mechanisms by which medium-power IEMI disrupts sensor operation, offering insights for future research directions. These findings also highlight the importance of integrating hardware-based shielding solutions to safeguard UAV systems against electromagnetic threats. Full article

Unmanned aerial vehicles (UAVs) are increasingly significant in modern warfare due to their versatility and capacity to perform high-risk missions without risking human lives. Beyond surveillance and reconnaissance, UAVs with jet propulsion and engagement capabilities are set to play roles similar to conventional jets. In various scenarios, military aircraft, drones, and UAVs face multiple threats while ground radar systems continuously monitor their positions. The interaction between these aerial platforms and radars causes temporal fluctuations in scattered echo power due to changes in aspect angle, impacting radar tracking accuracy. This study utilizes the potential radar cross-section (RCS) dynamics of an aircraft throughout its flight, using ground radar as a reference. Key factors influencing RCS include time, frequency, polarization, incident angle, physical geometry, and surface material, with a focus on the complex scattering geometry of the aircraft. The research evaluates the monostatic RCS case and examines the impact of attitude variations on RCS scintillation. Here, we present dynamic RCS modeling by examining the influence of flight dynamics on the RCS fluctuations of a UAV-sized aircraft. Dynamic RCS modeling is essential in creating a robust framework for operational analysis and developing effective countermeasure strategies, such as advanced active decoys. Especially in the cognitive radar concept, aircraft will desperately need more dynamic and adaptive active decoys. A methodology for calculating target aspect angles is proposed, using the aircraft’s attitude and spherical position relative to the radar system. A realistic 6DoF (6 degrees of freedom) flight data time series generated by a commercial flight simulator is used to derive aircraft-to-radar aspect angles. By estimating aspect angles for a simulated complex flight trajectory, RCS scintillation throughout the flight is characterized. The study highlights the importance of maneuver parameters such as roll and pitch on the RCS measured at the radar by comparing datasets with and without these parameters. Significant differences were found, with a 32.44% difference in RCS data between full maneuver and no roll and pitch changes. Finally, proposed future research directions and insights are discussed. Full article

Unmanned Aerial Vehicles (UAVs) represent a rapidly increasing technology with profound implications for various domains, including surveillance, security, and commercial applications. Among the number of detection and classification methodologies, radar technology stands as a cornerstone due to its versatility and reliability. This paper presents a comprehensive primer written specifically for researchers starting on investigations into UAV detection and classification, with a distinct emphasis on the integration of full-wave electromagnetic computer-aided design (EM CAD) tools. Commencing with an elucidation of radar’s pivotal role within the UAV detection paradigm, this primer systematically navigates through fundamental Frequency-Modulated Continuous-Wave (FMCW) radar principles, elucidating their intricate interplay with UAV characteristics and signatures. Methodologies pertaining to signal processing, detection, and tracking are examined, with particular emphasis placed on the pivotal role of full-wave EM CAD tools in system design and optimization. Through an exposition of relevant case studies and applications, this paper underscores successful implementations of radar-based UAV detection and classification systems while elucidating encountered challenges and insights obtained. Anticipating future trajectories, the paper contemplates emerging trends and potential research directions, accentuating the indispensable nature of full-wave EM CAD tools in propelling radar techniques forward. In essence, this primer serves as an indispensable roadmap, empowering researchers to navigate the complex terrain of radar-based UAV detection and classification, thereby fostering advancements in aerial surveillance and security systems. Full article

Unmanned aerial vehicles (UAVs) have gained significant popularity across various domains, but their proliferation also raises concerns about security, public safety, and privacy. Consequently, the detection and tracking of UAVs have become crucial. Among the UAV-monitoring technologies, those suitable for urban Internet-of-Things (IoT) environments primarily include radio frequency (RF), acoustic, and visual technologies. In this article, we provide a comprehensive review of passive UAV surveillance technologies, encompassing RF-based, acoustic-based, and vision-based methods for UAV detection, localization, and tracking. Our research reveals that certain lightweight UAV depth detection models have been effectively downsized for deployment on edge devices, facilitating the integration of edge computing and deep learning. In the city-wide anti-UAV, the integration of numerous urban infrastructure monitoring facilities presents a challenge in achieving a centralized computing center due to the large volume of data. To address this, calculations can be performed on edge devices, enabling faster UAV detection. Currently, there is a wide range of anti-UAV systems that have been deployed in both commercial and military sectors to address the challenges posed by UAVs. In this article, we provide an overview of the existing military and commercial anti-UAV systems. Furthermore, we propose several suggestions for developing general-purpose UAV-monitoring systems tailored for urban environments. These suggestions encompass considering the specific requirements of the application scenario, integrating detection and tracking mechanisms with appropriate countermeasures, designing for scalability and modularity, and leveraging advanced data analytics and machine learning techniques. To promote further research in the field of UAV-monitoring systems, we have compiled publicly available datasets comprising visual, acoustic, and radio frequency data. These datasets can be employed to evaluate the effectiveness of various UAV-monitoring techniques and algorithms. All of the datasets mentioned are linked in the text or in the references. Most of these datasets have been validated in multiple studies, and researchers can find more specific information in the corresponding papers or documents. By presenting this comprehensive overview and providing valuable insights, we aim to advance the development of UAV surveillance technologies, address the challenges posed by UAV proliferation, and foster innovation in the field of UAV monitoring and security. Full article

Unmanned aerial vehicles (UAVs) equipped with computer vision capabilities have been widely utilized in several remote sensing applications, such as precision agriculture, environmental monitoring, and surveillance. However, the commercial usage of these UAVs in such applications is mostly performed manually, with humans being responsible for data observation or offline processing after data collection due to the lack of on board AI on edge. Other technical methods rely on the cloud computation offloading of AI applications, where inference is conducted on video streams, which can be unscalable and infeasible due to remote cloud servers’ limited connectivity and high latency. To overcome these issues, this paper presents a new approach to using edge computing in drones to enable the processing of extensive AI tasks onboard UAVs for remote sensing. We propose a cloud–edge hybrid system architecture where the edge is responsible for processing AI tasks and the cloud is responsible for data storage, manipulation, and visualization. We designed AERO, a UAV brain system with onboard AI capability using GPU-enabled edge devices. AERO is a novel multi-stage deep learning module that combines object detection (YOLOv4 and YOLOv7) and tracking (DeepSort) with TensorRT accelerators to capture objects of interest with high accuracy and transmit data to the cloud in real time without redundancy. AERO processes the detected objects over multiple consecutive frames to maximize detection accuracy. The experiments show a reduced false positive rate (0.7%), a low percentage of tracking identity switches (1.6%), and an average inference speed of 15.5 FPS on a Jetson Xavier AGX edge device. Full article

The roads we travel daily are exposed to several energy sources (mechanical load, solar radiation, heat, air movement, etc.), which can be exploited to make common systems and apparatus for roadways (i.e., lighting, video surveillance, and traffic monitoring systems) energetically autonomous. For decades, research groups have developed many technologies able to scavenge energy from the said sources related to roadways: electromagnetism, piezoelectric and triboelectric harvesters for the cars’ stress and vibrations, photovoltaic modules for sunlight, thermoelectric solutions and pyroelectric materials for heat and wind turbines optimized for low-speed winds, such as the ones produced by moving vehicles. Thus, this paper explores the existing technologies for scavenging energy from sources available on roadways, both natural and related to vehicular transit. At first, to contextualize them within the application scenario, the available energy sources and transduction mechanisms were identified and described, arguing the main requirements that must be considered for developing harvesters applicable on roadways. Afterward, an overview of energy harvesting solutions presented in the scientific literature to recover energy from roadways is introduced, classifying them according to the transduction method (i.e., piezoelectric, triboelectric, electromagnetic, photovoltaic, etc.) and proposed system architecture. Later, a survey of commercial systems available on the market for scavenging energy from roadways is introduced, focusing on their architecture, performance, and installation methods. Lastly, comparative analyses are offered for each device category (i.e., scientific works and commercial products), providing insights to identify the most promising solutions and technologies for developing future self-sustainable smart roads. Full article

Nowadays, deep learning (DL)-based video surveillance services are widely used in smart cities because of their ability to accurately identify and track objects, such as vehicles and pedestrians, in real time. This allows a more efficient traffic management and improved public safety. However, DL-based video surveillance services that require object movement and motion tracking (e.g., for detecting abnormal object behaviors) can consume a substantial amount of computing and memory capacity, such as (i) GPU computing resources for model inference and (ii) GPU memory resources for model loading. This paper presents a novel cognitive video surveillance management with long short-term memory (LSTM) model, denoted as the CogVSM framework. We consider DL-based video surveillance services in a hierarchical edge computing system. The proposed CogVSM forecasts object appearance patterns and smooths out the forecast results needed for an adaptive model release. Here, we aim to reduce standby GPU memory by model release while avoiding unnecessary model reloads for a sudden object appearance. CogVSM hinges on an LSTM-based deep learning architecture explicitly designed for future object appearance pattern prediction by training previous time-series patterns to achieve these objectives. By referring to the result of the LSTM-based prediction, the proposed framework controls the threshold time value in a dynamic manner by using an exponential weighted moving average (EWMA) technique. Comparative evaluations on both simulated and real-world measurement data on the commercial edge devices prove that the LSTM-based model in the CogVSM can achieve a high predictive accuracy, i.e., a root-mean-square error metric of 0.795. In addition, the suggested framework utilizes up to 32.1% less GPU memory than the baseline and 8.9% less than previous work. Full article

Transport, rescue, search, surveillance, and disaster relief tasks are some applications that can be developed with unmanned aerial vehicles (UAVs), where accurate trajectory tracking is a crucial property to operate in a cluttered environment or under uncertainties. However, this is challenging due to high nonlinear dynamics, system constraints, and uncertainties presented in cluttered environments. Hence, uncertainties in the form of unmodeled dynamics, aerodynamic effects, and external disturbances such as wind can produce unstable feedback control schemes, introducing significant positional tracking errors. This work presents a detailed comparative study between controllers such as nonlinear model predictive control (NMPC) and non-predictive baseline feedback controllers, with particular attention to tracking accuracy and computational efficiency. The development of the non-predictive feedback controller schemes was divided into inverse differential kinematics and inverse dynamic compensation of the aerial vehicle. The design of the two controllers uses the mathematical model of UAV and nonlinear control theory, guaranteeing a low computational cost and an asymptotically stable algorithm. The NMPC formulation was developed considering system constraints, where the simplified dynamic model was included; additionally, the boundaries in control actions and a candidate Lyapunov function guarantees the stability of the control structure. Finally, this work uses the commercial simulator DJI brand and DJI Matrice 100 UAV in real-world experiments, where the NMPC shows a reduction in tracking error, indicating the advantages of this formulation. Full article

The growing number of civil applications in which Unmanned Aerial Vehicles (UAVs) are involved can create many concerns for airspace security and surveillance. Gathering as much information as possible about a drone can be crucial to apply proper countermeasures if a potentially dangerous situation is detected. Of course, the presence of a UAV can be detected by radar, but it is possible to extend the system capabilities to obtain additional information. For example, in the case in which the UAV is equipped with propellers, the radar-measured rotational speed could be important information to classify the type of UAV or to reveal if it is carrying some possibly harmful payload. In addition, the rotational speed measured through radar could be used for different purposes, such as to detect a drone manumission, to estimate its maximum payload, or for predictive maintenance of the drone. Measuring the propellers’ rotational speed with radar systems is a critical task, as the Doppler generated by the rotation can be very high, and it is very difficult to find commercial radar systems in the market able to handle such a high Doppler. Another problem is caused by the typically very small Radar Cross-Section (RCS) of the propellers, which makes their detection even more difficult. In the literature, common detection techniques are based on the measurement of the Doppler effect produced by the propellers to derive their rotational speed, but due to the very limited capabilities of commercial sensors, this approach can be applied only at very low values of the rotational speed. In this work, a different approach based on a Frequency-Modulated Continuous Wave (FMCW) radar is proposed, which exploits the vibration of the UAV generated by the rotation of the propellers. The phenomenon and how the sensor can detect it will be presented, which is joined with a performance analysis comparing different estimation techniques for the indirect measurement of the propellers’ speed to evaluate the potential benefits of the proposed approach. Full article

Drones/unmanned aerial vehicles (UAVs) have recently grown in popularity due to their inexpensive cost and widespread commercial use. The increased use of drones raises the possibility that they may be employed in illicit activities such as drug smuggling and terrorism. Thus, drone monitoring and automated detection are critical for protecting restricted areas or special zones from illicit drone operations. One of the most challenging difficulties in drone detection in surveillance videos is the apparent likeness of drones against varied backdrops. This paper introduces an automated image-based drone-detection system that uses an enhanced deep-learning-based object-detection algorithm known as you only look once (YOLOv5) to defend restricted territories or special zones from unauthorized drone incursions. The transfer learning to pretrain the model is employed for improving performance due to an insufficient number of samples in our dataset. Furthermore, the model can recognize the detected object in the images and mark the object’s bounding box by joining the results across the region. The experiments show outstanding results for the loss value, drone location detection, precision and recall. Full article

Swarms of unmanned vehicles (air and ground) can increase the efficiency and effectiveness of military and law enforcement operations by enhancing situational awareness and allowing the persistent monitoring of multiple hostile targets. The key focus in the development of the enabling technologies for swarm systems is the minimisation of uncertainties in situational awareness information for surveillance operations supported by ‘system of systems’ composed of static and mobile heterogeneous sensors. The identified critical enabling techniques and technologies for adaptive, informative and reconfigurable operations of unmanned swarm systems are robust static sensor network design, mobile sensor tasking (including re-allocation), sensor fusion and information fusion, including behaviour monitoring. The work presented in this paper describes one of the first attempts to integrate all swarm-related technologies into a prototype, demonstrating the benefits of swarms of heterogeneous vehicles for defence applications used for the persistent monitoring of high-value assets, such as military installations and camps. The key enabling swarm system technologies are analysed here, and novel algorithms are presented that can be implemented in available COTS-based unmanned vehicles. The algorithms have been designed and optimised to require small computational power, be flexible, be reconfigurable and be implemented in a large range of commercially available unmanned vehicles (air and ground). Full article

The development of unmanned aerial vehicles (UAVs) is expected to become one of the most commercialized research areas in the world over the next decade. Globally, unmanned aircraft have been increasingly used for safety surveillance in the construction industry and civil engineering fields. This paper presents an aerial image-based approach using UAVs to inspect cracks and deformations in buildings. A state-of-the-art safety evaluation method termed SMART SKY EYE (Smart building safety assessment system using UAV) is introduced; this system utilizes an unmanned airplane equipped with a thermal camera and programmed with various surveying efficiency improvement methods, such as thermography, machine-learning algorithms, and 3D point cloud modeling. Using this method, crack maps, crack depths, and the deformations of structures can be obtained. Error rates are compared between the proposed and conventional methods. Full article

Road traffic accidents regarding commercial vehicles have been demonstrated as an important culprit restricting the steady development of the social economy, which are closely related to the distracted behavior of drivers. However, the existing driver’s distracted behavior surveillance systems for monitoring and preventing the distracted behavior of drivers still have some shortcomings such as fewer recognition objects and scenarios. This study aims to provide a more comprehensive methodological framework to demonstrate the significance of enlarging the recognition objects, scenarios and types of the existing driver’s distracted behavior recognition systems. The driver’s posture characteristics were primarily analyzed to provide the basis of the subsequent modeling. Five CNN sub-models were established for different posture categories and to improve the efficiency of recognition, accompanied by a holistic multi-cascaded CNN framework. To suggest the best model, image data sets of commercial vehicle driver postures including 117,410 daytime images and 60,480 night images were trained and tested. The findings demonstrate that compared to the non-cascaded models, both daytime and night cascaded models show better performance. Besides, the night models exhibit worse accuracy and better speed relative to their daytime model counterparts for both non-cascaded and cascaded models. This study could be used to develop countermeasures to improve driver safety and provide helpful information for the design of the driver’s real-time monitoring and warning system as well as the automatic driving system. Future research could be implemented to combine the vehicle state parameters with the driver’s microscopic behavior to establish a more comprehensive proactive surveillance system. Full article

This paper aims to provide an overview of the capabilities of unmanned systems to monitor and manage aquaculture farms that support precision aquaculture using the Internet of Things. The locations of aquaculture farms are diverse, which is a big challenge on accessibility. For offshore fish cages, there is a difficulty and risk in the continuous monitoring considering the presence of waves, water currents, and other underwater environmental factors. Aquaculture farm management and surveillance operations require collecting data on water quality, water pollutants, water temperature, fish behavior, and current/wave velocity, which requires tremendous labor cost, and effort. Unmanned vehicle technologies provide greater efficiency and accuracy to execute these functions. They are even capable of cage detection and illegal fishing surveillance when equipped with sensors and other technologies. Additionally, to provide a more large-scale scope, this document explores the capacity of unmanned vehicles as a communication gateway to facilitate offshore cages equipped with robust, low-cost sensors capable of underwater and in-air wireless connectivity. The capabilities of existing commercial systems, the Internet of Things, and artificial intelligence combined with drones are also presented to provide a precise aquaculture framework. Full article