Search Results (66)

The paper presents a double-radio wireless multimedia sensor node (WMSN) with a camera on board, designed for plant proximal monitoring. Camera sensor nodes represent an effective solution to monitor the crop at the leaf or fruit scale, with details that cannot be retrieved with the same precision through satellites or unnamed aerial vehicles (UAVs). From the technological point of view, WMSNs are characterized by very different requirements, compared to standard wireless sensor nodes; in particular, the network data rate results in higher energy consumption and incompatibility with the usage of battery-powered devices. Avoiding energy harvesters allows for device miniaturization and, consequently, application flexibility, even for small plants. To do this, the proposed node has been implemented with two radios, with different roles. A GPRS modem has been exclusively implemented for image transmission, while all other tasks, including node monitoring and camera control, are performed by a LoRaWAN class A end-node that connects every 10 min. Via the LoRaWAN downlink, it is possible to efficiently control the camera settings; the shooting times and periodicity, according to weather conditions; the eventual farming operations; the crop growth stages and the season. The node energy consumption has been verified in the laboratory and in the field, showing that it is possible to acquire one picture per day for more than eight months without any energy harvester, opening up further possible implementations for disease detection and production optimization. Full article

Mobile communications have experienced exponential growth both in connectivity and multimedia traffic in recent years. To support this tremendous growth, device-to-device (D2D) communications play a significant role in 5G and beyond 5G networks. However, enabling D2D communications in an underlay, heterogeneous cellular network poses two major challenges. First, interference management between D2D and cellular users directly affects a system’s performance. Second, achieving an acceptable level of link quality for both D2D and cellular networks is necessary. An optimum resource allocation is required to mitigate the interference and improve a system’s performance. In this paper, we provide a solution to interference management with an acceptable quality of services (QoS). To this end, we propose a machine learning-based resource allocation method to maximize throughput and achieve minimum QoS requirements for all active D2D pairs and cellular users. We first solve a resource optimization problem by allocating spectrum resources and controlling power transmission on demand. As resource optimization is an integer nonlinear programming problem, we address this problem by proposing a deep Q-network-based reinforcement learning algorithm (DRL) to optimize the resource allocation issue. The proposed DRL algorithm is trained with a decision-making policy to obtain the best solution in terms of spectrum efficiency, computational time, and throughput. The system performance is validated by simulation. The results show that the proposed method outperforms the existing ones. Full article

The revolutionary breakthroughs in Machine Learning (ML) and Artificial Intelligence (AI) are extensively being harnessed across a diverse range of domains, e.g., forensic science, healthcare, virtual assistants, cybersecurity, and robotics. On the flip side, they can also be exploited for negative purposes, like producing authentic-looking fake news that propagates misinformation and diminishes public trust. Deepfakes pertain to audio or visual multimedia contents that have been artificially synthesized or digitally modified through the application of deep neural networks. Deepfakes can be employed for benign purposes (e.g., refinement of face pictures for optimal magazine cover quality) or malicious intentions (e.g., superimposing faces onto explicit image/video to harm individuals producing fake audio recordings of public figures making inflammatory statements to damage their reputation). With mobile devices and user-friendly audio and visual editing tools at hand, even non-experts can effortlessly craft intricate deepfakes and digitally altered audio and facial features. This presents challenges to contemporary computer forensic tools and human examiners, including common individuals and digital forensic investigators. There is a perpetual battle between attackers armed with deepfake generators and defenders utilizing deepfake detectors. This paper first comprehensively reviews existing image, video, and audio deepfake databases with the aim of propelling next-generation deepfake detectors for enhanced accuracy, generalization, robustness, and explainability. Then, the paper delves deeply into open challenges and potential avenues for research in the audio and video deepfake generation and mitigation field. The aspiration for this article is to complement prior studies and assist newcomers, researchers, engineers, and practitioners in gaining a deeper understanding and in the development of innovative deepfake technologies. Full article

Live video streaming has become one of the main multimedia trends in networks in recent years. Providing Quality of Service (QoS) during live transmissions is challenging due to the stringent requirements for low latency and minimal interruptions. This scenario has led to a high dependence on cloud services, implying a widespread usage of Internet connections, which constrains contexts in which an Internet connection is not available. Thus, alternatives such as Mobile Ad Hoc Networks (MANETs) emerge as potential communication techniques. These networks operate autonomously with mobile devices serving as nodes, without the need for coordinating centralized components. However, these characteristics lead to challenges to live video streaming, such as dynamic node topologies or periods of disconnection. Considering these constraints, this paper investigates the application of Artificial Intelligence (AI)-based classification techniques to provide adaptive streaming in MANETs. For this, a software-driven architecture is proposed to route stream in offline MANETs, predicting the stability of individual links and compressing video frames accordingly. The proposal is implemented and assessed in a laboratory context, in which the model performance and QoS metrics are analyzed. As a result, the model is implemented in a decision forest algorithm, which provides 95.9% accuracy. Also, the obtained latency values become assumable for video streaming, manifesting a reliable response for routing and node movements. Full article

Audio inpainting plays an important role in addressing incomplete, damaged, or missing audio signals, contributing to improved quality of service and overall user experience in multimedia communications over the Internet and mobile networks. This paper presents an innovative solution for speech inpainting using Long Short-Term Memory (LSTM) networks, i.e., a restoring task where the missing parts of speech signals are recovered from the previous information in the time domain. The lost or corrupted speech signals are also referred to as gaps. We regard the speech inpainting task as a time-series prediction problem in this research work. To address this problem, we designed multi-layer LSTM networks and trained them on different speech datasets. Our study aims to investigate the inpainting performance of the proposed models on different datasets and with varying LSTM layers and explore the effect of multi-layer LSTM networks on the prediction of speech samples in terms of perceived audio quality. The inpainted speech quality is evaluated through the Mean Opinion Score (MOS) and a frequency analysis of the spectrogram. Our proposed multi-layer LSTM models are able to restore up to 1 s of gaps with high perceptual audio quality using the features captured from the time domain only. Specifically, for gap lengths under 500 ms, the MOS can reach up to 3~4, and for gap lengths ranging between 500 ms and 1 s, the MOS can reach up to 2~3. In the time domain, the proposed models can proficiently restore the envelope and trend of lost speech signals. In the frequency domain, the proposed models can restore spectrogram blocks with higher similarity to the original signals at frequencies less than 2.0 kHz and comparatively lower similarity at frequencies in the range of 2.0 kHz~8.0 kHz. Full article

As assisted driving technology advances and vehicle entertainment systems rapidly develop, future vehicles will become mobile cinemas, where passengers can use various multimedia applications in the car. In recent years, the progress in multimedia technology has given rise to immersive video experiences. In addition to conventional 2D videos, 360° videos are gaining popularity, and volumetric videos, which can offer users a better immersive experience, have been discussed. However, these applications place high demands on network capabilities, leading to a dependence on next-generation wireless communication technology to address network bottlenecks. Therefore, this study provides an exhaustive overview of the latest advancements in video streaming over vehicular networks. First, we introduce related work and background knowledge, and provide an overview of recent developments in vehicular networking and video types. Next, we detail various video processing technologies, including the latest released standards. Detailed explanations are provided for network strategies and wireless communication technologies that can optimize video transmission in vehicular networks, paying special attention to the relevant literature regarding the current development of 6G technology that is applied to vehicle communication. Finally, we proposed future research directions and challenges. Building upon the technologies introduced in this paper and considering diverse applications, we suggest a suitable vehicular network architecture for next-generation video transmission. Full article

The Internet of Things (IoT) was introduced as a recently developed technology in the telecommunications field. It is a network made up of real-world objects, things, and gadgets that are enabled by sensors and software that can communicate data with one another. Systems for monitoring gather, exchange, and process video and image data captured by sensors and cameras across a network. Furthermore, the novel concept of Digital Twin offers new opportunities so that new proposed systems can work virtually, but without differing in operation from a “real” system. This paper is a meticulous survey of the IoT and monitoring systems to illustrate how their combination will improve certain types of the Monitoring systems of Healthcare–IoT in the Cloud. To achieve this goal, we discuss the characteristics of the IoT that improve the use of the types of monitoring systems over a Multimedia Transmission System in the Cloud. The paper also discusses some technical challenges of Multimedia in IoT, based on Healthcare data. Finally, it shows how the Mobile Cloud Computing (MCC) technology, settled as base technology, enhances the functionality of the IoT and has an impact on various types of monitoring technology, and also it proposes an algorithm approach to transmitting and processing video/image data through a Cloud-based Monitoring system. To gather pertinent data about the validity of our proposal in a more safe and useful way, we have implemented our proposal in a Digital Twin scenario of a Smart Healthcare system. The operation of the suggested scenario as a Digital Twin scenario offers a more sustainable and energy-efficient system and experimental findings ultimately demonstrate that the proposed system is more reliable and secure. Experimental results show the impact of our proposed model depicts the efficiency of the usage of a Cloud Management System operated over a Digital Twin scenario, using real-time large-scale data produced from the connected IoT system. Through these scenarios, we can observe that our proposal remains the best choice regardless of the time difference or energy load. Full article

Mobile-health (m-health) is described as the application of medical sensors and mobile computing to the healthcare provision. While 5G networks can support a variety of m-health services, applications such as telesurgery, holographic communications, and augmented/virtual reality are already emphasizing their limitations. These limitations apply to both the Quality of Service (QoS) and the Quality of Experience (QoE). However, 6G mobile networks are predicted to proliferate over the next decade in order to solve these limitations, enabling high QoS and QoE. Currently, academia and industry are concentrating their efforts on the 6G network, which is expected to be the next major game-changer in the telecom industry and will significantly impact all other related verticals. The exponential growth of m-health multimedia traffic (e.g., audio, video, and images) creates additional challenges for service providers in delivering a suitable QoE to their customers. As QoS is insufficient to represent the expectations of m-health end-users, the QoE of the services is critical. In recent years, QoE has attracted considerable attention and has established itself as a critical component of network service and operation evaluation. This article aims to provide the first thorough survey on a promising research subject that exists at the intersection of two well-established domains, i.e., QoE and m-health, and is driven by the continuing efforts to define 6G. This survey, in particular, creates a link between these two seemingly distinct domains by identifying and discussing the role of 6G in m-health applications from a QoE viewpoint. We start by exploring the vital role of QoE in m-health multimedia transmission. Moreover, we examine how m-health and QoE have evolved over the cellular network’s generations and then shed light on several critical 6G technologies that are projected to enable future m-health services and improve QoE, including reconfigurable intelligent surfaces, extended radio communications, terahertz communications, enormous ultra-reliable and low-latency communications, and blockchain. In contrast to earlier survey papers on the subject, we present an in-depth assessment of the functions of 6G in a variety of anticipated m-health applications via QoE. Multiple 6G-enabled m-health multimedia applications are reviewed, and various use cases are illustrated to demonstrate how 6G-enabled m-health applications are transforming human life. Finally, we discuss some of the intriguing research challenges associated with burgeoning multimedia m-health applications. Full article

Fifth-generation (5G) networks offer high-speed data transmission with low latency, increased base station volume, improved quality of service (QoS), and massive multiple-input–multiple-output (M-MIMO) channels compared to 4G long-term evolution (LTE) networks. However, the COVID-19 pandemic has disrupted the achievement of mobility and handover (HO) in 5G networks due to significant changes in intelligent devices and high-definition (HD) multimedia applications. Consequently, the current cellular network faces challenges in propagating high-capacity data with improved speed, QoS, latency, and efficient HO and mobility management. This comprehensive survey paper specifically focuses on HO and mobility management issues within 5G heterogeneous networks (HetNets). The paper thoroughly examines the existing literature and investigates key performance indicators (KPIs) and solutions for HO and mobility-related challenges while considering applied standards. Additionally, it evaluates the performance of current models in addressing HO and mobility management issues, taking into account factors such as energy efficiency, reliability, latency, and scalability. Finally, this paper identifies significant challenges associated with HO and mobility management in existing research models and provides detailed evaluations of their solutions along with recommendations for future research. Full article

Various kinds of powerful intelligent mobile devices (MDs) need to access multimedia content anytime and anywhere, which places enormous pressure on mobile wireless networks. Fetching content from remote sources may introduce overly long accessing delays, which will result in a poor quality of experience (QoE). In this article, we considered the advantages of combining mobile/multi-access edge computing (MEC) with device-to-device (D2D) technologies. We propose a D2D-enabled cooperative edge caching (DCEC) architecture to reduce the delay of accessing content. We designed the DCEC caching management scheme through the maximization of a monotone submodular function under matroid constraints. The DCEC scheme includes a proactive cache placement algorithm and a reactive cache replacement algorithm. Thus, we obtained an optimal content caching and content update, which minimized the average delay cost of fetching content files. Finally, simulations compared the DCEC network architecture with the MEC and D2D networks and the DCEC caching management scheme with the least-frequently used and least-recently used scheme. The numerical results verified that the proposed DCEC scheme was effective at improving the cache hit ratio and the average delay cost. Therefore, the users’ QoE was improved. Full article

With the advancement of internet technologies and multimedia applications, the spectrum scarcity problem is becoming more acute. Thus, spectral-efficient schemes with minimal interference for IoT networks are required. Device-to-device communication (D2D) technology has the potential to solve the issue of spectrum scarcity in future wireless networks. Additionally, throughput is considered a non-convex and NP-hard problem, and heuristic approaches are effective in these scenarios. This paper presents two novel heuristic approaches for throughput optimization for D2D users with quality of service (QoS)-aware wireless communication for mobile users (MU): the modified whale colony optimization algorithm (MWOA) and modified non-domination sorted genetic algorithm (MNSGA). The performance of the proposed algorithms is analyzed to show that the proposed mode selection technique efficiently fulfills the QoS requirements. Simulation results show the performance of the proposed heuristic algorithms compared to other understudied approaches. Full article

Vehicles serve as mobile nodes in a high-mobility MANET technique known as the vehicular ad hoc network (VANET), which is used in urban and rural areas as well as on highways. The VANET, based on 5G (5G-VANET), provides advanced facilities to the driving of vehicles such as reliable communication, less end-to-end latency, a higher data rate transmission, reasonable cost, and assured quality of experience (QoE) for delivered services. However, the crucial challenge with these recent technologies is to design a real-time multimedia traffic shaping that maintains smooth connectivity under the unpredictable change of channel capacity and data rate due to handover for rapid vehicle mobility among roadside units. This research proposes a smart real-time multimedia traffic shaping to control the amount and the rate of the traffic sent to the 5G-VANET based on distributed reinforcement learning (RMDRL). The proposed mechanism selects the accurate decisions of coding parameters such as quantization parameters, group of pictures, and frame rate that are used to manipulate the required traffic shaping of the multimedia stream on the 5G-VANET. Furthermore, the impact of the aforementioned three coding parameters has been comprehensively studied using five video clips to achieve the optimal traffic rate value for real-time multimedia streaming on 5G communication. The proposed algorithm outperforms the baseline traffic shaping in terms of peak-signal-to-noise-ratio (PSNR) and end-to-end frame delay. This research will open new comfortable facilities for vehicle manufacturing to enhance the data communication system on the 5G-VANET. Full article

Historically, the optical access network (OAN) plays a crucial role of supporting emerging new services such as 4 k, 8 k multimedia streaming, telesurgery, augmented reality (AR), and virtual reality (VR) applications in the context of Tactile Internet (TI). In order to prevent losing connectivity to the current mobile network and Tactile Internet, the OAN must expand capacity and improve the quality of Services (QoS) mainly for the low latency of 1 ms. The optical network has adopted artificial intelligence (AI) technology, such as deep learning (DL), in order to classify and predict complex data. This trend mainly focuses on bandwidth prediction. The software-defined network (SDN) and cloud technologies provide all the essential capabilities for deploying deep learning to enhance the performance of next-generation ethernet passive optical networks (NG-EPONs). Therefore, in this paper, we propose a deep learning long-short-term-memory model-based predictive dynamic wavelength bandwidth allocation (DWBA) mechanism, termed LSTM-DWBA in NG-EPON. Future bandwidth for the end-user is predicted based on NG-EPON MPCP control messages exchanged between the OLT and ONUs and cycle times. This proposed LSTM-DWBA addresses the uplink control message overhead and QoS bottleneck of such networks. Finally, the extensive simulation results show the packet delay, jitter, packet drop, and utilization. Full article

Next generation mobile networks are expected to integrate multiple drones organized in Flying Ad Hoc Networks (FANETs) to support demanding and diverse services. The highly mobile drones should always be connected to the network in order to satisfy the strict requirements of upcoming applications. As the number of drones increases, they burden the network with the management of signaling and continuous monitoring of the drones during data transmission. Therefore, designing transmission mechanisms for fifth-generation (5G) drone-aided networks and using clustering algorithms for their grouping is of paramount importance. In this paper, a clustering and selection algorithm of the cluster head is proposed together with an efficient Group Handover (GHO) scheme that details how the respective Point of Access (PoA) groups will be clustered. Subsequently, for each cluster, the PoA elects a Cluster Head (CH), which is responsible for manipulating the mobility of the cluster by orchestrating the handover initiation (HO initiation), the network selection, and the handover execution (HO execution) processes. Moreover, the members of the cluster are informed about the impending HO from the CH. As a result, they establish new uplink and downlink communication channels to exchange data packets. In order to evaluate the proposed HO scheme, extensive simulations are carried out for a next-generation drone network architecture that supports Internet of Things (IoT) and multimedia services. This architecture relies on IEEE 802.11p Wireless Access for Vehicular Environment (WAVE) Road Side Units (RSUs) as well as Long-Term Evolution Advanced (LTE-A) and IEEE 802.16 Worldwide Interoperability for Microwave Access (WiMAX). Furthermore, the proposed scheme is also evaluated in a real-world scenario using a testbed deployed in a controlled laboratory environment. Both simulation and real-world experimental results verify that the proposed scheme outperforms existing HO algorithms. Full article

Seamless management of producer mobility in named data networks (NDNs) has become an inherent requirement to satisfy the ever-increasing number of mobile user devices and the streaming of widespread real-time multimedia content. In this paper, we first classify the various producer mobility management (MM) schemes into four different approaches. Then, we select a representative scheme from each approach and conduct a comparative analysis between them to suggest the most suitable producer MM approach for a broad class of latency sensitive applications, such as video and audio streaming and broadcasting over NDNs. To assess and compare the efficiency and effectiveness of the representative schemes, we implemented them in the NDN defacto NdnSIM simulator and used the same network scenarios and mobility settings. The results show the superiority of the producer MM scheme that follows the data plane-based approach, which yielded lower data loss rates, lower data delivery delays and lower signaling overheads. Full article