Next Article in Journal
An Interleaved Battery Charger Circuit for a Switched Capacitor Inverter-Based Standalone Single-Phase Photovoltaic Energy Management System
Previous Article in Journal
A Study of Passenger Car Cabin Pre-Ventilation under the Sun
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Advanced Power Converters and Learning in Diverse Robotic Innovation: A Review

by
Rupam Singh
1,
Varaha Satya Bharath Kurukuru
2 and
Mohammed Ali Khan
3,*
1
Mærsk Mc Kinney Møller Instituttet, SDU Robotics, University of Southern Denmark, Campusvej 55, 5230 Odense, Denmark
2
Research Division Power Electronics, Silicon Austria Labs GmbH, Europastraße 12, 9524 Villach, Austria
3
Centre for Industrial Electronics (CIE), University of Southern Denmark, Alsion 2, 6400 Sønderborg, Denmark
*
Author to whom correspondence should be addressed.
Energies 2023, 16(20), 7156; https://doi.org/10.3390/en16207156
Submission received: 26 September 2023 / Revised: 14 October 2023 / Accepted: 17 October 2023 / Published: 19 October 2023
(This article belongs to the Section F3: Power Electronics)

Abstract

:
This paper provides a comprehensive review of the integration of advanced power management systems and learning techniques in the field of robotics. It identifies the critical roles these areas play in reshaping the capabilities of robotic systems across diverse applications. To begin, it highlights the significance of efficient power usage in modern robotics. The paper explains how advanced power converters effectively control voltage, manage current and shape waveforms, thereby optimizing energy utilization. These converters ensure that robotic components receive the precise voltage levels they require, leading to improved motor performance and enabling precise control over motor behavior. Consequently, this results in extended operational times and increased design flexibility. Furthermore, the review explores the integration of learning approaches, emphasizing their substantial impact on robotic perception, decision-making and autonomy. It discusses the application of techniques such as reinforcement learning, supervised learning and unsupervised learning, showcasing their applications in areas like object recognition, semantic segmentation, sensor fusion and anomaly detection. By utilizing these learning methods, robots become more intelligent, adaptable and capable of autonomous operation across various domains. By examining the interaction between advanced power management and learning integration, this review anticipates a future where robots operate with increased efficiency, adapt to various tasks and drive technological innovation across a wide range of industries.

1. Introduction

Industrial robots have a wide range of applications across various industries, including tasks like handling, painting, assembly, welding and more [1,2,3]. In fields like autonomous vehicles, machine-learning algorithms process sensor data to make real-time decisions, enabling vehicles to navigate and respond intelligently to complex environments [4,5,6]. In healthcare, robots equipped with AI can assist in surgeries, diagnose illnesses and even provide emotional support to patients [7,8,9]. Manufacturing processes are streamlined through AI-driven robotics that optimize production lines and adapt to changing demands [10,11].
Furthermore, in sectors like agriculture, AI-powered drones and robotic systems can monitor and tend to crops with precision, leading to enhanced yields and resource management. Search-and-rescue operations benefit from robots that can analyze disaster scenarios and navigate hazardous environments autonomously [12,13,14,15]. In the service industry, AI-driven robots are employed in customer interactions, from chatbots resolving inquiries to robots providing room service in hotels. Household robotics, such as smart vacuum cleaners, leverage machine learning to map and clean spaces effectively [16,17,18].
The integration of AI and machine learning with robotics also enhance the development of human–robot collaboration. Robots can understand and adapt to human behavior, making them safer and more intuitive to work alongside. The effectiveness and performance of the robot’s manipulative actions in any field of operation primarily depend on the dynamic response of its internal drive system [19,20]. This internal drive system has several impacts on the environment, depending on its design, efficiency and energy source. This concept encompasses the idea of robots being able to adapt, improve and learn from their interactions with their environment, tasks and humans.The control and conversion of electrical energy is responsible for highly efficient robotic systems such as when a robot performs a mix of high-energy and low-energy tasks; learning-based control can allocate energy resources dynamically [21,22,23]. It can optimize power distribution to different actuators based on the priority of tasks. They aim to optimize the efficiency of energy transfer from the power source to the actuators. This is particularly important in robotics, where energy efficiency translates to longer battery life, reduced heat generation and overall better performance [24,25].
Some robots use regenerative braking to capture and store energy generated during deceleration or braking [26,27,28]. Power electronics systems facilitate this process by converting the captured energy into a form that can be stored or reused, thereby increasing energy efficiency. Actuators, like motors, may require different voltage levels and current intensities for different tasks. Power electronics components can regulate these parameters to match the requirements of the specific task the robot is performing [29,30,31]. Another big advancement is use of wireless power transfer in unmanned aerial vehicles as it can transfer the transmission of electrical power from a source to the drone without the need for physical wires or connectors [32,33,34,35]. This technology has the potential to revolutionize the way UAVs are powered and operated, offering benefits such as extended flight times, improved convenience and reduced downtime for recharging.
On the other side, irrespective of the nature of the mission, the primary complexities in the design of multirotor UAVs are shaped by the imperative to optimize payload capacity, maneuverability and flight duration. The capacity to carry payloads and the agility of these UAVs are intertwined with the proportions and mass of their propulsion elements, which directly relate to their power-to-weight ratio. Conversely, the duration of flight hinges on the energy stored and the effectiveness of the propulsion system, encompassing propellers and energy-storage mechanisms [36,37,38,39]. It is widely recognized that efficiency and power density are contrasting prerequisites. To solve this problem, a strong propulsion system has been developed which achieves the high-power density targets for UAVs, while at the same time demonstrating high efficiency and addressing the resiliency and reliability requirements.
In light of all the above developments that are underway, this review addresses the emerging synergy between advanced power management and learning approaches in robotics, highlighting the potential to significantly enhance the capabilities of robotic systems. As industries increasingly rely on robotics, grasping the critical importance of this fusion becomes imperative. Further, with robotics no longer confined to a single industry but spanning across diverse sectors such as manufacturing, healthcare, agriculture and disaster response, this review highlights how these advancements have a far-reaching impact, making it highly relevant to a broad audience. Moreover, in an era of heightened sustainability and environmental consciousness, the optimization of energy utilization in robotics takes center stage. The paper identifies the role of advanced power converters and energy management in promoting energy efficiency—a pressing concern for organizations and governments alike. Lastly, the review explores technologies, including wireless power transfer for UAVs and regenerative braking, addressing how these developments have the potential to disrupt existing paradigms and introduce new possibilities for the field of robotics. In contrast to previous reviews in the field, this paper introduces a fresh perspective on energy harvesting for robotics, emphasizing emerging and innovative solutions that have received limited attention in existing literature. The novel aspects of this review article are as follows:
  • The review discusses the integration of various machine-learning and AI methods, including reinforcement learning, supervised learning, unsupervised learning and Bayesian techniques, showcasing the diverse approaches being used to enhance robotic innovation.
  • It explores the use of state-of-the-art energy-harvesting technologies, highlighting the latest developments in solar energy for robotic applications.
  • The review discusses supercapacitors as a fast-charging alternative to batteries, emphasizing their structural flexibility and the potential for integrating them into robotic systems.
  • The review mentions the potential use of polymer electrolyte membrane fuel cells for higher energy density in large robots like UAVs, presenting hydrogen fuel as a promising and economical option for renewable energy in robotics.
The major highlights of this article are as follows:
  • Emerging synergy between advanced power management and learning integration in robotics.
  • Emphasis on energy efficiency through advanced power converters.
  • Learning integration enhancing robotic perception, decision-making and autonomy.
Further, the paper is structured as follows: Section 2 delves into the role of advanced power management systems in robotics, discussing various types of power converters and advancements in power-converter technologies. Section 3 focuses on learning approaches in robotic innovation, covering machine-learning fundamentals, enhancing robotic perception and elevating decision-making processes. Section 4 discusses energy harvesting in robotic applications. Section 5 explores technical advancements observed, emphasizing the influence of integration on robotic applications and highlighting emerging technologies. Finally, Section 6 provides conclusions drawn from the discussions in the paper.

2. Advanced Power Converters in Robotics

Power converters play a pivotal role in robotics by facilitating efficient energy conversion and management [23,40]. In this section, the significance of power converters in robotics is discussed, as well as the various types utilized, recent technological advancements and case studies, highlighting their influence on robotic performance and energy efficiency. Figure 1 illustrates the schematic representation of the robotic system’s partitioning, shedding light on the essential components that collectively enable the robot’s operation.

2.1. Role of Power Converters in Robotics

In the dynamic landscape of robotics, where energy-efficient operation is predominant, power converters serve as the bridge between energy sources and the electrical demands of robotic subsystems [21,41]. The role of power converters encompasses several key aspects:
  • Voltage Regulation: Robotic systems incorporate components with diverse voltage requirements. Power converters provide efficient voltage regulation, ensuring that sensors, microcontrollers and other components receive the appropriate voltage levels. This not only prevents potential damage due to overvoltage but also maximizes the efficiency of these components [40,42].
  • Current Management: Motors and actuators, crucial for robotic motion and manipulation, often require varying current levels [43]. Power converters enable precise current control, allowing dynamic adjustment to match the specific demands of each task. This adaptability results in optimized motor performance and enhanced control accuracy [44].
  • Waveform Shaping: Certain robotic components require specific waveform characteristics, such as sinusoidal signals for AC motors. Power converters facilitate waveform shaping, converting DC power to AC with the desired frequency and amplitude, thereby enabling precise control over motor behavior [45,46].
  • Energy Efficiency: By minimizing energy losses during conversion and distribution, power converters contribute significantly to overall energy efficiency in robotic systems. Efficient power conversion reduces wasted energy as heat, leading to prolonged operational times and reduced battery replacements [21,40].
Figure 1. Schematic Representation of Robotic System Partitioning, highlighting the integration of Power Supplies, Converters, Control Box and Sensing Systems for the Robot’s Operation.
Figure 1. Schematic Representation of Robotic System Partitioning, highlighting the integration of Power Supplies, Converters, Control Box and Sensing Systems for the Robot’s Operation.
Energies 16 07156 g001

2.2. Types of Power Converters in Robotics

The complex landscape of robotic applications necessitates a spectrum of power-converter types tailored to specific demands. Figure 2 presents an overview of the power-converter technologies that find applications across various robotic systems.

2.2.1. DC–DC Converters

DC–DC converters are pivotal in robotics, providing voltage step-up or step-down capabilities. For instance, in battery-powered robots, where the available voltage decreases as the battery discharges, DC–DC converters maintain stable voltage levels for critical components. Additionally, as robots integrate sensors and actuators with distinct voltage requirements, these converters ensure compatibility across the system [47].

2.2.2. DC–AC Converters

In robotics, DC–AC converters or inverters play a central role in converting DC power from batteries to AC power for motor-driven systems [48]. Advanced inverter technologies, including advanced modulation schemes like sinusoidal pulse width modulation (SPWM), enable precise control over AC motor characteristics, such as torque, speed and position. This level of control enhances robotic locomotion, manipulation and even aerial operations [49].

2.2.3. AC–DC Converters

AC–DC converters or rectifiers are essential for robotic systems that require power input from alternating current (AC) sources [50]. These converters not only rectify AC power to DC for internal use but also allow robots to draw power directly from AC grids. Charging stations for electric robots, as well as industrial robots operating in environments with readily available AC power, benefit from AC–DC converters.
Figure 2. Power Converters for Diverse Robotic Applications.
Figure 2. Power Converters for Diverse Robotic Applications.
Energies 16 07156 g002

2.2.4. Resonant Converters

Resonant converters utilize resonant components to achieve efficient power conversion with reduced switching losses. This feature makes them valuable for wireless power-transfer applications within robotics, enabling energy delivery without physical connections [51]. Resonant converters are employed in scenarios like charging robotic devices over short distances or even wirelessly powering sensors in remote locations [52,53].

2.2.5. Multi-Level Converters

Robotic systems often demand power converters that can handle high voltages while minimizing harmonic distortion. Multi-level converters achieve this by generating stepped voltage waveforms, reducing stress on components and improving overall system efficiency [54,55]. Applications include high-power robotic arms, where precise motion control requires efficient and high-voltage power conversion.

2.2.6. Soft-Switching Converters

Soft-switching converters focus on reducing switching losses during power conversion. These converters utilize techniques like Zero Voltage Switching (ZVS) and Zero Current Switching (ZCS) to minimize stress on semiconductor devices, leading to improved efficiency and reduced electromagnetic interference (EMI) [56]. In robotics, soft-switching converters find use in high-frequency motor drives and precision robotics that demand minimal energy loss and EMI [57].

2.2.7. Matrix Converters

Matrix converters perform direct AC–AC conversion without intermediate DC links [58]. This feature offers advantages in terms of efficiency, size and reduced components. In robotics, matrix converters can be applied to variable-speed motor drives and actuators [59], facilitating fine-tuned control and efficient power management.

2.2.8. Dual Active Bridge Converters

Dual Active Bridge (DAB) converters provide bidirectional AC–DC conversion, enabling power flow in both directions. This characteristic suits applications where energy regeneration and grid connection are important, such as grid-tied robotics or robots operating in dynamic environments where power needs fluctuate [60].
By understanding and harnessing the capabilities of these advanced power converters, robotics can achieve higher levels of performance, efficiency and adaptability across a wide range of applications. Table 1 provides a comprehensive overview of the key advancements in power-converter technologies for robotics, highlighting the benefits they offer and the specific applications where they find utility. These advancements represent critical milestones in the evolution of robotic systems, enabling enhanced performance, efficiency and adaptability.

2.3. Advancements in Power-Converter Technologies for Robotics

Robotic systems are witnessing transformative impacts due to advancements in power-converter technologies. Table 2 highlights several significant advancements in power-converter technologies for robotics. These advancements are tailored to address the unique challenges and opportunities in robotics.

2.3.1. Integration of Wide-Bandgap Semiconductors

Wide-bandgap materials, notably silicon carbide (SiC) and gallium nitride (GaN), have revolutionized power-converter design. The unique material properties of SiC and GaN enable higher operating temperatures, reduced conduction and switching losses and faster switching speeds [64,65]. In robotics, this translates to increased power-converter efficiency, reduced cooling requirements and improved power density. These benefits are particularly relevant for robots operating in extreme environments, such as industrial automation, space exploration and search-and-rescue missions [66,67].

2.3.2. Enhanced High-Frequency Operation

Robotics often demands compactness and agility. Advancements in high-frequency operation have enabled power converters to operate at frequencies beyond conventional limits [68]. Higher switching frequencies allow for the miniaturization of passive components like inductors and capacitors, resulting in more compact converter designs. This is pivotal in creating lightweight robots that exhibit improved agility, responsiveness and energy efficiency [69,70].
Table 2. Advancements in Power-Converter Technologies for Robotics.
Table 2. Advancements in Power-Converter Technologies for Robotics.
AdvancementDescriptionBenefitsApplications
GaN Transistors [71,72]High-efficiency, fast-switching transistors enabling compact power converters.Reduced power losses, smaller form factors, improved thermal management.Industrial robots, drones, electric vehicles.
SiC Devices [73]High-temperature, high-power devices for efficient and reliable converters.Higher power handling, reduced cooling requirements, better performance in harsh environments.Electric propulsion, extreme environment robotics.
Digital Power Management [74,75]Real-time parameter adjustment for adaptable and efficient converters.Improved adaptability, energy efficiency, remote monitoring.Mobile robots, medical robots, automation.
Resonant Converter Topologies [76,77,78]Reduced switching losses, high efficiency, low electromagnetic interference.Improved efficiency, reduced heat, less EMI.Renewable energy, wireless charging.
Hybrid and Multilevel Converters [79,80]Combined topologies for efficiency and voltage control.Enhanced efficiency, reduced distortion, improved voltage control.Electric grids, robotic vehicles, renewables.
Advanced Cooling Techniques [81,82,83]Innovative cooling for efficient operation in confined spaces.Improved thermal management, higher power handling, compact designs.High Performance Computing (HPC) clusters, motor drives, confined spaces.
Advanced Control Algorithms [84,85,86]Precise regulation for changing conditions and loads.Enhanced accuracy, better response, improved stability.Prosthetics, haptics, precision control.
Wireless Power Transfer [71,87,88]Wireless charging for convenience and seamless integration.Convenience, reduced wear, seamless integration.Mobile robotics, drones, underwater robots.

3. Learning Approaches for Robotic Innovation

In recent years, combining machine learning and artificial intelligence with robots has led to significant progress. This section explores the technical aspects of these learning methods, explaining how they contribute to improving different aspects of robot development [89,90].

3.1. Machine Learning and AI Fundamentals in Robotics

Machine-learning techniques in robotics involve the development of algorithms that enable robots to improve their performance based on data-driven experiences. Reinforcement learning (RL), supervised learning and unsupervised learning serve as the major aspects of these approaches [91,92,93]. RL involves training robots to take actions that maximize a cumulative reward signal. In RL, an agent interacts with an environment and learns to make optimal decisions through trial and error [94]. Techniques such as Q-learning, Deep Q Networks (DQN) [95] and Proximal Policy Optimization (PPO) [96] enable robots to navigate intricate environments and accomplish tasks autonomously. RL algorithms, utilizing exploration and exploitation strategies, have demonstrated exceptional performance in domains like autonomous driving, robotic manipulation and game playing [97,98,99]. Figure 3 provides a visual representation of the profound impact of AI on robotic systems across diverse sectors.
Figure 3. AI in robotic applications across various industries.
Figure 3. AI in robotic applications across various industries.
Energies 16 07156 g003
Further, supervised learning equips robots with the ability to generalize from labeled datasets. Convolutional Neural Networks (CNNs) have proven pivotal for tasks like object recognition and image segmentation. These networks automatically learn hierarchical features from visual data, enabling the identification of objects and scenes [100,101]. Recurrent Neural Networks (RNNs) extend the capabilities of robots to sequential data, enabling tasks like natural language processing and gesture recognition. The supervised learning paradigm, by leveraging large-scale annotated datasets, has led to substantial progress in enabling robots to perceive and interpret their surroundings accurately [102,103,104]. Furthermore, unsupervised learning encompasses diverse techniques that allow robots to uncover patterns and structures within data. Dimensionality-reduction methods, such as Principal Component Analysis (PCA) [105,106] and t-SNE [107], aid in reducing the complexity of sensory data while preserving essential information. Clustering algorithms, like K-means [108,109,110] and Gaussian Mixture Models (GMM) [111,112], facilitate grouping similar data points together. Generative models, including Variational Autoencoders (VAEs) [113,114] and Generative Adversarial Networks (GANs) [115,116], enable robots to learn data distributions and generate novel samples. These unsupervised techniques empower robots to autonomously explore and understand their environments without the need for explicit labels.

3.2. Enhancing Robotic Perception

Robotic perception heavily relies on machine-learning approaches, particularly in the domains of computer vision and sensor fusion. Supervised learning is pivotal for tasks like object recognition, where CNNs excel [117]. CNNs automatically learn hierarchical features from labeled images, enabling robots to detect and classify objects with remarkable accuracy [118,119,120]. Transfer learning, a technique within supervised learning, enables models trained on large datasets (e.g., ImageNet) to be fine-tuned for specific robotic tasks with limited labeled data [121,122,123]. In addition, unsupervised learning techniques play a crucial role in sensor fusion, where data from multiple sensors (such as cameras, LiDAR and IMUs) are combined to create a holistic understanding of the environment [124,125]. By applying unsupervised methods like Independent Component Analysis (ICA) [126,127,128] or Canonical Correlation Analysis (CCA) [129,130], robots can identify relationships between sensor modalities, enhancing their ability to perceive and interpret complex scenes. Figure 4 provides a brief overview of the essential technological clusters that support various aspects of modern robotics.

3.2.1. Object Recognition and Detection

Supervised learning techniques, particularly CNNs, have revolutionized object recognition and detection in robotics. CNNs excel in learning hierarchical features directly from raw pixel data, enabling the extraction of intricate visual patterns [131]. Transfer learning is frequently employed wherein pre-trained CNN models (e.g., ResNet, VGG) on massive image datasets are fine-tuned for specific robotic tasks. This approach allows robots to discern objects even in scenarios with limited labeled data [132,133]. Furthermore, the fusion of object detection frameworks, like Single Shot MultiBox Detector (SSD) [134,135,136] and You Only Look Once (YOLO) [137,138,139], with CNNs enables real-time object localization and tracking. These techniques, driven by machine learning, equip robots to interact with their surroundings intelligently by recognizing and localizing objects of interest.

3.2.2. Semantic Segmentation and Scene Understanding

Semantic segmentation [140], a pixel-level labeling task, is pivotal for robots to understand scene semantics accurately. Deep-learning architectures, such as Fully Convolutional Networks (FCNs) [141,142] and U-Net [143,144], have proven indispensable for semantic segmentation tasks. These networks leverage encoder–decoder architectures with skip connections to capture both local and global contextual information, enabling accurate pixel-wise categorization of objects and regions within a scene. Scene understanding is further enhanced via unsupervised learning methods. By leveraging techniques like Generative Adversarial Networks (GANs) [145,146], robots can perform unsupervised domain adaptation. This enables the model to generalize its perception capabilities from a source domain to a target domain without requiring explicit annotations. Such adaptation ensures robust performance of perception systems in diverse and dynamic environments.

3.2.3. Sensor Fusion for Multi-Modal Perception

Robotics often relies on data from multiple sensors, necessitating robust sensor fusion techniques [147]. Machine-learning approaches, specifically probabilistic methods like Bayesian filtering, play a pivotal role in combining information from various sensors (e.g., cameras, LiDAR, IMUs) to generate a coherent representation of the environment [148,149,150]. Moreover, Kalman Filters and their variants (Extended Kalman Filter, Unscented Kalman Filter) are extensively used for sensor fusion, enabling estimation of the robot’s state and the environment’s structure [151,152,153]. Additionally, Particle Filters provide a non-parametric approach to handle non-linear and non-Gaussian distributions [154,155]. Further, deep-learning techniques have also penetrated sensor fusion, where RNNs [151,156] process sequential sensor data effectively. Long Short-Term Memory (LSTM) [151,157] networks, a type of RNN, are employed to model temporal dependencies in sensor streams, enhancing the robot’s ability to predict dynamic changes in the environment.

3.2.4. Anomaly Detection

Unsupervised learning techniques are harnessed for anomaly detection, allowing robots to identify deviations from expected behavior [158]. One-Class SVMs (Support Vector Machines) [159], Autoencoders [160] and VAEs [161,162] are employed to learn the normal data distribution and subsequently detect anomalies. This is crucial for applications like fault detection in industrial robotics or identifying unfamiliar objects in a scene.

3.3. Elevating Decision-Making Processes

The use of different learning methods, especially reinforcement learning (RL), has brought a big change in how robots make decisions. Reinforcement learning is about training robots to make a series of choices in order to obtain the best overall rewards in their environment. It involves complex algorithms that combine trying out new actions with choosing actions that have worked well before to learn the best ways to do things [163,164,165,166]. Deep Reinforcement Learning (DRL) has become popular for improving robot decision-making by using deep neural networks to handle complicated situations. This is particularly useful in tasks like robotic arm manipulation [92,93,167,168,169,170]. Algorithms like Trust Region Policy Optimization (TRPO) and Soft Actor-Critic (SAC) are good at fine-tuned actions for precise tasks [171,172,173,174,175]. Model Predictive Control (MPC) combined with RL helps robots adjust their actions to deal with unexpected changes in the environment, like in legged locomotion [176,177]. Exploration methods, like Monte Carlo Tree Search (MCTS) and Proximal Policy Optimization (PPO), help robots make good decisions even in complex situations [178,179,180,181,182,183]. Hierarchical RL makes decision-making more efficient by breaking it down into smaller steps. Robots can also learn from human-like behavior and adapt using RL [184,185]. Lastly, handling uncertainty in the environment is important and Bayesian RL helps robots make decisions while considering potential risks [186,187,188,189,190,191,192,193]. All of this has transformed how robots work in different fields, from manipulation to agile movement, making them smarter and more adaptable. Table 3 offers a concise overview of various learning methods that play a pivotal role in enhancing robot decision-making capabilities. These methods harness the power of AI and machine learning to enable robots to make informed choices and adapt to dynamic environments.

4. Energy Harvesting for Robotic Application

Developments in robotic system over the years have made industrial robots more accessible and user-friendly. However one of the major limitations to the accessibility is related to the self-powered robots, energy storage and conservation between different operating stages [89].
The challenges related to the energy requirement for the operation of the robotics can be easily solved by the energy-harvesting methods. The harvesting can be easily done by generating the power from renewable-energy sources such as thermal, solar and kinetic. Using a renewable alternative to act as a power source for the robotics equipment can lead to a self-powered robotic operation. Hence, it is one of the most innovative research areas for the evolution of robotics [194].
Solar energy is one of the easiest available forms of energy as the global irradiance is somewhere near between 100 to 250 W/m2 throughout the year. There has been a lot of development in the solar harvesting as there are studies on thin films which are more convenient and efficient to put on a robotic installation. There are solar cells with dye-sensitized solar cells (DSSCs), copper indium gallium diselenide (CIGS), perovskite solar cells (PSCs) and organic solar cell (OSCs) which are being used widely in the field of robotics [195]. The idea behind the development of different material-based solar cells is to improve the efficiency and reliability of the solar cell along with providing more flexibility to the cell so that it can be installed around the robot [196]. We have covered commercial thin film being placed on a robot to bendable, stretchable and wearable solar film.
Thermoelectrical alternative is also one of the prominent energy-harvesting methods where the change in temperature is used to generates a certain amount of energy [197]. For the generation, p and n of a semiconductor are connected in series electrical and parallel for thermal operation. There are a lot of efforts being devoted to developing a wearable thermoelectrical generation material. The idea is to capture the heat generated during the operation and convert it into energy for further operation, creating a close loop. A wearable thermoelectric unit can generate up to 38 μWcm−2 from a human body [198]. Innovations have significantly reduced the power requirement by different drivers being implemented, but there still persists a challenge regarding the power sharing between the different drivers as many of the robotic operations are comprised of multiple degrees of freedom during the operation.
Further, developments in battery technology have also impacted the application characteristics of the robots [199]. Previously, the robots needed to have access to power cords for long operational runs or the battery would usually run out faster when the motors operate at their maximum efficiency. There has been a lot of progress in battery technology in the past decade [200]. These changes have resulted in longer-lasting batteries with higher efficiency and robustness. Previously, the batteries used are usually rechargeable and primarily alkaline batteries. Later, for commercial application, batteries such as lead acid, lithium-ion and nickel-metal hydride became popular as they were cheaper for commercial use and can be used in a wide range of operating temperatures [201]. Lead acid batteries presented some challenges with limited life span and low energy density for portable operation. However, few of the issues were overcome by nickel-metal hydride as such batteries have been widely used for autonomous vehicles. Nickel-metal hydride presents advantages with longer durability and faster charging speed. Further, on comparing the nickel-metal hydride battery to lithium-ion, it can be observed that operating temperature still remains an issue as it may cause trouble under extreme conditions. Other than that, issues related to lower specific power and higher operating cost are also present. This forces the modern electric vehicle to switch back to the lithium-ion alternative [202].
Apart from battery technology, there has been a significant development taking place in the field of super capacitors as they provide a fast-charging alternative to batteries [203]. In [204], the authors developed an approach to enhance the performance of Micro Air Vehicles (MAVs) through innovative power-conservation strategies. By employing plasmonics nano-antenna technology, the research had promising results, with a potential mission duration improvement of 16.30 min, offering an insight into the future of MAV capabilities. Predominantly, the supercapacitors can be characterized as either electrochemical pseudo-capacitors or electric double-layer capacitors. The property for charging on the electrical double-layer capacitor is similar to that of the conventional capacitor in which the charge is stored though rapid absorption and desorption of electrons. Because of its unique charge mechanism, the supercapacitors present faster charging and discharging rates [205]. Along with all the advantages, the supercapacitors are deemed to be environmentally friendly when compared to the battery. More then that, because of their stretchability and structural properties, supercapacitors are a great alternative for a wearable robotic system. Table 4 presents a comprehensive overview of energy-harvesting techniques and the associated considerations that play a pivotal role in powering robotic systems.
It can be deduced from the study that the renewable-energy sources do provide an attractive alternative to the power sources which also results in reduction of size, weight and increase in endurance. The integration of renewables with robot systems accounts for the storage and energy-generation unit. Energy requirements for larger robots such as UAVs or drones will need to have a high energy density power supply for longer operation [206]. Polymer electrolyte membrane fuel cells are mostly preferred for delivering higher energy density performance along with higher energy gravimetrics. Fuel cells use the chemical properties to store the energy instead of wasting heat. Because of the higher efficiency and greater potential to upscale, the fuel cell technology holds the key to the future. The scope of hydrogen fuel is also very economical for the consumer as the green transition for energy generation and storage is promoted by such alternatives.

4.1. Classification of Robots by Power Supply

Robots can be classified into different categories based on their power-supply methods. The choice of power supply is a critical consideration in the design and operation of robots, as it impacts their mobility, energy efficiency and adaptability to specific applications. Here, we categorize robots into four main groups based on their power-supply methods:

4.1.1. Galvanic Contact-Powered Robots

Galvanic contact-powered robots are stationary or fixed in place, receiving power through direct electrical connections, typically via cords or cables. This method offers high energy efficiency as there is minimal energy loss during power transmission. They are commonly used in industrial settings, such as manufacturing lines and CNC machines, where tasks do not require mobility. The advantages of galvanic contact power include high energy efficiency, continuous operation and minimal downtime. However, these robots have limited mobility and range due to their fixed power sources.

4.1.2. Electromagnetic Wave-Powered Robots

Electromagnetic wave-powered robots receive their energy through wireless transfer methods, often using electromagnetic waves like radio waves or microwaves. This approach provides more degrees of freedom for the robot, making it suitable for applications that require mobility, flexibility or remote operation. Drones and autonomous vehicles are examples of robots that often use electromagnetic wave power transfer. While offering enhanced mobility and adaptability to changing environments, this method may have lower energy efficiency compared to galvanic contact. Potential considerations include lower energy efficiency, the risk of interference and limitations in energy-transfer distance.

4.1.3. Battery-Powered Robots

Battery-powered robots are equipped with onboard batteries that store and supply electrical energy. They are highly mobile and versatile, and suitable for a wide range of applications, including drones, robotic vacuum cleaners and autonomous rovers. The key advantages of battery power include mobility, autonomy and the ability to operate in diverse environments. However, they face considerations such as limited battery life, the need for recharging or battery replacement and challenges related to battery weight and size.

4.1.4. Hybrid Systems

Hybrid systems combine multiple power-supply methods to leverage the strengths of each. For example, a robot may have a primary battery power source and employ energy-harvesting techniques or wireless charging to extend operational capabilities. These systems are found in various applications, including medical robots, solar-powered drones and remote environmental monitoring robots. Their advantages include enhanced flexibility, extended operational range and increased energy efficiency. However, they involve complex system integration, potential trade-offs and the need for advanced power management.

4.1.5. Efficiency Considerations

Each power-supply method has its unique advantages and limitations and the choice of power source depends on the specific requirements of the robot’s application. Efficiency considerations play a vital role in this decision-making process. Here are some key efficiency factors to keep in mind:
  • Energy Efficiency: Galvanic contact power supply is highly efficient, while electromagnetic wave power-transfer methods may have lower efficiency due to energy losses during wireless transmission.
  • Mobility vs. Efficiency: Battery-powered robots offer mobility and autonomy but may have limited operational time between recharges or battery replacements. Electromagnetic wave-powered robots provide mobility but often at the expense of energy efficiency.
  • Hybrid Approaches: Hybrid systems allow for a balance between mobility and energy efficiency by combining power-supply methods. For example, a drone with a primary battery source can use solar panels for energy harvesting during flight, extending its operational time.
  • Application-Specific Considerations: The choice of power supply should align with the specific requirements of the robot’s intended application, considering factors such as mobility, energy demand and operational environment.

5. Technical Advancements Observed

In this section, the significant effects that come from combining advanced power converters and learning methods in robotic systems are explored. By using these technologies together, researchers and engineers have expanded the possibilities of different robotic applications, bringing in a new era of capabilities and efficiencies.

5.1. Integration’s Influence on Robotic Applications

The convergence of advanced power converters and learning approaches has unleashed a wave of innovation across diverse robotic applications. By seamlessly fusing sophisticated power management techniques with intelligent learning algorithms, robotic systems are becoming increasingly adaptable, efficient and capable of tackling complex tasks [207,208,209]. This section investigates the ways in which this integration impacts several key robotic domains:
  • Manufacturing and Automation: The integration of advanced power converters and learning approaches has revolutionized manufacturing processes [210]. Robots equipped with optimized power management systems can dynamically allocate resources, leading to significant energy savings and streamlined operations. Machine-learning algorithms, on the other hand, empower robots to learn from their interactions with the environment, enhancing their ability to handle intricate assembly tasks with precision and adapt to changing production demands [211,212].
  • Healthcare and Medical Robotics: The integration has brought about remarkable advancements in medical robotics. Power converters designed for energy efficiency prolong the operation time of medical robots during critical procedures, while machine learning facilitates the development of robots capable of real-time diagnosis and personalized patient care [213,214]. These robots can learn to interpret medical data and collaborate with healthcare professionals, ultimately improving diagnostics, surgical procedures and patient outcomes.
  • Agriculture and Environmental Monitoring: In agricultural and environmental settings, the synergy of advanced power converters and learning approaches has led to the creation of autonomous robots that can operate for extended periods in remote locations. These robots harness renewable energy sources through advanced converters, enabling prolonged missions for crop monitoring, soil analysis and wildlife observation [215,216,217]. In [218], the authors highlighted the role of geomatics in Agriculture 4.0, demonstrating the integration of diverse data sources such as satellite imagery, UAVs and autonomous vehicles through advanced data-fusion techniques. By optimizing vineyard management and production with methodologies like Normalized Difference Vegetation Index (NDVI) analysis and sensor-equipped autonomous vehicles, the research offered valuable insights for enhancing precision agriculture in the context of Agriculture 4.0. Further, ML algorithms can empower these robots to navigate challenging terrains, identify anomalies and make informed decisions, contributing to sustainable resource management.
  • Search-and-Rescue Missions: The integration plays a pivotal role in enhancing robotic capabilities for search-and-rescue operations. By efficiently managing power resources, robots can operate in disaster-stricken areas for extended durations, maximizing their chances of locating and aiding survivors [219,220]. Learning approaches enable these robots to adapt their search patterns based on evolving conditions and past experiences, significantly increasing their effectiveness in locating and assisting individuals in distress [221,222].

5.2. Emerging Technologies

To provide concrete insights into the transformative potential of integrating advanced power converters and learning approaches, this section highlights the advancements in progress across different domains:
  • Smart Factory Optimization: This case study showcases a manufacturing facility that has implemented advanced power converters to optimize energy consumption. By coupling this with machine-learning algorithms, robots within the factory have learned to predict production fluctuations and adapt their energy usage accordingly. The result is a significant reduction in operational costs and improved overall efficiency [223,224,225].
  • Minimally Invasive Surgery Assistance: Here, we delve into a medical robotics scenario where power converters with rapid response capabilities enable precise movements of surgical instruments. Paired with learning algorithms, the robot learns to interpret real-time physiological data, adjusting its movements to ensure safe and accurate procedures [226,227]. This integration has led to shorter surgery times and improved patient safety.
  • Autonomous Agricultural Monitoring: In the context of agriculture, this case study features autonomous robots powered by renewable energy sources. These robots navigate vast fields, collecting data on crop health and soil conditions. Machine-learning algorithms allow the robots to identify areas requiring special attention and customize their treatment strategies, resulting in higher yields and resource-efficient farming [23,228,229].
  • Disaster Recovery with Aerial Robotics: This aspect focuses on the utilization of aerial drones equipped with advanced power systems and learning algorithms in disaster-stricken areas. These drones can fly longer missions, thanks to energy-efficient converters and employ machine learning to rapidly analyze vast amounts of visual and thermal data [230,231,232]. This integration has drastically reduced response times during disaster-recovery efforts.
Table 5 offers an insight into developments at the intersection of advanced power converters and machine-learning approaches. By examining these aspects and considering their implications across various sectors, it becomes evident that the integration of advanced power converters and learning approaches is a driving force behind the next generation of robotic advancements.

6. Discussion and Future Trends in Robotics

From the above review on various critical aspects of robotics, including the role of advanced power converters, learning approaches and energy-harvesting methods, it is evident that the field of robotics is experiencing significant advancements that are reshaping the landscape of robotic systems. The review on power converters emphasized their pivotal role in robotics. Voltage regulation, current management, waveform shaping and energy efficiency are key aspects of power converters. These capabilities are essential for optimizing the performance and energy efficiency of robotic systems. The trend in power-converter development is towards greater efficiency and adaptability. As robotics applications become more diverse and demanding, the need for advanced power converters that can handle different voltage requirements and provide precise control over current and waveforms is increasing. Additionally, as energy efficiency and sustainability gain importance, power converters are evolving to minimize energy losses and contribute to prolonged operational times. Moreover, various types of power converters used in robotics, from DC–DC converters to matrix converters and soft-switching converters are identified. These diverse converter types cater to different robotic applications and requirements. The trend in this field is towards specialization and innovation in converter design. With the growing demand for robotics in various industries, specialized converters that meet the specific needs of each application are expected to become more prevalent. Further, the review of articles on learning approaches highlighted the crucial role of ML and AI in enhancing robotic perception and decision-making. Reinforcement learning, supervised learning and unsupervised learning are key paradigms in this field. The trend in learning approaches is towards increased autonomy and adaptability. Robots are becoming more capable of perceiving and interpreting their environments, making informed decisions and adapting to dynamic situations. As AI algorithms continue to advance, we can expect further breakthroughs in robotic autonomy and adaptability. Lastly, the review of articles on energy harvesting underlines the importance of energy sources such as solar, thermoelectrical and supercapacitors in powering robotic systems. The trend in energy harvesting is towards sustainability and efficiency. As the world shifts towards greener energy solutions, the integration of renewable energy sources into robotics aligns with environmental and economic considerations. Furthermore, the development of fuel cell technology presents promising opportunities for larger robotic systems like UAVs, offering higher energy density and longer operational times.

6.1. Overall Trends

Driven by the advances in power converters, learning approaches and energy-harvesting methods, some of the key trends can be defined as follows:
  • Efficiency and Sustainability: Efficiency and sustainability are at the forefront of robotic system development. Power converters and energy-harvesting methods are being designed to minimize energy wastage and utilize renewable energy sources, contributing to more sustainable and eco-friendly robotics.
  • Specialization: With robotics finding applications in a wide range of industries, specialized power converters and learning algorithms are on the rise. These specialized solutions cater to the unique demands of each application, whether it is in healthcare, manufacturing or autonomous vehicles.
  • Increased Autonomy: Learning approaches, particularly reinforcement learning and AI, are empowering robots to become more autonomous and adaptable. This trend is particularly evident in fields like autonomous driving, where robots are learning to navigate complex environments with minimal human intervention.
  • Integration of Efficient Energy: The integration of energy sources into robotic systems is a growing trend. Solar, thermoelectrical and supercapacitors are increasingly being used to power robots, reducing their reliance on traditional energy sources and contributing to longer operational times.
  • Fuel Cell Technology: Fuel cell technology, such as polymer electrolyte membrane fuel cells, holds promise for larger robotic systems. They offer higher energy density, longer operational times and can be a game-changer for applications like UAVs.

6.2. Economic Aspects of Optimal Control in Robotic Applications

The economic aspect of optimal control in robotic applications is a critical consideration that can significantly impact the viability and adoption of robotic systems across various industries. The economic factors to be taken into account when implementing optimal control in robotic applications include initial costs, operational efficiency, maintenance and return on investment.
  • Initial Costs: The choice of optimal control structures can have a substantial impact on initial costs. For instance, more complex control algorithms or hardware setups may require a larger upfront investment. However, it is essential to balance initial costs with long-term benefits, such as increased productivity, reduced labor costs and improved product quality.
  • Operational Efficiency: Optimal control can enhance operational efficiency by improving accuracy, reducing cycle times and minimizing energy consumption. The economic benefit lies in increased productivity and reduced operating expenses over time. For example, in manufacturing, optimal control can lead to higher throughput, lower scrap rates and energy savings, all of which contribute to cost reduction.
  • Maintenance: The choice of control structures can also impact maintenance costs. Complex control systems may require more frequent maintenance and specialized expertise, which can increase operating expenses. Simpler control systems with predictive maintenance capabilities can help reduce downtime and maintenance costs.
  • Return on Investment (ROI): The economic feasibility of optimal control largely depends on the ROI it offers. While investing in advanced control structures may have a higher upfront cost, it is crucial to evaluate how quickly these investments will pay off through increased productivity and cost savings. Factors like the expected lifespan of the robotic system, industry-specific demands and potential market growth should be considered when calculating ROI.
Recommendations on the most suitable control structures to be implemented should be made on a case-by-case basis, considering the specific requirements and constraints of the application. However, some general guidelines can be helpful:
  • Customization: The optimal control structure should align with the specific needs of the application. Customizing the control system to the unique demands of the task can lead to more efficient and cost-effective solutions.
  • Scalability: Consider control structures that can be scaled as needed. This allows for flexibility in adapting to changes in production volume or complexity, ensuring that the investment remains economically viable over time.
  • Energy Efficiency: Opt for control structures that prioritize energy efficiency, as this not only reduces operational costs but also aligns with sustainability goals.
  • Integration: Ensure that the chosen control structure integrates seamlessly with existing systems and processes. Compatibility can minimize disruptions and reduce integration costs.
  • Predictive Maintenance: Implement predictive maintenance capabilities to proactively address issues before they lead to costly downtime. This can extend the lifespan of the robotic system and reduce maintenance expenses.

7. Conclusions

In conclusion, this paper has effectively highlighted the significant impact of advanced power management systems and the integration of learning techniques in the field of robotics. The convergence of efficient power utilization and learning-based control systems has introduced a new era of intelligent, adaptable and innovative robotic systems, revealing notable achievements and innovative research. One of the key aspects identified in the review is the successful implementation of various energy-harvesting methods, such as solar energy, thermoelectrical generation and supercapacitors, in powering robotic systems. These methods have demonstrated their potential to reduce reliance on conventional power sources and increase the endurance and adaptability of robots, making them well-suited for a wide range of applications. Furthermore, the review explored the learning approaches in robotics and how these techniques have transformed the decision-making processes. This has enabled robots to operate autonomously, navigate through intricate environments and interact intelligently with their surroundings, significantly enhancing their capabilities. Further, throughout the review process it is identified that the synergies between advanced power management and learning integration for robotic systems are expected to further revolutionize various sectors, such as industrial automation, healthcare, agriculture and disaster response. The integration of wireless power transfer technology in UAVs is foreseen to hold extended flight times and increased operational efficiency, opening new horizons in aerial robotics. In this developing landscape, the interaction between advancements in the fields of power management, machine learning and robotics will be crucial in realizing the full potential of robotic systems.

Author Contributions

Conceptualization, R.S., V.S.B.K. and M.A.K.; methodology, R.S., V.S.B.K. and M.A.K.; validation, R.S., V.S.B.K. and M.A.K.; formal analysis, R.S., V.S.B.K. and M.A.K.; investigation, R.S., V.S.B.K. and M.A.K.; resources, M.A.K.; data curation, R.S., V.S.B.K. and M.A.K.; writing—original draft preparation, R.S., V.S.B.K. and M.A.K.; writing—review and editing, R.S., V.S.B.K. and M.A.K.; visualization, R.S., V.S.B.K. and M.A.K.; supervision, R.S., V.S.B.K. and M.A.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Data Availability Statement

There is no data associated with this review.

Conflicts of Interest

The authors declare no conflict of interest.

List of Abbreviations and Acronyms

AIArtificial IntelligencePCAPrincipal Component Analysis
CCACanonical Correlation AnalysisPPOProximal Policy Optimization
CNNsConvolutional Neural NetworksPIDProportional-Integral-Derivative
DABDual Active Bridge ConverterPSCsPerovskite Solar Cells
DQNDeep Q NetworksPWMPulse-Width Modulation
DRLDeep Reinforcement LearningR&DResearch and Development
EMEnergy ManagementRLReinforcement Learning
EMIElectromagnetic InterferenceRNNsRecurrent Neural Networks
EVElectric VehicleSACSoft Actor-Critic
GaNGallium NitrideSiCSilicon Carbide
GANsGenerative Adversarial NetworksSPWMSinusoidal Pulse Width Modulation
GMMGaussian Mixture ModelsSVMsSupport Vector Machines
HPCHigh-Performance Computingt-SNEt-Distributed Stochastic Neighbor Embedding
HEVHybrid Electric VehicleTRPOTrust Region Policy Optimization
ICAIndependent Component AnalysisUAVUnmanned Aerial Vehicle
IoTInternet of ThingsUAVsUnmanned Aerial Vehicles
K-meansK-means ClusteringVAEsVariational Autoencoders
LSTMLong Short-Term MemoryZCSZero Current Switching
MCTSMonte Carlo Tree SearchZVSZero Voltage Switching
MLMachine LearningDSSCsDye-Sensitized Solar Cells
MPCModel Predictive ControlCIGSCopper Indium Gallium Diselenide
OSCsOrganic Solar CellsROIReturn on Investment
MAVsMicro Air VehiclesNDVINormalized Difference Vegetation Index

References

  1. Bartoš, M.; Bulej, V.; Bohušík, M.; Stanček, J.; Ivanov, V.; Macek, P. An overview of robot applications in the automotive industry. Transp. Res. Procedia 2021, 55, 837–844. [Google Scholar] [CrossRef]
  2. Chodha, V.; Dubey, R.; Kumar, R.; Singh, S.; Kaur, S. Selection of industrial arc welding robot with TOPSIS and Entropy MCDM techniques. Mater. Today Proc. 2022, 50, 709–715. [Google Scholar] [CrossRef]
  3. Sherwani, F.; Asad, M.M.; Ibrahim, B.S.K.K. Collaborative Robots and Industrial Revolution 4.0 (IR 4.0). In Proceedings of the 2020 International Conference on Emerging Trends in Smart Technologies (ICETST), Karachi, Pakistan, 26–27 March 2020; pp. 1–5. [Google Scholar] [CrossRef]
  4. Muhammad, K.; Ullah, A.; Lloret, J.; Del Ser, J.; de Albuquerque, V.H.C. Deep learning for safe autonomous driving: Current challenges and future directions. IEEE Trans. Intell. Transp. Syst. 2020, 22, 4316–4336. [Google Scholar] [CrossRef]
  5. Khayyam, H.; Javadi, B.; Jalili, M.; Jazar, R.N. Artificial intelligence and internet of things for autonomous vehicles. In Nonlinear Approaches in Engineering Applications: Automotive Applications of Engineering Problems; Springer: Berlin/Heidelberg, Germany, 2020; pp. 39–68. [Google Scholar]
  6. Vishnukumar, H.J.; Butting, B.; Müller, C.; Sax, E. Machine learning and deep neural network—Artificial intelligence core for lab and real-world test and validation for ADAS and autonomous vehicles: AI for efficient and quality test and validation. In Proceedings of the 2017 Intelligent Systems Conference (IntelliSys), London, UK, 7–8 September 2017; IEEE: Piscataway, NJ, USA, 2017. [Google Scholar]
  7. Lee, D.; Yoon, S.N. Application of artificial intelligence-based technologies in the healthcare industry: Opportunities and challenges. Int. J. Environ. Res. Public Health 2021, 18, 271. [Google Scholar] [CrossRef] [PubMed]
  8. Alugubelli, R. Exploratory study of artificial intelligence in healthcare. Int. J. Innov. Eng. Res. Technol. 2016, 3, 1–10. [Google Scholar]
  9. Denecke, K.; Claude R., B. A review of artificial intelligence and robotics in transformed health ecosystems. Front. Med. 2022, 9, 795957. [Google Scholar] [CrossRef]
  10. Castañé, G.; Dolgui, A.; Kousi, N.; Meyers, B.; Thevenin, S.; Vyhmeister, E.; Östberg, P.-O. The ASSISTANT project: AI for high level decisions in manufacturing. Int. J. Prod. Res. 2023, 61, 2288–2306. [Google Scholar] [CrossRef]
  11. Sjödin, D.R.; Parida, V.; Leksell, M.; Petrovic, A. Smart Factory Implementation and Process Innovation: A Preliminary Maturity Model for Leveraging Digitalization in Manufacturing. Moving to smart factories presents specific challenges that can be addressed through a structured approach focused on people, processes and technologies. Res. Technol. Manag. 2018, 61, 22–31. [Google Scholar]
  12. Talaviya, T.; Shah, D.; Patel, N.; Yagnik, H.; Shah, M. Implementation of artificial intelligence in agriculture for optimisation of irrigation and application of pesticides and herbicides. Artif. Intell. Agric. 2020, 4, 58–73. [Google Scholar] [CrossRef]
  13. Rejeb, A.; Abdollahi, A.; Rejeb, K.; Treiblmaier, H. Drones in agriculture: A review and bibliometric analysis. Comput. Electron. Agric. 2022, 198, 107017. [Google Scholar] [CrossRef]
  14. Cheng, C.; Fu, J.; Su, H.; Ren, L. Recent Advancements in Agriculture Robots: Benefits and Challenges. Machines 2023, 11, 48. [Google Scholar] [CrossRef]
  15. Balaska, V.; Adamidou, Z.; Vryzas, Z.; Gasteratos, A. Sustainable Crop Protection via Robotics and Artificial Intelligence Solutions. Machines 2023, 11, 774. [Google Scholar] [CrossRef]
  16. Park, K.-B.; Choi, S.H.; Lee, J.Y.; Ghasemi, Y.; Mohammed, M.; Jeong, H. Hands-free human–robot interaction using multimodal gestures and deep learning in wearable mixed reality. IEEE Access 2021, 9, 55448–55464. [Google Scholar] [CrossRef]
  17. Heydari, J.; Saha, O.; Ganapathy, V. Reinforcement learning-based coverage path planning with implicit cellular decomposition. arXiv 2021, arXiv:2110.09018. [Google Scholar]
  18. Pathmakumar, T.; Kalimuthu, M.; Elara, M.R.; Ramalingam, B. An autonomous robot-aided auditing scheme for floor cleaning. Sensors 2021, 21, 4332. [Google Scholar] [CrossRef] [PubMed]
  19. Alami, R.; Albu-Schaeffer, A.; Bicchi, A.; Bischoff, R.; Chatila, R.; De Luca, A.; De Santis, A.; Giralt, G.; Guiochet, J.; Hirzinger, G.; et al. Safe and Dependable Physical Human-Robot Interaction in Anthropic Domains: State of the Art and Challenges. In Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China, 9–15 October 2006. [Google Scholar]
  20. Smith, C.; Karayiannidis, Y.; Nalpantidis, L.; Gratal, X.; Qi, P.; Dimarogonas, D.V.; Kragic, D. Dual Arm Manipulation—A Survey. Robot. Auton. Syst. 2012, 60, 1340–1353. [Google Scholar] [CrossRef]
  21. Carabin, G.; Wehrle, E.; Vidoni, R. A Review on Energy-Saving Optimization Methods for Robotic and Automatic Systems. Robotics 2017, 6, 39. [Google Scholar] [CrossRef]
  22. Mantha, B.R.K.; Jung, M.K.; García de Soto, B.; Menassa, C.C.; Kamat, V.R. Generalized task allocation and route planning for robots with multiple depots in indoor building environments. Autom. Constr. 2020, 119, 103359. [Google Scholar] [CrossRef]
  23. Ahmad, T.; Zhu, H.; Zhang, D.; Tariq, R.; Bassam, A.; Ullah, F.; AlGhamdi, A.S.; Alshamrani, S.S. Energetics Systems and artificial intelligence: Applications of industry 4.0. Energy Rep. 2022, 8, 334–361. [Google Scholar] [CrossRef]
  24. Mazumdar, A.; Spencer, S.J.; Hobart, C.; Salton, J.; Quigley, M.; Wu, T.; Bertrand, S.; Pratt, J.; Buerger, S.P. Parallel elastic elements improve energy efficiency on the STEPPR bipedal walking robot. IEEE/ASME Trans. Mechatronics 2016, 22, 898–908. [Google Scholar] [CrossRef]
  25. Fisk, W.J. Health and productivity gains from better indoor environments and their relationship with building energy efficiency. Annu. Rev. Energy Environ. 2000, 25, 537–566. [Google Scholar] [CrossRef]
  26. Xu, G.; Xu, K.; Zheng, C.; Zhang, X.; Zahid, T. Fully electrified regenerative braking control for deep energy recovery and maintaining safety of electric vehicles. IEEE Trans. Veh. Technol. 2015, 65, 1186–1198. [Google Scholar] [CrossRef]
  27. Prasanth, B.; Paul, R.; Kaliyaperumal, D.; Kannan, R.; Venkata Pavan Kumar, Y.; Kalyan Chakravarthi, M.; Venkatesan, N. Maximizing Regenerative Braking Energy Harnessing in Electric Vehicles Using Machine Learning Techniques. Electronics 2023, 12, 1119. [Google Scholar] [CrossRef]
  28. Soori, M.; Arezoo, B.; Dastres, R. Optimization of Energy Consumption in Industrial Robots, A Review. Cogn. Robot. 2023, 3, 142–157. [Google Scholar] [CrossRef]
  29. Meireles, M.R.G.; Almeida, P.E.M.; Simões, M.G. A comprehensive review for industrial applicability of artificial neural networks. IEEE Trans. Ind. Electron. 2003, 50, 585–601. [Google Scholar] [CrossRef]
  30. Monmasson, E.; Cirstea, M.N. FPGA design methodology for industrial control systems—A review. IEEE Trans. Ind. Electron. 2007, 54, 1824–1842. [Google Scholar] [CrossRef]
  31. Lee, T.-S. Input-output linearization and zero-dynamics control of three-phase AC/DC voltage-source converters. IEEE Trans. Power Electron. 2003, 18, 11–22. [Google Scholar]
  32. Le, A.; Truong, L.; Quyen, T.; Nguyen, C.; Nguyen, M.; Truong, T.; Quyen, C.; Nguyen, M. Wireless power transfer near-field technologies for unmanned aerial vehicles (UAVs): A review. EAI Endorsed Trans. Ind. Netw. Intell. Syst. 2020, 7, e5. [Google Scholar] [CrossRef]
  33. Ucgun, H.; Ugur, Y.; Cuneyt, B. A review on applications of rotary-wing unmanned aerial vehicle charging stations. Int. J. Adv. Robot. Syst. 2021, 18, 17298814211015863. [Google Scholar] [CrossRef]
  34. Amjad, M.; Farooq-i-Azam, M.; Ni, Q.; Dong, M.; Ansari, E.A. Wireless charging systems for electric vehicles. Renew. Sustain. Energy Rev. 2022, 167, 112730. [Google Scholar] [CrossRef]
  35. Huo, Y.; Dong, X.; Lu, T.; Xu, W.; Yuen, M. Distributed and multilayer UAV networks for next-generation wireless communication and power transfer: A feasibility study. IEEE Internet Things J. 2019, 6, 7103–7115. [Google Scholar] [CrossRef]
  36. Nvss, S.; Esakki, B.; Yang, L.-J.; Udayagiri, C.; Vepa, K.S. Design and development of unibody quadcopter structure using optimization and additive manufacturing techniques. Designs 2022, 6, 8. [Google Scholar] [CrossRef]
  37. Arafat, M.Y.; Alam, M.M.; Moh, S. Vision-based navigation techniques for unmanned aerial vehicles: Review and challenges. Drones 2023, 7, 89. [Google Scholar] [CrossRef]
  38. Cao, X.; Liu, L.; Ge, J.; Yang, D. Conceptual design of long-endurance small solar-powered unmanned aerial vehicle with multiple tilts and hovers. Proc. Inst. Mech. Eng. Part G J. Aerosp. Eng. 2023. [Google Scholar] [CrossRef]
  39. Mohan, V.; Jeyaraj, A.K.; Susan, L.-H. Systems Integration Framework for Hybrid-Electric Commuter and Regional Aircraft. Aerospace 2023, 10, 533. [Google Scholar] [CrossRef]
  40. Mikołajczyk, T.; Mikołajewski, D.; Kłodowski, A.; Łukaszewicz, A.; Mikołajewska, E.; Paczkowski, T.; Macko, M.; Skornia, M. Energy Sources of Mobile Robot Power Systems: A Systematic Review and Comparison of Efficiency. Appl. Sci. 2023, 13, 7547. [Google Scholar] [CrossRef]
  41. Paryanto; Brossog, M.; Bornschlegl, M.; Franke, J. Reducing the energy consumption of industrial robots in manufacturing systems. Int. J. Adv. Manuf. Technol. 2015, 78, 1315–1328. [Google Scholar] [CrossRef]
  42. Wang, J.; Chortos, A. Control Strategies for Soft Robot Systems. Adv. Intell. Syst. 2022, 4, 2100165. [Google Scholar] [CrossRef]
  43. Lewis, F.L.; Kreith, F. (Eds.) Robotics. In Mechanical Engineering Handbook; CRC Press LLC: Boca Raton, FL, USA, 1999. [Google Scholar]
  44. Afifa, R.; Ali, S.; Pervaiz, M.; Iqbal, J. Adaptive Backstepping Integral Sliding Mode Control of a MIMO Separately Excited DC Motor. Robotics 2023, 12, 105. [Google Scholar] [CrossRef]
  45. Lorenz, R.D.; Lipo, T.A.; Novotny, D.W. Motion Control with Induction Motors. Proc. IEEE 1994, 82, 1215–1240. [Google Scholar] [CrossRef]
  46. Dario, P.; Bergamasco, M. An advanced robot system for automated diagnostic tasks through palpation. IEEE Trans. Biomed. Eng. 1988, 35, 118–126. [Google Scholar] [CrossRef] [PubMed]
  47. Forouzesh, M.; Siwakoti, Y.P.; Gorji, S.A.; Blaabjerg, F.; Lehman, B. Step-Up DC–DC Converters: A Comprehensive Review of Voltage-Boosting Techniques, Topologies and Applications. IEEE Trans. Power Electron. 2017, 32, 9143–9178. [Google Scholar] [CrossRef]
  48. Musumeci, S.; Mandrile, F.; Barba, V.; Palma, M. Low-Voltage GaN FETs in Motor Control Application; Issues and Advantages: A Review. Energies 2021, 14, 6378. [Google Scholar] [CrossRef]
  49. Arrigo, D.; Adragna, C.; Marano, V.; Pozzi, R.; Pulicelli, F.; Pulvirenti, F. The Next “Automation Age”: How Semiconductor Technologies Are Changing Industrial Systems and Applications. In Proceedings of the ESSCIRC 2022-IEEE 48th European Solid State Circuits Conference (ESSCIRC), Milan, Italy, 19–22 September 2022; pp. 17–24. [Google Scholar] [CrossRef]
  50. Paul, S.; Lee, D.; Kim, K.; Chang, J. Nonlinear modeling and performance testing of high-power electromagnetic energy harvesting system for self-powering transmission line vibration deicing robot. Mech. Syst. Signal Process. 2021, 151, 107369. [Google Scholar] [CrossRef]
  51. Moradewicz, A.J.; Kazmierkowski, M.P. Contactless Energy Transfer System with FPGA-Controlled Resonant Converter. IEEE Trans. Ind. Electron. 2010, 57, 3181–3190. [Google Scholar] [CrossRef]
  52. Kikuchi, S.; Sakata, T.; Takahashi, E.; Kanno, H. Development of Wireless Power Transfer System for Robot Arm with Rotary and Linear Movement. In Proceedings of the 2016 IEEE International Conference on Advanced Intelligent Mechatronics (AIM), Banff, AB, Canada, 12–15 July 2016; pp. 1616–1621. [Google Scholar] [CrossRef]
  53. Barman, S.D.; Reza, A.W.; Kumar, N.; Karim, M.E.; Munir, A.B. Wireless powering by magnetic resonant coupling: Recent trends in wireless power transfer system and its applications. Renew. Sustain. Energy Rev. 2015, 51, 1525–1552. [Google Scholar] [CrossRef]
  54. Urrea, C.; Jara, D. Design, Analysis and Comparison of Control Strategies for an Industrial Robotic Arm Driven by a Multi-Level Inverter. Symmetry 2021, 13, 86. [Google Scholar] [CrossRef]
  55. Ghani, M.A.; Mallet, J. Switched capacitors multilevel converter design for robotics application employing arduino microcontroller. In Proceedings of the 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), Kuala Lumpur, Malaysia, 12–15 November 2014; pp. 472–476. [Google Scholar] [CrossRef]
  56. Ivanovic, B.; Stojiljkovic, Z. A novel active soft switching snubber designed for boost converter. IEEE Trans. Power Electron. 2004, 19, 658–665. [Google Scholar] [CrossRef]
  57. Hasanpour, S.; Forouzesh, M.; Siwakoti, Y.P.; Blaabjerg, F. A Novel Full Soft-Switching High-Gain DC/DC Converter Based on Three-Winding Coupled-Inductor. IEEE Trans. Power Electron. 2021, 36, 12656–12669. [Google Scholar] [CrossRef]
  58. Rohouma, W.; Zanchetta, P.; Wheeler, P.W.; Empringham, L. A Four-Leg Matrix Converter Ground Power Unit with Repetitive Voltage Control. IEEE Trans. Ind. Electron. 2015, 62, 2032–2040. [Google Scholar] [CrossRef]
  59. Szczesniak, P.; Urbanski, K.; Fedyczak, Z.; Zawirski, K. Comparative study of drive systems using vector-controlled PMSM fed by a matrix converter and a conventional frequency converter. Turk. J. Electr. Eng. Comput. Sci. 2016, 24, 59. [Google Scholar] [CrossRef]
  60. Hao, K.; Lu, J. Modeling Research of Dual Active Bridge DC Converter Based on Double Phase Shift Control. In Proceedings of the 2019 3rd International Conference on Robotics and Automation Sciences (ICRAS), Wuhan, China, 1–3 June 2019; pp. 79–84. [Google Scholar]
  61. Wong, L.H.; Sivanesan, S.; Faisol, M.F.A.; Othman, W.A.F.W.; Wahab, A.A.A.; Alhady, S.S.N. Development of quadruped walking robot with passive compliance legs using XL4005 buck converter. J. Phys. Conf. Ser. 2021, 1969, 012003. [Google Scholar] [CrossRef]
  62. Abidin, Z.; Faridzi, M.A.; Siwindarto, P. Design of Solenoid Based Kicker with ZVS Boost Converter for Wheeled Soccer Robot. In Proceedings of the 2023 International Electronics Symposium (IES), Denpasar, Indonesia, 8–10 August 2023; pp. 150–154. [Google Scholar]
  63. Cruz-Lambert, J.; Benavidez, P.; Ortiz, J.; Richey, J.; Morris, S.; Gallardo, N.; Jamshidi, M. Converter design for solar powered outdoor mobile robot. In Proceedings of the 2016 World Automation Congress (WAC), Rio Grande, PR, USA, 3 July–4 August 2016; pp. 1–6. [Google Scholar] [CrossRef]
  64. Truong, T.-A.; Nguyen, T.K.; Huang, X.; Ashok, A.; Yadav, S.; Park, Y.; Thai, M.T.; Nguyen, N.-K.; Fallahi, H.; Peng, S.; et al. Engineering Route for Stretchable, 3D Microarchitectures of Wide Bandgap Semiconductors for Biomedical Applications. Adv. Funct. Mater. 2023, 33, 2211781. [Google Scholar] [CrossRef]
  65. Lee, W.; Li, S.; Han, D.; Sarlioglu, B.; Minav, T.A.; Pietola, M. A Review of Integrated Motor Drive and Wide-Bandgap Power Electronics for High-Performance Electro-Hydrostatic Actuators. IEEE Trans. Transp. Electrif. 2018, 4, 684–693. [Google Scholar] [CrossRef]
  66. Dorigo, M.; Theraulaz, G.; Trianni, V. Swarm Robotics: Past, Present and Future [Point of View]. Proc. IEEE 2021, 109, 1152–1165. [Google Scholar] [CrossRef]
  67. Lee, W.; Li, S.; Han, D.; Sarlioglu, B.; Minav, T.A.; Pietola, M. Achieving high-performance electrified actuation system with integrated motor drive and wide bandgap power electronics. In Proceedings of the 19th European Conference on Power Electronics and Applications (EPE’17 ECCE Europe), Warsaw, Poland, 11–14 September 2017; pp. P.1–P.10. [Google Scholar]
  68. Nguyen, K.T.; Kang, B.; Choi, E.; Park, J.O.; Kim, C.S. High-Frequency and High-Powered Electromagnetic Actuation System Utilizing Two-Stage Resonant Effects. IEEE/ASME Trans. Mechatron. 2020, 25, 2398–2408. [Google Scholar] [CrossRef]
  69. Hagn, U.; Nickl, M.; Jörg, S.; Passig, G.; Bahls, T.; Nothhelfer, A.; Hacker, F.; Le-Tien, L.; Albu-Schäffer, A.; Konietschke, R.; et al. The DLR MIRO: A Versatile Lightweight Robot for Surgical Applications. Ind. Robot. 2008, 35, 324–336. [Google Scholar] [CrossRef]
  70. Zhang, T.; Qian, F.; Li, C.; Masarati, P.; Hoover, A.M.; Birkmeyer, P.; Pullin, A.; Fearing, R.S.; Goldman, D.I. Ground fluidization promotes rapid running of a lightweight robot. Int. J. Robot. Res. 2013, 32, 859–869. [Google Scholar] [CrossRef]
  71. Makhdoom, R.; Maji, S.; Sinha, S.; Etta, D.; Afridi, K. Multi-MHz In-Motion Capacitive Wireless Power Transfer System for Mobile Robots. In Proceedings of the 2022 Wireless Power Week (WPW), Bordeaux, France, 5–8 July 2022; pp. 1–5. [Google Scholar]
  72. Lidow, A.; Glaser, J. GaN-based Solutions for Cost-effective Direct and Indirect Time-of-Flight Lidar Transmitters are Changing the Way We Live. In Proceedings of the 2022 International Power Electronics Conference (IPEC-Himeji 2022- ECCE Asia), Himeji, Japan, 15–19 May 2022; pp. 637–643. [Google Scholar] [CrossRef]
  73. Ino, K.; Miura, M.; Nakano, Y.; Aketa, M.; Kawamoto, N. SiC Power Device Evolution Opening a New Era in Power Electronics. In Proceedings of the 2019 IEEE International Conference on Electron Devices and Solid-State Circuits (EDSSC), Xi’an, China, 12–14 June 2019; pp. 1–3. [Google Scholar] [CrossRef]
  74. Carlson, S.J.; Arora, P.; Karakurt, T.; Moore, B.; Papachristos, C. Towards Multi-Day Field Deployment Autonomy: A Long-Term Self-Sustainable Micro Aerial Vehicle Robot. In Proceedings of the 2023 IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023; pp. 11396–11403. [Google Scholar] [CrossRef]
  75. Javaid, M.; Haleem, A.; Singh, R.P.; Suman, R. Substantial Capabilities of Robotics in Enhancing Industry 4.0 Implementation. Cogn. Robot. 2021, 1, 58–75. [Google Scholar] [CrossRef]
  76. Chen, J.; Yang, C.; Zou, J. Robust Enhanced Voltage Range Control for Industrial Robot Chargers. IEEE Access 2022, 10, 132635–132643. [Google Scholar] [CrossRef]
  77. Natarajan, S.; Kannadasan, R.; Alsaif, F.; Alsharif, M.H. Design of Novel Modified Double-Ended Forward Converter for Stepper Motor Drive. Machines 2023, 11, 777. [Google Scholar] [CrossRef]
  78. Bodian, A.; Cardenas, A.; Ben Abdelghani, A.B. Double Outputs Resonant-based Wireless Charger for Electric Vehicle and Robotic Applications. In Proceedings of the 2022 5th International Conference on Advanced Systems and Emergent Technologies (IC_ASET), Hammamet, Tunisia, 22–24 March 2022; pp. 439–444. [Google Scholar]
  79. Silva, F.A. Advanced DC/AC Inverters: Applications in Renewable Energy (Luo, F.L. and Ye, H.; 2013) [Book News]. IEEE Ind. Electron. Mag. 2013, 7, 68–69. [Google Scholar] [CrossRef]
  80. Benmiloud, M.; Benalia, A. Finite-time stabilization of the limit cycle of two-cell DC/DC converter: Hybrid approach. Nonlinear Dyn. 2016, 83, 319–332. [Google Scholar] [CrossRef]
  81. Moreno, G.; Narumanchi, S.; Feng, X.; Anschel, P.; Myers, S.; Keller, P. Electric-Drive Vehicle Power Electronics Thermal Management: Current Status, Challenges and Future Directions. J. Electron. Packag. 2022, 144, 011004. [Google Scholar] [CrossRef]
  82. Omura, I. Power Electronics for a Future Sustainable Society. In Proceedings of the PCIM Europe 2022, International Exhibition and Conference for Power Electronics, Intelligent Motion, Renewable Energy and Energy Management, Nuremberg, Germany, 10–12 May 2022; pp. 1–8. [Google Scholar] [CrossRef]
  83. Schellenberger, M.; Lorentz, V.; Eckardt, B. Cognitive Power Electronics—An Enabler for Smart Systems. In Proceedings of the PCIM Europe 2022; International Exhibition and Conference for Power Electronics, Intelligent Motion, Renewable Energy and Energy Management, Nuremberg, Germany, 10–12 May 2022; pp. 1–5. [Google Scholar] [CrossRef]
  84. Dian, S.; Fang, H.; Zhao, T.; Wu, Q.; Hu, Y.; Guo, R.; Li, S. Modeling and Trajectory Tracking Control for Magnetic Wheeled Mobile Robots Based on Improved Dual-Heuristic Dynamic Programming. IEEE Trans. Ind. Inform. 2021, 17, 1470–1482. [Google Scholar] [CrossRef]
  85. Božek, P.; Nikitin, Y. The Development of an Optimally-Tuned PID Control for the Actuator of a Transport Robot. Actuators 2021, 10, 195. [Google Scholar] [CrossRef]
  86. Dini, P.; Saponara, S. Model-Based Design of an Improved Electric Drive Controller for High-Precision Applications Based on Feedback Linearization Technique. Electronics 2021, 10, 2954. [Google Scholar] [CrossRef]
  87. Zhang, Z.; Zhang, B. Omnidirectional and Efficient Wireless Power Transfer System for Logistic Robots. IEEE Access 2020, 8, 13683–13693. [Google Scholar] [CrossRef]
  88. Zhang, J.; Zhao, J.; Zhang, Y.; Deng, F. A Wireless Power Transfer System With Dual Switch-Controlled Capacitors for Efficiency Optimization. IEEE Trans. Power Electron. 2020, 35, 6091–6101. [Google Scholar] [CrossRef]
  89. Borboni, A.; Reddy, K.V.V.; Elamvazuthi, I.; AL-Quraishi, M.S.; Natarajan, E.; Azhar Ali, S.S. The Expanding Role of Artificial Intelligence in Collaborative Robots for Industrial Applications: A Systematic Review of Recent Works. Machines 2023, 11, 111. [Google Scholar] [CrossRef]
  90. Mohsen, S.; Behrooz, A.; Roza, D. Artificial Intelligence, Machine Learning and Deep Learning in Advanced Robotics: A Review. Cogn. Robot. 2023, 3, 54–70. [Google Scholar] [CrossRef]
  91. Sarker, I.H. Machine Learning: Algorithms, Real-World Applications and Research Directions. SN Comput. Sci. 2021, 2, 160. [Google Scholar] [CrossRef] [PubMed]
  92. Han, D.; Mulyana, B.; Stankovic, V.; Cheng, S. A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation. Sensors 2023, 23, 3762. [Google Scholar] [CrossRef]
  93. Liu, R.; Nageotte, F.; Zanne, P.; De Mathelin, M.; Dresp, B. Deep Reinforcement Learning for the Control of Robotic Manipulation: A Focused Mini-Review. Robotics 2021, 10, 22. [Google Scholar] [CrossRef]
  94. Shao, S.; Tsai, J.; Mysior, M.; Luk, W.; Chau, T.; Warren, A.; Jeppesen, B. Towards Hardware Accelerated Reinforcement Learning for Application-Specific Robotic Control. In Proceedings of the 2018 IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP), Milan, Italy, 10–12 July 2018; pp. 1–8. [Google Scholar] [CrossRef]
  95. Zhou, S.; Liu, X.; Xu, Y.; Guo, J. A Deep Q-network (DQN) Based Path Planning Method for Mobile Robots. In Proceedings of the 2018 IEEE International Conference on Information and Automation (ICIA), Wuyishan, China, 11–13 August 2018; pp. 366–371. [Google Scholar] [CrossRef]
  96. Schulman, J.; Wolski, F.; Dhariwal, P.; Radford, A.; Klimov, O. Proximal policy optimization algorithms. arXiv 2017, arXiv:1707.06347. [Google Scholar]
  97. Amarjyoti, S. Deep reinforcement learning for robotic manipulation-the state of the art. arXiv 2017, arXiv:1701.08878. [Google Scholar]
  98. Saeed, M.; Nagdi, M.; Rosman, B.; Ali, H.H. Deep Reinforcement Learning for Robotic Hand Manipulation. In Proceedings of the 2020 International Conference on Computer, Control, Electrical and Electronics Engineering (ICCCEEE), Khartoum, Sudan, 26 February–1 March 2021; pp. 1–5. [Google Scholar] [CrossRef]
  99. Ashraf, N.M.; Mostafa, R.R.; Sakr, R.H.; Rashad, M.Z. Optimizing hyperparameters of deep reinforcement learning for autonomous driving based on whale optimization algorithm. PLoS ONE 2021, 16, e0252754. [Google Scholar] [CrossRef]
  100. Mahony, N.O.; Campbell, S.; Carvalho, A.; Harapanahalli, S.; Velasco-Hernandez, G.; Krpalkova, L.; Riordan, D.; Walsh, J. Deep Learning vs. Traditional Computer Vision. In Advances in Computer Vision. CVC 2019. Advances in Intelligent Systems and Computing; Arai, K., Kapoor, S., Eds.; Spronger: Cham, Switzerland, 2020; Volume 943. [Google Scholar] [CrossRef]
  101. Wang, Z.; Majewicz Fey, A. Deep learning with convolutional neural network for objective skill evaluation in robot-assisted surgery. Int. J. CARS 2018, 13, 1959–1970. [Google Scholar] [CrossRef]
  102. Mayer, H.; Gomez, F.; Wierstra, D.; Nagy, I.; Knoll, A.; Schmidhuber, J. A System for Robotic Heart Surgery that Learns to Tie Knots Using Recurrent Neural Networks. Adv. Robot. 2008, 22, 1521–1537. [Google Scholar] [CrossRef]
  103. Zhang, M.; Chu, Z. Adaptive sliding mode control based on local recurrent neural networks for underwater robot. Ocean Eng. 2012, 45, 56–62. [Google Scholar] [CrossRef]
  104. Nair, R.S.; Supriya, P. Robotic Path Planning Using Recurrent Neural Networks. In Proceedings of the 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India, 1–3 July 2020; pp. 1–5. [Google Scholar] [CrossRef]
  105. Brown, C.Y.; Asada, H.H. Inter-finger coordination and postural synergies in robot hands via mechanical implementation of principal components analysis. In Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA, 29 October–2 November 2007; pp. 2877–2882. [Google Scholar] [CrossRef]
  106. Kim, S.; Park, F.C. Fast Robot Motion Generation Using Principal Components: Framework and Algorithms. IEEE Trans. Ind. Electron. 2008, 55, 2506–2516. [Google Scholar] [CrossRef]
  107. Zhao, N.; Yang, G.; Cao, Y. Mining Technological Innovation Talents Based on Patent Index using t-SNE Algorithms: Take the Field of Intelligent Robot as an Example. In Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Computer Applications (ICAICA), Dalian, China, 27–29 June 2020; pp. 595–601. [Google Scholar] [CrossRef]
  108. AL-Furati, I.; Rashid, A.T.; Al-Ibadi, A. IR sensors array for robots localization using K means clustering algorithm. In Proceedings of the UKSim-AMSS 21st International Conference on Modelling & Simulation, Cambridge, UK, 27–29 March 2019. [Google Scholar] [CrossRef]
  109. Ravankar, A.A.; Hoshino, Y.; Emaru, T.; Kobayashi, Y. Robot Mapping Using k-means Clustering Of Laser Range Sensor Data. Bull. Netw. Comput. Syst. Softw. 2012, 1, 9–12. [Google Scholar]
  110. Elango, M.; Nachiappan, S.; Tiwari, M. KBalancing task allocation in multi-robot systems using K-means clustering and auction based mechanisms. Expert Syst. Appl. 2011, 38, 6486–6491. [Google Scholar] [CrossRef]
  111. Upcroft, B.; Kumar, S.; Ridley, M.; Ong, L.L.; Durrant-Whyte, H. Fast re-parameterisation of Gaussian mixture models for robotics applications. In Proceedings of the Australasian Conference on Robotics and Automation, Canberra, Australia, 6–8 December 2004. [Google Scholar]
  112. Jasim, I.F.; Plapper, P.W. Contact-state Modeling of Robotic Assembly Tasks Using Gaussian Mixture Models. Procedia CIRP 2014, 23, 229–234. [Google Scholar] [CrossRef]
  113. Park, D.; Hoshi, Y.; Kemp, C. CA Multimodal Anomaly Detector for Robot-Assisted Feeding Using an LSTM-Based Variational Autoencoder. IEEE Robot. Autom. Lett. 2018, 3, 1544–1551. [Google Scholar] [CrossRef]
  114. Chen, T.; Liu, X.; Xia, B.; Wang, W.; Lai, Y. Unsupervised Anomaly Detection of Industrial Robots Using Sliding-Window Convolutional Variational Autoencoder. IEEE Access 2020, 8, 47072–47081. [Google Scholar] [CrossRef]
  115. Ren, H.; Ben-Tzvi, P. Learning inverse kinematics and dynamics of a robotic manipulator using generative adversarial networks. Robot. Auton. Syst. 2020, 124, 103386. [Google Scholar] [CrossRef]
  116. Lembono, T.S.; Pignat, E.; Jankowski, J.; Calinon, S. Learning Constrained Distributions of Robot Configurations With Generative Adversarial Network. IEEE Robot. Autom. Lett. 2021, 6, 4233–4240. [Google Scholar] [CrossRef]
  117. Fayyad, J.; Jaradat, M.A.; Gruyer, D.; Najjaran, H. Deep Learning Sensor Fusion for Autonomous Vehicle Perception and Localization: A Review. Sensors 2020, 20, 4220. [Google Scholar] [CrossRef]
  118. Sadeghi Esfahlani, S.; Sanaei, A.; Ghorabian, M.; Shirvani, H. The Deep Convolutional Neural Network Role in the Autonomous Navigation of Mobile Robots (SROBO). Remote Sens. 2022, 14, 3324. [Google Scholar] [CrossRef]
  119. Premebida, C.; Ambrus, R.; Marton, Z.C. Intelligent robotic perception systems. In Applications of Mobile Robots; Books on Demand: Pasig, Philippines, 2018; pp. 111–127. [Google Scholar]
  120. Rajendran, S.V.; Debnath, B.; Mghames, S.; Mandil, W.; Parsa, S.; Parsons, S.; Ghalamzan-E, A. Towards autonomous selective harvesting: A review of robot perception, robot design, motion planning and control. J. Field Robot. 2023, 1–33. [Google Scholar] [CrossRef]
  121. Falco, P.; Lu, S.; Natale, C.; Pirozzi, S.; Lee, D.A. Transfer Learning Approach to Cross-Modal Object Recognition: From Visual Observation to Robotic Haptic Exploration. IEEE Trans. Robot. 2019, 35, 987–998. [Google Scholar] [CrossRef]
  122. Saha, O.; Dasgupta, P.; Woosley, B. Real-time robot path planning from simple to complex obstacle patterns via transfer learning of options. Auton. Robot. 2019, 43, 2071–2093. [Google Scholar] [CrossRef]
  123. Tsitos, A.C.; Dagioglou, M. Enhancing team performance with transfer-learning during real-world human–robot collaboration. arXiv 2022, arXiv:2211.13070. [Google Scholar]
  124. Song, D.; Tian, G.-M.; Liu, J. Real-time localization measure and perception detection using multi-sensor fusion for Automated Guided Vehicles. In Proceedings of the 40th Chinese Control Conference (CCC), Shanghai, China, 26–28 July 2021; IEEE: Piscataway, NJ, USA, 2021. [Google Scholar]
  125. Chebotar, Y.; Hausman, K.; Lu, Y.; Xiao, T.; Kalashnikov, D.; Varley, J.; Irpan, A.; Eysenbach, B.; Julian, R.; Finn, C.; et al. Actionable models: Unsupervised offline reinforcement learning of robotic skills. arXiv 2021, arXiv:2104.07749. [Google Scholar]
  126. Ohnishi, N.; Imiya, A. Independent component analysis of optical flow for robot navigation. Neurocomputing 2008, 71, 2140–2163. [Google Scholar] [CrossRef]
  127. Hudson, R.E.; Newman, W.S. Independent Component Analysis and Bayes’ Theorem for robotics and automation. In Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA, 3–7 May 2010; IEEE: Piscataway, NJ, USA, 2010. [Google Scholar]
  128. Roberts, S.; Everson, R. (Eds.) Independent Component Analysis: Principles and Practice; Cambridge University Press: Cambridge, UK, 2001. [Google Scholar]
  129. Chen, L.; Wang, K.; Li, M.; Wu, M.; Pedrycz, W.; Hirota, K. K-means clustering-based kernel canonical correlation analysis for multimodal emotion recognition in human–robot interaction. IEEE Trans. Ind. Electron. 2022, 70, 1016–1024. [Google Scholar] [CrossRef]
  130. Richer, N.; Downey, R.J.; Hairston, W.D.; Ferris, D.P.; Nordin, A.D. Motion and muscle artifact removal validation using an electrical head phantom, robotic motion platform and dual layer mobile EEG. IEEE Trans. Neural Syst. Rehabil. Eng. 2020, 28, 1825–1835. [Google Scholar] [CrossRef]
  131. Pierson, H.A.; Michael, S.G. Deep learning in robotics: A review of recent research. Adv. Robot. 2017, 31, 821–835. [Google Scholar] [CrossRef]
  132. CChungath, T.T.; Nambiar, A.M.; Mittal, A. Transfer Learning and Few-Shot Learning Based Deep Neural Network Models for Underwater Sonar Image Classification with a Few Samples. IEEE J. Ocean. Eng. 2023. [Google Scholar] [CrossRef]
  133. Károly, A.I.; Tirczka, S.; Gao, H.; Rudas, I.J.; Galambos, P. Increasing the Robustness of Deep Learning Models for Object Segmentation: A Framework for Blending Automatically Annotated Real and Synthetic Data. IEEE Trans. Cybern. 2023, 1–14. [Google Scholar] [CrossRef] [PubMed]
  134. Magalhães, S.A.; Castro, L.; Moreira, G.; dos Santos, F.N.; Cunha, M.; Dias, J.; Moreira, A.P. Evaluating the single-shot multibox detector and YOLO deep learning models for the detection of tomatoes in a greenhouse. Sensors 2021, 21, 3569. [Google Scholar] [CrossRef] [PubMed]
  135. Rogelio, J.; Dadios, E.; Bandala, A.; Vicerra, R.R.; Sybingco, E. Alignment control using visual servoing and mobilenet single-shot multi-box detection (SSD): A review. Int. J. Adv. Intell. Inform. 2022, 8, 97–114. [Google Scholar] [CrossRef]
  136. Kipkosgei, P.; Njiri, J.G.; Kimotho, J.K. Real-time object detection using single-shot multibox detector network for autonomous robotic arm. J. Sustain. Res. Eng. 2020, 6, 11–23. [Google Scholar]
  137. Luo, R.C.; Yu, Z.-L. AI enhanced visual inspection of post-polished workpieces using you only look once vision system for intelligent robotics applications. In Proceedings of the 2022 International Conference on Advanced Robotics and Intelligent Systems (ARIS), Taipei, Taiwan, 24–27 August 2021; IEEE: Piscataway, NJ, USA, 2022. [Google Scholar]
  138. Li, X.; Tian, M.; Kong, S.; Wu, L.; Yu, J. A modified YOLOv3 detection method for vision-based water surface garbage capture robot. Int. J. Adv. Robot. Syst. 2020, 17, 1729881420932715. [Google Scholar] [CrossRef]
  139. Kulik, S.D.; Shtanko, A.N. Experiments with neural net object detection system YOLO on small training datasets for intelligent robotics. In Advanced Technologies in Robotics and Intelligent Systems: Proceedings of ITR 2019; Springer International Publishing: Berlin/Heidelberg, Germany, 2020. [Google Scholar]
  140. Hurtado, J.V.; Valada, A. Semantic scene segmentation for robotics. In Deep Learning for Robot Perception and Cognition; Academic Press: Cambridge, MA, USA, 2022; pp. 279–311. [Google Scholar]
  141. Dang, T.-V.; Ngoc-Tam, B. Multi-scale fully convolutional network-based semantic segmentation for mobile robot navigation. Electronics 2023, 12, 533. [Google Scholar] [CrossRef]
  142. Lahbas, A.; Hadmi, A.; Radgui, A. Scenes Segmentation in Self-driving Car Perception System Based U-Net and FCN Models. In International Conference on Advanced Technologies for Humanity; Springer International Publishing: Cham, Switzerland, 2021. [Google Scholar]
  143. Kolekar, S.; Gite, S.; Pradhan, B.; Alamri, A. Explainable AI in scene understanding for autonomous vehicles in unstructured traffic environments on Indian roads using the inception U-Net Model with Grad-CAM visualization. Sensors 2022, 22, 9677. [Google Scholar] [CrossRef]
  144. Kazerouni, I.A.; Dooly, G.; Toal, D. Ghost-UNet: An asymmetric encoder-decoder architecture for semantic segmentation from scratch. IEEE Access 2021, 9, 97457–97465. [Google Scholar] [CrossRef]
  145. Zhang, C.; Tang, Y.; Zhao, C.; Sun, Q.; Ye, Z.; Kurths, J. Multitask GANs for semantic segmentation and depth completion with cycle consistency. IEEE Trans. Neural Netw. Learn. Syst. 2021, 32, 5404–5415. [Google Scholar] [CrossRef]
  146. Yan, F. Semantic Scene Understanding for Intelligent Robotics. Ph.D. Thesis, Wichita State University, Wichita, KS, USA, 2023. [Google Scholar]
  147. Lynen, S.; Achtelik, M.W.; Weiss, S.; Chli, M.; Siegwart, R. A Robust and Modular Multi-Sensor Fusion Approach Applied to MAV Navigation. In Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan, 3–7 November 2013; IEEE: Piscataway, NJ, USA, 2013. [Google Scholar]
  148. Lai, T. A Review on Visual-SLAM: Advancements from Geometric Modelling to Learning-Based Semantic Scene Understanding Using Multi-Modal Sensor Fusion. Sensors 2022, 22, 7265. [Google Scholar] [CrossRef] [PubMed]
  149. Ovur, S.E.; Demiris, Y. Naturalistic Robot-to-Human Bimanual Handover in Complex Environments Through Multi-Sensor Fusion. IEEE Trans. Autom. Sci. Eng. 2023, 1–12. [Google Scholar] [CrossRef]
  150. Tang, Q.; Liang, J.; Zhu, F. A Comparative Review on Multi-modal Sensors Fusion Based on Deep Learning. Signal Process. 2023, 213, 109165. [Google Scholar] [CrossRef]
  151. Yang, M.; Sun, X.; Jia, F.; Rushworth, A.; Dong, X.; Zhang, S.; Fang, Z.; Yang, G.; Liu, B. Sensors and Sensor Fusion Methodologies for Indoor Odometry: A Review. Polymers 2022, 14, 2019. [Google Scholar] [CrossRef] [PubMed]
  152. Wu, J.; Gao, J.; Yi, J.; Liu, P.; Xu, C. Environment Perception Technology for Intelligent Robots in Complex Environments: A Review. In Proceedings of the 2022 7th International Conference on Communication, Image and Signal Processing (CCISP), Chengdu, China, 18–20 November 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 479–485. [Google Scholar] [CrossRef]
  153. Zheng, S.; Wang, J.; Rizos, C.; Ding, W.; El-Mowafy, A. Simultaneous Localization and Mapping (SLAM) for Autonomous Driving: Concept and Analysis. Remote Sens. 2023, 15, 1156. [Google Scholar] [CrossRef]
  154. Ge, G.; Zhang, Y.; Wang, W.; Hu, L.; Wang, Y.; Jiang, Q. Visual-Feature-Assisted Mobile Robot Localization in a Long Corridor Environment. Front. Inf. Technol. Electron. Eng. 2023, 24, 876–889. [Google Scholar] [CrossRef]
  155. Shi, Y.; Jiang, K.; Wang, K.; Li, J.; Wang, Y.; Yang, D. FusionMotion: Multi-Sensor Asynchronous Fusion for Continuous Occupancy Prediction via Neural-ODE. arXiv 2023, arXiv:2302.09585. [Google Scholar]
  156. Bordvik, D.A.; Hou, J.; Noori, F.M.; Uddin, M.Z.; Torresen, J. Monitoring In-Home Emergency Situation and Preserve Privacy Using Multi-Modal Sensing and Deep Learning. In Proceedings of the 2022 International Conference on Electronics, Information and Communication (ICEIC), Jeju, Republic of Korea, 6–9 February 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1–6. [Google Scholar] [CrossRef]
  157. Jiang, P.; Ma, J.; Zhang, Z.; Zhang, J. Multi-Sensor Fusion Framework for Obstacle Avoidance via Deep Reinforcement Learning. In Proceedings of the 2022 2nd International Conference on Electrical Engineering and Control Science (IC2ECS), Nanjing, China, 16–18 December 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 153–156. [Google Scholar] [CrossRef]
  158. Tayeh, T.; Aburakhia, S.; Myers, R.; Shami, A. An attention-based ConvLSTM autoencoder with dynamic thresholding for unsupervised anomaly detection in multivariate time series. Mach. Learn. Knowl. Extr. 2022, 4, 350–370. [Google Scholar] [CrossRef]
  159. Kabir, R.; Watanobe, Y.; Islam, M.R.; Naruse, K.; Rahman, M.M. Unknown object detection using a one-class support vector machine for a cloud–robot system. Sensors 2022, 22, 1352. [Google Scholar] [CrossRef] [PubMed]
  160. Yun, H.; Kim, H.; Jeong, Y.H.; Jun, M.B.G. Autoencoder-based anomaly detection of industrial robot arm using stethoscope based internal sound sensor. J. Intell. Manuf. 2023, 34, 1427–1444. [Google Scholar] [CrossRef]
  161. Yokkampon, U.; Mowshowitz, A.; Chumkamon, S.; Hayashi, E. Robust Unsupervised Anomaly Detection with Variational Autoencoder in Multivariate Time Series Data. IEEE Access 2022, 10, 57835–57849. [Google Scholar] [CrossRef]
  162. Mantegazza, D.; Giusti, A.; Gambardella, L.M.; Guzzi, J. An outlier exposure approach to improve visual anomaly detection performance for mobile robots. IEEE Robot. Autom. Lett. 2022, 7, 11354–11361. [Google Scholar] [CrossRef]
  163. Dulac-Arnold, G.; Levine, N.; Mankowitz, D.J. Challenges of Real-World Reinforcement Learning: Definitions, Benchmarks and Analysis. Mach. Learn. 2021, 110, 2419–2468. [Google Scholar] [CrossRef]
  164. Kormushev, P.; Calinon, S.; Caldwell, D.G. Reinforcement Learning in Robotics: Applications and Real-World Challenges. Robotics 2013, 2, 122–148. [Google Scholar] [CrossRef]
  165. Zhu, H.; Yu, J.; Gupta, A.; Shah, D.; Hartikainen, K.; Singh, A.; Kumar, V.; Levine, S. The Ingredients of Real-World Robotic Reinforcement Learning. arXiv 2020, arXiv:2004.12570. [Google Scholar]
  166. Ibarz, J.; Tan, J.; Finn, C.; Kalakrishnan, M.; Pastor, P.; Levine, S. How to Train Your Robot with Deep Reinforcement Learning: Lessons We Have Learned. Int. J. Robot. Res. 2021, 40, 698–721. [Google Scholar] [CrossRef]
  167. Tsurumine, Y.; Cui, Y.; Uchibe, E. Matsubara, TDeep reinforcement learning with smooth policy update: Application to robotic cloth manipulation. Robot. Auton. Syst. 2019, 112, 72–83. [Google Scholar] [CrossRef]
  168. Kobayashi, T. Adaptive and multiple time-scale eligibility traces for online deep reinforcement learning. Robot. Auton. Syst. 2022, 151, 104019. [Google Scholar] [CrossRef]
  169. Iriondo, A.; Lazkano, E.; Ansuategi, A.; Rivera, A.; Lluvia, I.; Tubío, C. Learning positioning policies for mobile manipulation operations with deep reinforcement learning. Int. J. Mach. Learn. Cyber. 2023, 14, 3003–3023. [Google Scholar] [CrossRef]
  170. Wang, Q.; Sanchez, F.R.; McCarthy, R.; Bulens, D.C.; McGuinness, K.; O’Connor, N.; Wüthrich, M.; Widmaier, F.; Bauer, S.; Redmond, S.J. Dexterous robotic manipulation using deep reinforcement learning and knowledge transfer for complex sparse reward-based tasks. Expert Syst. 2023, 40, e13205. [Google Scholar] [CrossRef]
  171. Shahid, A.A.; Piga, D.; Braghin, F.; Roveda, L. Continuous control actions learning and adaptation for robotic manipulation through reinforcement learning. Auton Robot. 2022, 46, 483–498. [Google Scholar] [CrossRef]
  172. Biemann, M.; Scheller, F.; Liu, X.; Huang, L. Experimental evaluation of model-free reinforcement learning algorithms for continuous HVAC control. Appl. Energy 2021, 298, 117164. [Google Scholar] [CrossRef]
  173. Aumjaud, P.; McAuliffe, D.; Rodríguez-Lera, F.J.; Cardiff, P. Reinforcement Learning Experiments and Benchmark for Solving Robotic Reaching Tasks; Springer International Publishing: Cham, Switzerland, 2021; pp. 318–331. [Google Scholar]
  174. Lyu, J.; Yang, Y.; Yan, J.; Li, X. Value activation for bias alleviation: Generalized-activated deep double deterministic policy gradients. Neurocomputing 2023, 518, 70–81. [Google Scholar] [CrossRef]
  175. Flet-Berliac, Y.; Ouhamma, R.; Maillard, O.-A.; Preux, P. Learning Value Functions in Deep Policy Gradients using Residual Variance. arXiv 2020, arXiv:2010.04440. [Google Scholar]
  176. Kovalev, V.; Shkromada, A.; Ouerdane, H.; Osinenko, P. Combining Model-Predictive Control and Predictive Reinforcement Learning for Stable Quadrupedal Robot Locomotion. arXiv 2023, arXiv:2307.07752.2023. [Google Scholar]
  177. Zhang, Z.; Chang, X.; Ma, H.; An, H.; Lang, L. Model Predictive Control of Quadruped Robot Based on Reinforcement Learning. Appl. Sci. 2023, 13, 154. [Google Scholar] [CrossRef]
  178. Chadi, M.A.; Mousannif, H. Understanding Reinforcement Learning Algorithms: The Progress from Basic Q-learning to Proximal Policy Optimization. arXiv 2023, arXiv:2304.00026. [Google Scholar]
  179. Gelly, S.; Kocsis, L.; Schoenauer, M.; Sebag, M.; Silver, D.; Szepesvári, C.; Teytaud, O. The grand challenge of computer Go. Commun. ACM 2012, 55, 106–113. [Google Scholar] [CrossRef]
  180. Koren, M.; Kochenderfer, M.J. Adaptive Stress Testing without Domain Heuristics using Go-Explore. arXiv 2020, arXiv:2004.04292. [Google Scholar]
  181. Bai, F.; Meng, F.; Liu, J.; Wang, J.; Meng, M.Q.-H. Hierarchical policy with deep-reinforcement learning for nonprehensile multiobject rearrangement. Biomim. Intell. Robot. 2022, 2, 100047. [Google Scholar] [CrossRef]
  182. Zhou, C.; Huang, B.; Fränti, P. A review of motion planning algorithms for intelligent robots. J. Intell. Manuf. 2022, 33, 387–424. [Google Scholar] [CrossRef]
  183. Baláž, M.; Tarábek, P. Tensor Implementation of Monte-Carlo Tree Search for Model-Based Reinforcement Learning. Appl. Sci. 2023, 13, 1406. [Google Scholar] [CrossRef]
  184. Zhang, J.; Yu, H.; Xu, W. Hierarchical Reinforcement Learning By Discovering Intrinsic Options. arXiv 2021, arXiv:2101.06521. [Google Scholar]
  185. Morimoto, J.; Doya, K. Acquisition of stand-up behavior by a real robot using hierarchical reinforcement learning. Robot. Auton. Syst. 2001, 36, 37–51. [Google Scholar] [CrossRef]
  186. Chapman, M.; Xu, L.; Lapeyrolerie, M.; Boettiger, C. Bridging adaptive management and reinforcement learning for more robust decisions. arXiv 2023, arXiv:2303.08731. [Google Scholar] [CrossRef]
  187. Wang, Z.; Meng, H.; Zhou, Z.; Feng, Y.; Gao, Y.; Yu, C. Towards Uncertainty in Decision: A Survey on Recent Advances and Challenges in Bayesian Reinforcement Learning. 2022. Available online: https://www.researchsquare.com/article/rs-1780336/v1 (accessed on 12 September 2023).
  188. Badings, T.; Simão, T.D.; Suilen, M.; Jansen, N. Decision-Making Under Uncertainty: Beyond Probabilities. Int. J. Softw. Tools Technol. Transf. 2023, 25, 375–391. [Google Scholar] [CrossRef]
  189. Valverde, G.; Quesada, D.; Larrañaga, P.; Bielza, C. Causal reinforcement learning based on Bayesian networks applied to industrial settings. Eng. Appl. Artif. Intell. 2023, 125, 106657. [Google Scholar] [CrossRef]
  190. Xu, S.; Liu, Q.; Hu, Y.; Xu, M.; Hao, J. Decision-making models on perceptual uncertainty with distributional reinforcement learning. Green Energy Intell. Transp. 2023, 2, 100062. [Google Scholar] [CrossRef]
  191. Wu, J.; Shang, S. Managing Uncertainty in AI-Enabled Decision Making and Achieving Sustainability. Sustainability 2020, 12, 8758. [Google Scholar] [CrossRef]
  192. Tchangani, A.; Networks, B.; Advances, I.D. Bayesian Networks in Risk Informed Decision-Making. Adv. Math. Res. 2023, 29, 31–76. [Google Scholar]
  193. Celemin, C.; Kober, J. Knowledge- and ambiguity-aware robot learning from corrective and evaluative feedback. NEural Comput. Appl. 2023, 35, 16821–16839. [Google Scholar] [CrossRef]
  194. Liang, Z.; He, J.; Hu, C.; Pu, X.; Khani, H.; Dai, L.; Fan, D.; Manthiram, A.; Wang, Z. Next-Generation Energy Harvesting and Storage Technologies for Robots Across All Scales. Adv. Intell. Syst. 2023, 5, 2200045. [Google Scholar] [CrossRef]
  195. Szewczyk, P.K.; Gradys, A.; Kim, S.K.; Persano, L.; Marzec, M.; Kryshtal, A.; Busolo, T.; Toncelli, A.; Pisignano, D.; Bernasik, A.; et al. Enhanced Piezoelectricity of Electrospun Polyvinylidene Fluoride Fibers for Energy Harvesting. ACS Appl. Mater. Interfaces 2020, 12, 13575–13583. [Google Scholar] [CrossRef]
  196. Pu, X.; Liu, M.; Chen, X.; Sun, J.; Du, C.; Zhang, Y.; Zhai, J.; Hu, W.; Wang, Z.L. Ultrastretchable, transparent triboelectric nanogenerator as electronic skin for biomechanical energy harvesting and tactile sensing. Sci. Adv. 2017, 3, e1700015. [Google Scholar] [CrossRef] [PubMed]
  197. Mamur, H.; Dilmaç, Ö.F.; Begum, J.; Bhuiyan, M.R.A. Thermoelectric generators act as renewable energy sources. Clean. Mater. 2021, 2, 100030. [Google Scholar] [CrossRef]
  198. Zhu, S.; Fan, Z.; Feng, B.; Shi, R.; Jiang, Z.; Peng, Y.; Gao, J.; Miao, L.; Koumoto, K. Review on Wearable Thermoelectric Generators: From Devices to Applications. Energies 2022, 15, 3375. [Google Scholar] [CrossRef]
  199. Verstraten, T.; Hosen, M.S.; Berecibar, M.; Vanderborght, B. Selecting Suitable Battery Technologies for Untethered Robot. Energies 2023, 16, 4904. [Google Scholar] [CrossRef]
  200. Fichtner, M.; Edström, K.; Ayerbe, E.; Berecibar, M.; Bhowmik, A.; Castelli, I.E.; Clark, S.; Dominko, R.; Erakca, M.; Franco, A.A.; et al. Rechargeable Batteries of the Future—The State of the Art from a BATTERY 2030+ Perspective. Adv. Energy Mater. 2022, 12, 2102904. [Google Scholar] [CrossRef]
  201. Al-Thyabat, S.; Nakamura, T.; Shibata, E.; Iizuka, A. Adaptation of minerals processing operations for lithium-ion (LiBs) and nickel metal hydride (NiMH) batteries recycling: Critical review. Miner. Eng. 2013, 45, 4–17. [Google Scholar] [CrossRef]
  202. Duffner, F.; Kronemeyer, N.; Tübke, J.; Leker, J.; Winter, M.; Schmuch, R. Post-lithium-ion battery cell production and its compatibility with lithium-ion cell production infrastructure. Nat. Energy 2021, 6, 123–134. [Google Scholar] [CrossRef]
  203. Forouzandeh, P.; Kumaravel, V.; Pillai, S.C. Electrode Materials for Supercapacitors: A Review of Recent Advances. Catalysts 2020, 10, 969. [Google Scholar] [CrossRef]
  204. Citroni, R.; Di Paolo, F.; Livreri, P. A Novel Energy Harvester for Powering Small UAVs: Performance Analysis, Model Validation and Flight Results. Sensors 2019, 19, 1771. [Google Scholar] [CrossRef]
  205. Nardekar, S.S.; Kim, S.-J. Untethered Magnetic Soft Robot with Ultra-Flexible Wirelessly Rechargeable Micro-Supercapacitor as an Onboard Power Source. Adv. Sci. 2023, 10, 2303918. [Google Scholar] [CrossRef]
  206. Townsend, A.; Jiya, I.N.; Martinson, C.; Bessarabov, D.; Gouws, R. A comprehensive review of energy sources for unmanned aerial vehicles, their shortfalls and opportunities for improvements. Heliyon 2020, 6, e05285. [Google Scholar] [CrossRef] [PubMed]
  207. Allioui, H.; Mourdi, Y. Unleashing the Potential of AI: Investigating Cutting-Edge Technologies That Are Transforming Businesses. Int. J. Comput. Eng. Data Sci. IJCEDS 2023, 3, 1–12. [Google Scholar]
  208. Sun, Y. Neural Network-Based Tracking Control of Uncertain Robotic Systems: Predefined-Time Nonsingular Terminal Sliding-Mode Approach. IEEE Trans. Ind. Electron. 2022, 69, 10510–10520. [Google Scholar] [CrossRef]
  209. Bhadra, P.; Chakraborty, S.; Saha, S. Cognitive IoT Meets Robotic Process Automation: The Unique Convergence Revolutionizing Digital Transformation in the Industry 4.0 Era. In Confluence of Artificial Intelligence and Robotic Process Automation; Smart Innovation, Systems and Technologies; Bhattacharyya, S., Banerjee, J.S., De, D., Eds.; Springer: Singapore, 2023; Volume 335. [Google Scholar]
  210. Chryssolouris, G.; Alexopoulos, K.; Arkouli, Z. Artificial Intelligence in Manufacturing Equipment, Automation and Robots. In A Perspective on Artificial Intelligence in Manufacturing. Studies in Systems, Decision and Control; Springer: Cham, Switzerland, 2023; Volume 436. [Google Scholar]
  211. Tan, Y.; Deng, T.; Xu, L. An Ensemble Energy Consumption Prediction Model for Industrial Serial-Robot. In Proceedings of the 2022 34th Chinese Control and Decision Conference (CCDC), Hefei, China, 15–17 August 2022; pp. 5473–5478. [Google Scholar]
  212. Bathla, G.; Bhadane, K.; Singh, R.K.; Kumar, R.; Aluvalu, R.; Krishnamurthi, R.; Kumar, A.; Thakur, R.N.; Basheer, S. Autonomous Vehicles and Intelligent Automation: Applications, Challenges and Opportunities. Mob. Inf. Syst. 2022, 2022, 7632892. [Google Scholar] [CrossRef]
  213. Liu, C.; Lu, J.; Yang, H.; Guo, K. Current State of Robotics in Hand Rehabilitation after Stroke: A Systematic Review. Appl. Sci. 2022, 12, 4540. [Google Scholar] [CrossRef]
  214. Su, H.; Hou, X.; Zhang, X.; Qi, W.; Cai, S.; Xiong, X.; Guo, J. Pneumatic Soft Robots: Challenges and Benefits. Actuators 2022, 11, 92. [Google Scholar] [CrossRef]
  215. Xie, D.; Chen, L.; Liu, L.; Chen, L.; Wang, H. Actuators and Sensors for Application in Agricultural Robots: A Review. Machines 2022, 10, 913. [Google Scholar] [CrossRef]
  216. Dhanya, V.G.; Subeesh, A.; Kushwaha, N.L.; Vishwakarma, D.K.; Nagesh Kumar, T.; Ritika, G.; Singh, A.N. Deep learning based computer vision approaches for smart agricultural applications. Artif. Intell. Agric. 2022, 6, 211–229. [Google Scholar] [CrossRef]
  217. Ghobadpour, A.; Monsalve, G.; Cardenas, A.; Mousazadeh, H. Off-Road Electric Vehicles and Autonomous Robots in Agricultural Sector: Trends, Challenges and Opportunities. Vehicles 2022, 4, 843–864. [Google Scholar] [CrossRef]
  218. Barrile, V.; Simonetti, S.; Citroni, R.; Fotia, A.; Bilotta, G. Experimenting Agriculture 4.0 with Sensors: A Data Fusion Approach between Remote Sensing, UAVs and Self-Driving Tractors. Sensors 2022, 22, 7910. [Google Scholar] [CrossRef] [PubMed]
  219. Arbanas, B.; Petric, F.; Batinović, A.; Polić, M.; Vatavuk, I.; Marković, L.; Bogdan, S. From ERL to MBZIRC: Development of An Aerial-Ground Robotic Team for Search and Rescue. In Automation and Control—Theories and Applications; IntechOpen: Rijeka, Croatia, 2022. [Google Scholar] [CrossRef]
  220. Megalingam, R.K.; Vadivel, S.R.R.; Rajendraprasad, A.; Raj, A.; Baskar, S.; Marutha Babu, R.B. Development and Evaluation of a Search-and-Rescue Robot Paripreksya 2.0 for WRS 2020. Adv. Robot. 2022, 36, 1120–1133. [Google Scholar] [CrossRef]
  221. Nguyen, T.; Katila, R.; Gia, T.N. An advanced Internet-of-Drones System with Blockchain for improving quality of service of Search and Rescue: A feasibility study. Future Gener. Comput. Syst. 2023, 140, 36–52. [Google Scholar] [CrossRef]
  222. Hu, J.; Niu, H.; Carrasco, J.; Lennox, B.; Arvin, F. Voronoi-Based Multi-Robot Autonomous Exploration in Unknown Environments via Deep Reinforcement Learning. IEEE Trans. Veh. Technol. 2020, 69, 14413–14423. [Google Scholar] [CrossRef]
  223. Sahoo, S.; Lo, C.-Y. Smart Manufacturing Powered by Recent Technological Advancements: A Review. J. Manuf. Syst. 2022, 64, 236–250. [Google Scholar] [CrossRef]
  224. Luiz, L.E.; Pilarski, L.; Baidi, K.; Braun, J.; Oliveira, A.; Lima, J.; Costa, P. Robot at Factory Lite—A Step-by-Step Educational Approach to the Robot Assembly. In ROBOT2022: Fifth Iberian Robotics Conference; Tardioli, D., Matellán, V., Heredia, G., Silva, M.F., Marques, L., Eds.; ROBOT 2022; Lecture Notes in Networks and Systems; Springer: Cham, Switzerland, 2023; Volume 589. [Google Scholar]
  225. Hemavathi, S.; Shinisha, A. A Study on Trends and Developments in Electric Vehicle Charging Technologies. J. Energy Storage 2022, 52 Pt C, 105013. [Google Scholar] [CrossRef]
  226. Sengun, B.; Iscan, Y.; Ozbulak, G.A.; Kumbasar, N.; Egriboz, E.; Sormaz, I.C.; Aksakal, N.; Deniz, S.M.; Haklidir, M.; Tunca, F.; et al. Artificial Intelligence in Minimally Invasive Adrenalectomy: Using Deep Learning to Identify the Left Adrenal Vein. Surg. Laparosc. Endosc. Percutaneous Tech. 2023, 33, 327–331. [Google Scholar] [CrossRef]
  227. Haidegger, T.; Speidel, S.; Stoyanov, D.; Satava, R.M. Robot-Assisted Minimally Invasive Surgery—Surgical Robotics in the Data Age. Proc. IEEE 2022, 110, 835–846. [Google Scholar] [CrossRef]
  228. Farooq, M.U.; Eizad, A.; Bae, H.-K. Power solutions for autonomous mobile robots: A survey. Robot. Auton. Syst. 2023, 159, 104285. [Google Scholar] [CrossRef]
  229. Ghobadpour, A.; Cardenas, A.; Monsalve, G.; Mousazadeh, H. Optimal Design of Energy Sources for a Photovoltaic/Fuel Cell Extended-Range Agricultural Mobile Robot. Robotics 2023, 12, 13. [Google Scholar] [CrossRef]
  230. Saviolo, A.; Loianno, G. Learning quadrotor dynamics for precise, safe and agile flight control. Annu. Rev. Control. 2023, 55, 45–60. [Google Scholar] [CrossRef]
  231. Barzegar, A.; Lee, D.-J. Deep Reinforcement Learning-Based Adaptive Controller for Trajectory Tracking and Altitude Control of an Aerial Robot. Appl. Sci. 2022, 12, 4764. [Google Scholar] [CrossRef]
  232. Ruan, T.; Wang, H.; Stolkin, R.; Chiou, M. A Taxonomy of Semantic Information in Robot-Assisted Disaster Response. In Proceedings of the 2022 IEEE International Symposium on Safety, Security and Rescue Robotics (SSRR), Sevilla, Spain, 8–10 November 2022; pp. 285–292. [Google Scholar]
  233. Chen, Z.; Jiao, W.; Ren, K.; Yu, J.; Tian, Y.; Chen, K.; Zhang, X. A Survey of Research Status on the Environmental Adaptation Technologies for Marine Robots. Ocean. Eng. 2023, 286 Pt 2, 115650. [Google Scholar] [CrossRef]
  234. Arzo, S.T.; Sikeridis, D.; Devetsikiotis, M.; Granelli, F.; Fierro, R.; Esmaeili, M.; Akhavan, Z. Essential Technologies and Concepts for Massive Space Exploration: Challenges and Opportunities. IEEE Trans. Aerosp. Electron. Syst. 2023, 59, 3–29. [Google Scholar] [CrossRef]
Figure 4. Technological Clusters for Systems, Interaction, Machines and Awareness.
Figure 4. Technological Clusters for Systems, Interaction, Machines and Awareness.
Energies 16 07156 g004
Table 1. Key Advancements in Power-Converter Technologies for Robotics, along with their Benefits and Applications.
Table 1. Key Advancements in Power-Converter Technologies for Robotics, along with their Benefits and Applications.
Power ConverterKey FeaturesVoltage Regulation RangeEfficiency RangeSwitching FrequencyRobotics Applications
Buck Converter [61]Step-down voltage conversionNarrow to ModerateHighMedium to HighBattery-powered robots, sensor nodes
Boost Converter [62]Step-up voltage conversionModerateHighMedium to HighEnergy harvesting, charging mobile robots
Buck-Boost Converter [63]Bidirectional voltage conversionWideHighMedium to HighBattery management, variable power demands
Resonant Converter [52,53]Zero-voltage switching, reduced EMIWideModerate to HighMedium to HighWireless power transfer, contactless charging
Multi-level Converter [54,55]Reduced harmonics, high voltage capabilityWideHighMedium to HighHigh-power robotic arms, electric vehicles
Matrix Converter [58,59]Bi-directional AC–AC conversionWideHighMedium to HighVariable-speed motor drives, robotic actuators
Soft-Switching Converters [56,57]Minimal switching lossesModerate to WideHighHighHigh-frequency motor drives, precision robotics
Dual Active Bridge Converter [60]Bidirectional AC–DC conversionModerateHighMedium to HighGrid-tied robotics, energy-efficient actuators
Table 3. Summary of Learning Methods for Robot Decision-Making.
Table 3. Summary of Learning Methods for Robot Decision-Making.
Learning MethodApplicationAdvantagesDisadvantagesPossible Advancement
Reinforcement LearningRobot decision-makingLearns from trial and error, Adapts to changing environmentsRequires complex algorithms, May converge slowlyEnhanced exploration strategies, Improved sample efficiency
Deep Reinforcement LearningRobotic arm manipulationHandles complex situations, Utilizes deep neural networksHigh computational cost, Prone to overfittingHybrid architectures combining RL and symbolic reasoning, Better regularization techniques
Trust Region Policy OptimizationPrecise task executionFine-tuned actions for precision, Stable learningLimited to small-scale problems, Sensitive to hyperparametersScalable TRPO variants, Adaptive hyperparameter tuning
Soft Actor-CriticFine-tuned actionsHandles precise tasks efficiently, Stable trainingComplex to implement, Requires careful tuningImproved exploration strategies, Real-time implementation
Model Predictive Control combined with RLLegged locomotionAdapts to unexpected environmental changes, Predictive controlComputationally intensive, Limited to short planning horizonsEfficient approximations for long planning horizons, Better integration with sensor data
Monte Carlo Tree SearchComplex decision-makingEffective in complex situations, Strong theoretical foundationLimited to discrete action spaces, Computationally expensiveHybrid MCTS with RL for continuous action spaces, Parallelization for faster decision-making
Proximal Policy OptimizationComplex decision-makingStable and straightforward to implement, Good sample efficiencyCan be sensitive to initial conditions, Requires careful hyperparameter tuningAdvanced trust region methods, Adaptive exploration strategies
Hierarchical RLEfficient decision-makingBreaks down complex tasks into manageable steps, Improved efficiencyComplex to design and train, Hierarchical policies may not generalize wellBetter automated hierarchy discovery, Transfer learning between hierarchies
Bayesian RLDecision-making under uncertaintyConsiders uncertainty and risk, Robust decision-makingRequires probabilistic modeling, Computationally demandingImproved inference algorithms, Incorporation of domain knowledge
Table 4. Energy-Harvesting Methods and Considerations in Robotics.
Table 4. Energy-Harvesting Methods and Considerations in Robotics.
Method of Energy HarvestingDescriptionAdvantages and ApplicationsChallenges and ConsiderationsPossible Advancements
Solar Energy [89,194,195,196]Utilizes solar cells (e.g., DSSCs, CIGS, PSCs, OSCs) to convert sunlight into electrical power.Global availability of sunlight, Suitable for robotic installations, Various material options for flexibilityEfficiency and reliability improvements, Flexible installation optionsEnhanced efficiency of solar cells, improved flexibility and advanced installation techniques.
Thermoelectrical Generation [197,198]Harnesses temperature differentials to generate electrical energy using semiconductor elements.Harvests heat during operation, Potential for energy capture from human bodyPower sharing among multiple drivers, Multi-degree of freedom operation considerationsDevelopment of more efficient thermoelectric materials, advanced power management for multi-driver robots.
Battery Technology [199,200,201,202]Evolution of rechargeable batteries (e.g., lead acid, lithium-ion, nickel-metal hydride) for improved robot performance.Longer-lasting batteries, Enhanced efficiency and durability, Various battery chemistriesIssues with limited lifespan (lead acid), Operating temperature limitations (lithium-ion)Advancements in battery chemistry, increased energy density and improved temperature tolerance.
Super Capacitors [203,205]Offers fast charging as an alternative to batteries, categorized as electrochemical pseudo-capacitors and double-layer capacitors.Rapid charge and discharge, Environmentally friendly, Suitable for wearablesFaster charging and discharging, Structural and stretchability advantagesDevelopment of supercapacitors with even faster charging rates and enhanced structural properties.
Polymer Electrolyte Membrane Fuel Cells [206]Employs fuel cells using chemical properties for energy storage, providing high energy density performance.High energy density, Potential for green energy transition, Economical hydrogen fuel optionEfficient energy storage, Upscaling potential, Promotes green energy transitionAdvances in fuel cell technology for increased energy density, efficiency and scalability.
Table 5. Emerging Technologies Showcasing Integration of Advanced Power Converters and Learning Approaches Across Different Domains.
Table 5. Emerging Technologies Showcasing Integration of Advanced Power Converters and Learning Approaches Across Different Domains.
Emerging TechnologyIntegration DetailsAdvancementsTechnical HighlightsInnovations
Smart Factory [223,224,225]Bidirectional converters manage energy based on demand predictions, Robots optimize energy usage via learning.Reduced costs, efficient production, Adaptive energy allocation.Real-time power management, Reinforcement learning for optimization.Agile robotic assembly lines.
Minimally Invasive Surgery [226,227]High-frequency converters enable precise instrument control, Machine learning adapts movements based on patient data.Shorter surgery times, improved safety.Rapid-response power control, Neural networks for patient analysis.Haptic feedback for surgeon’s perception.
Autonomous Agriculture [23,228,229]Solar-powered robots monitor crops, Machine-learning processes sensor data for health assessment.Increased yield, efficient farming.Photovoltaic energy harvesting, Deep learning for pest detection.Crop-specific treatment recommendation.
Disaster Recovery with Aerial [230,231,232]Drones with efficient power systems and learning algorithms assess disasters.Rapid response, efficient data analysis.Lightweight power sources for extended flight, Computer vision for disaster assessment.Collaborative drone swarm coverage.
Ocean Exploration [233]Underwater robots equipped with power converters and learning algorithms explore ocean environments.Enhanced data collection, improved navigation.Advanced underwater power management, Reinforcement learning for underwater navigation.Real-time analysis of oceanographic data.
Space Exploration [234]Robots on extraterrestrial missions utilize advanced converters and learning algorithms.Extended mission duration, autonomous decision-making.Radiation-resistant power systems, AI for autonomous navigation and exploration.Self-repair capabilities in extreme conditions.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Singh, R.; Kurukuru, V.S.B.; Khan, M.A. Advanced Power Converters and Learning in Diverse Robotic Innovation: A Review. Energies 2023, 16, 7156. https://doi.org/10.3390/en16207156

AMA Style

Singh R, Kurukuru VSB, Khan MA. Advanced Power Converters and Learning in Diverse Robotic Innovation: A Review. Energies. 2023; 16(20):7156. https://doi.org/10.3390/en16207156

Chicago/Turabian Style

Singh, Rupam, Varaha Satya Bharath Kurukuru, and Mohammed Ali Khan. 2023. "Advanced Power Converters and Learning in Diverse Robotic Innovation: A Review" Energies 16, no. 20: 7156. https://doi.org/10.3390/en16207156

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop