Search Results (32)

As intelligent cockpits transition into the “third living space”, traditional driver monitoring systems face limitations such as rigid monitoring, computationally intensive algorithms, and insufficient engineering robustness. This paper proposes an edge-computing-based emotion-aware ambient lighting system, forming a complete loop of emotion perception–decision–adaptation. A lightweight emotion recognition network is designed for edge computing: the Mini_XCEPTION architecture is optimized with depthwise separable convolutions to reduce parameters, and a Gaussian-smoothed weighted cross-entropy loss function is used to address class imbalance and ambiguous emotion boundaries. After INT8 quantization, the model achieves 47 FPS real-time inference on a Raspberry Pi (Raspberry Pi Ltd., Cambridge, United Kingdom). A high-concurrency asynchronous software–hardware architecture based on PyQt5 5.15.6 and QThread5.15.6 is built, with a serial communication mechanism featuring fixed-length frames and fault recovery to improve the robustness of the hardware-in-the-loop system. Breaking the rigid alarm mode, an emotion–HSV lighting mapping matrix is established based on the Russell Valence-Arousal model, combined with 0.1 Hz bionic breathing rhythm for non-intrusive feedback. An FSM-controlled HSV lighting policy with 0.1 Hz breathing-light feedback was implemented on an in-cabin HIL platform. In a 12-participant simulated road-rage test, the intervention reduced FER-based anger recovery time by 42.6%; independent physiological validation remains necessary. Full article

The Pathfinder Algorithm (PFA) is a bionic swarm intelligence optimization algorithm inspired by simulating the cooperative movement of animal groups in nature to search for prey. Based on fitness, the algorithm classifies search individuals into leaders and followers. However, PFA fails to effectively balance the optimization capabilities of leaders and followers, leading to problems such as insufficient population diversity and slow convergence speed in the original algorithm. To address these issues, this paper proposes an enhanced pathfinder algorithm based on multi-strategy (EODE-PFA). Through the synergistic effects of multiple improved strategies, it effectively solves the balance problem between global exploration and local optimization of the algorithm. To verify the performance of EODE-PFA, this paper applies it to CEC2022 benchmark functions, three types of complex engineering optimization problems, and six sets of feature selection problems, respectively, and compares it with eight mature optimization algorithms. Experimental results show that in three different scenarios, EODE-PFA has significant advantages and competitiveness in both convergence speed and solution accuracy, fully verifying its engineering practicality and scenario universality. To highlight the synergistic effects and overall gains of multiple improved strategies, ablation experiments are conducted on key strategies. To further verify the statistical significance of the experimental results, the Wilcoxon signed-rank test is performed in this study. In addition, for feature selection problems, this study selects UCI real datasets with different real-world scenarios and dimensions, and the results show that the algorithm can still effectively balance exploration and exploitation capabilities in discrete scenarios. Full article

Recent advances in bionic intelligence are reshaping humanoid-robot design, demonstrating unprecedented agility, dexterity and task versatility. These breakthroughs drive an increasing need for large scale and high-quality data. Current data generation methods, however, are often expensive and time-consuming. To address this, we introduce Digital Twin Loong (DT-Loong), a digital twin system that combines a high-fidelity simulation environment with a full-scale virtual replica of the humanoid robot Loong, a bionic robot encompassing biomimetic joint design and movement mechanism. By integrating optical motion capture and human-to-humanoid motion re-targeting technologies, DT-Loong generates data for training and refining embodied AI models. We showcase the data collected from the system is of high quality. DT-Loong also proposes a Priority-Guided Quadratic Optimization algorithm for action retargeting, which achieves lower time delay and enhanced mapping accuracy. This approach enables real-time environmental feedback and anomaly detection, making it well-suited for monitoring and patrol applications. Our comprehensive framework establishes a foundation for humanoid robot training and further digital twin applications in humanoid robots to enhance their human-like behaviors through the emulation of biological systems and learning processes. Full article

Hydraulic legged robots, with advantages such as high load capacity and power density, have become a strategic driving force in advancing intelligent mobile platform technologies. However, their high energy consumption significantly limits long-duration endurance and efficient operational performance. In this paper, inspired by the excellent autonomous energy-efficient consciousness of mammals endowed by natural evolution, a bionic energy-efficient inverse kinematics method based on neural networks (EIKNN) is proposed for the energy-efficient motion planning of hydraulic legged robots with redundant degrees of freedom (RDOFs). Firstly, the dynamic programming (DP) algorithm is used to solve the optimal joint configuration with minimum energy loss as the goal, and the training data set is generated. Subsequently, the inverse kinematic model of the leg with minimum energy loss is learned based on neural network (NN) simulation of the autonomous energy-efficient consciousness endowed to mammals by natural evolution. Finally, extensive comparative experiments validate the effectiveness and superiority of the proposed method. This method not only significantly reduces energy dissipation in hydraulic legged robots but also lays a crucial foundation for advancing hydraulic legged robot technology toward high efficiency, environmental sustainability, and long-term developmental viability. Full article

Although existing motion transfer methods for bionic robot arms are based on kinematic equivalence or simplified dynamic models, they frequently fail to tackle dynamic compliance and real-time adaptability in complex human-like motions. To address this shortcoming, this study presents a motion transfer method from the human arm to a bionic robot arm based on the hybrid PSO-RF (Particle Swarm Optimization-Random Forest) algorithm to improve joint space mapping accuracy and dynamic compliance. Initially, a high-precision optical motion capture (Mocap) system was utilized to record human arm trajectories, and Kalman filtering and a Rauch–Tung–Striebel (RTS) smoother were applied to reduce noise and phase lag. Subsequently, the joint angles of the human arm were computed through geometric vector analysis. Although geometric vector analysis offers an initial estimation of joint angles, its deterministic framework is subject to error accumulation caused by the occlusion of reflective markers and kinematic singularities. To surmount this limitation, this study designed five action sequences for the establishment of the training database for the PSO-RF model to predict joint angles when performing different actions. Ultimately, an experimental platform was built to validate the motion transfer method, and the experimental verification showed that the system attained high prediction accuracy (R² = 0.932 for the elbow joint angle) and real-time performance with a latency of 0.1097 s. This paper promotes compliant human–robot interaction by dealing with joint-level dynamic transfer challenges, presenting a framework for applications in intelligent manufacturing and rehabilitation robotics. Full article

Human action recognition aims to understand human behavior and is crucial in enhancing the intelligence and naturalness of human–computer interaction and bionic robots. This paper proposes a method to improve the complexity and real-time performance of action recognition by combining the Kinect sensor with the OpenPose algorithm, the Levenberg–Marquardt (LM) algorithm, and the Dynamic Time Warping (DTW) algorithm. First, the Kinect V2 depth sensor is used to capture color images, depth images, and 3D skeletal point information from the human body. Next, the color image is processed using OpenPose to extract 2D skeletal point information, which is then mapped to the depth image to obtain 3D skeletal point information. Subsequently, the LM algorithm is employed to fuse the 3D skeletal point sequences with the sequences obtained from Kinect, generating stable 3D skeletal point sequences. Finally, the DTW algorithm is utilized to recognize complex movements. Experimental results across various scenes and actions demonstrate that the method is stable and accurate, achieving an average recognition rate of 95.94%. The method effectively addresses issues, such as jitter and self-occlusion, when Kinect collects skeletal points. The robustness and accuracy of the method make it highly suitable for application in robot interaction systems. Full article

This paper reviews the research progress of bionic soft robot technology learned from octopuses. The number of related research papers increased from 760 in 2021 to 1170 in 2024 (Google Scholar query), with a growth rate of 53.95% in the past five years. These studies mainly explore how humans can learn from the physiological characteristics of octopuses for sensor design, actuator development, processor architecture optimization, and intelligent optimization algorithms. The tentacle structure and nervous system of octopus have high flexibility and distributed control capabilities, which is an important reference for the design of soft robots. In terms of sensor technology, flexible strain sensors and suction cup sensors inspired by octopuses achieve accurate environmental perception and interaction. Actuator design uses octopus muscle fibers and movement patterns to develop various driving methods, including pneumatic, hydraulic and electric systems, which greatly improves the robot’s motion performance. In addition, the distributed nervous system of octopuses inspires multi-processor architecture and intelligent optimization algorithms. This paper also introduces the concept of expected functional safety for the first time to explore the safe design of soft robots in failure or unknown situations. Currently, there are more and more bionic soft robot technologies that draw on octopuses, and their application areas are constantly expanding. In the future, with further research on the physiological characteristics of octopuses and the integration of artificial intelligence and materials science, octopus soft robots are expected to show greater potential in adapting to complex environments, human–computer interaction, and medical applications. Full article

Background: With the development of artificial intelligence, memristors have become an ideal choice to optimize new neural network architectures and improve computing efficiency and energy efficiency due to their combination of storage and computing power. In this context, spiking neural networks show the ability to resist Gaussian noise, spike interference, and AC electric field interference by adjusting synaptic plasticity. The anti-interference ability to spike neural networks has become an important direction of electromagnetic protection bionics research. Methods: Therefore, this research constructs two types of spiking neural network models with LIF model as nodes: VGG-SNN and FCNN-SNN, and combines pruning algorithm to simulate network connection damage during the training process. By comparing and analyzing the millimeter wave radar human motion dataset and MNIST dataset with traditional artificial neural networks, the anti-interference performance of spiking neural networks and traditional artificial neural networks under the same probability of edge loss was deeply explored. Results: The experimental results show that on the millimeter wave radar human motion dataset, the accuracy of the spiking neural network decreased by 5.83% at a sparsity of 30%, while the accuracy of the artificial neural network decreased by 18.71%. On the MNIST dataset, the accuracy of the spiking neural network decreased by 3.91% at a sparsity of 30%, while the artificial neural network decreased by 10.13%. Conclusions: Therefore, under the same network connection damage conditions, spiking neural networks exhibit unique anti-interference performance advantages. The performance of spiking neural networks in information processing and pattern recognition is relatively more stable and outstanding. Further analysis reveals that factors such as network structure, encoding method, and learning algorithm have a significant impact on the anti-interference performance of both. Full article

Despite the implementation of numerous interventions to enhance urban traffic safety, the estimation of the risk of traffic crashes resulting in life-threatening and economic costs remains a significant challenge. In light of the above, an online inference method for traffic crash risk based on the self-developed TAR-DETR and WOA-SA-SVM methods is proposed. The method’s robust data inference capabilities can be applied to autonomous mobile robots and vehicle systems, enabling real-time road condition prediction, continuous risk monitoring, and timely roadside assistance. First, a self-developed dataset for urban traffic object detection, named TAR-1, is created by extracting traffic information from major roads around Hainan University in China and incorporating Russian car crash news. Secondly, we develop an innovative Context-Guided Reconstruction Feature Network-based Urban Traffic Objects Detection Model (TAR-DETR). The model demonstrates a detection accuracy of 76.8% for urban traffic objects, which exceeds the performance of other state-of-the-art object detection models. The TAR-DETR model is employed in TAR-1 to extract urban traffic risk features, and the resulting feature dataset was designated as TAR-2. TAR-2 comprises six risk features and three categories. A new inference algorithm based on WOA-SA-SVM is proposed to optimize the parameters (C, g) of the SVM, thereby enhancing the accuracy and robustness of urban traffic crash risk inference. The algorithm is developed by combining the Whale Optimization Algorithm (WOA) and Simulated Annealing (SA), resulting in a Hybrid Bionic Intelligent Optimization Algorithm. The TAR-2 dataset is inputted into a Support Vector Machine (SVM) optimized using a hybrid algorithm and used to infer the risk of urban traffic crashes. The proposed WOA-SA-SVM method achieves an average accuracy of 80% in urban traffic crash risk inference. Full article

E-skin is a bionic device with flexible and intelligent sensing ability that can mimic the touch, temperature, pressure, and other sensing functions of human skin. Because of its flexibility, breathability, biocompatibility, and other characteristics, it is widely used in health management, personalized medicine, disease prevention, and other pan-health fields. With the proposal of new sensing principles, the development of advanced functional materials, the development of microfabrication technology, and the integration of artificial intelligence and algorithms, e-skin has developed rapidly. This paper focuses on the characteristics, fundamentals, new principles, key technologies, and their specific applications in health management, exercise monitoring, emotion and heart monitoring, etc. that advanced e-skin needs to have in the healthcare field. In addition, its significance in infant and child care, elderly care, and assistive devices for the disabled is analyzed. Finally, the current challenges and future directions of the field are discussed. It is expected that this review will generate great interest and inspiration for the development and improvement of novel e-skins and advanced health monitoring systems. Full article

Due to its high power-to-weight ratio, low weight, and silent operation, shape memory alloy (SMA) is widely used as a muscle-like soft actuator in intelligent bionic robot systems. However, hysteresis nonlinearity and multi-valued mapping behavior can severely impact trajectory tracking accuracy. This paper proposes an adaptive nonsingular fast terminal sliding mode control (ANFTSMC) scheme aimed at enhancing position tracking performance in SMA-actuated systems by addressing hysteresis nonlinearity, uncertain dynamics, and external disturbances. Firstly, a simplified third-order actuator model is developed and a variable gain extended state observer (VGESO) is employed to estimate unmodeled dynamics and external disturbances within finite time. Secondly, a novel nonsingular fast terminal sliding mode control (NFTSMC) law is designed to overcome singularity issues, reduce chattering, and guarantee finite-time convergence of the system states. Finally, the ANFTSMC scheme, integrating NFTSMC with VGESO, is proposed to achieve precise position tracking for the prosthetic hand. The convergence of the closed-loop control system is validated using Lyapunov’s stability theory. Experimental results demonstrate that the external pulse disturbance error of ANFTSMC is 8.19°, compared to 19.21° for the comparative method. Furthermore, the maximum absolute error for ANFTSMC is 0.63°, whereas the comparative method shows a maximum absolute error of 1.03°. These results underscore the superior performance of the proposed ANFTSMC algorithm. Full article

This paper describes a novel bionic eye binocular vision system designed to mimic the natural movements of the human eye. The system provides a broader field of view and enhances visual perception in complex environments. Compared with similar bionic binocular cameras, the JEWXON BC200 bionic binocular camera developed in this study is more miniature. It consumes only 2.8 W of power, which makes it ideal for mobile robots. Combining axis and camera rotation enables more seamless panoramic image synthesis and is therefore suitable for self-rotating bionic binocular cameras. In addition, combined with the YOLO-V8 model, the camera can accurately recognize objects such as clocks and keyboards. This research provides new ideas for the development of robotic vision systems. Full article

The protection of plants in mountainous and hilly areas differs from that in plain areas due to the complex terrain, which divides the work plot into many narrow plots. When designing the path planning method for plant protection UAVs, it is important to consider the generality in different working environments. To address issues such as poor path optimization, long operation time, and excessive iterations required by traditional swarm intelligence algorithms, this paper proposes a bionic three-dimensional path planning algorithm for plant protection UAVs. This algorithm aims to plan safe and optimal flight paths between work plots obstructed by multiple obstacle areas. Inspired by krill group behavior and based on group intelligence algorithm theory, the bionic three-dimensional path planning algorithm consists of three states: “foraging behavior”, “avoiding enemy behavior”, and “cruising behavior”. The current position information of the UAV in the working environment is used to switch between these states, and the optimal path is found after several iterations, which realizes the adaptive global and local convergence of the track planning, and improves the convergence speed and accuracy of the algorithm. The optimal flight path is obtained by smoothing using a third-order B-spline curve. Three sets of comparative simulation experiments are designed to verify the performance of this proposed algorithm. The results show that the bionic swarm intelligence algorithm based on krill swarm behavior reduces the path length by 1.1~17.5%, the operation time by 27.56~75.15%, the path energy consumption by 13.91~27.35%, and the number of iterations by 46~75% compared with the existing algorithms. The proposed algorithm can shorten the distance of the planned path more effectively, improve the real-time performance, and reduce the energy consumption. Full article

Vehicle running state parameters and road surface state are crucial to the stability of four-wheel independent drive and steering electric vehicle control. Therefore, this study explores the estimation of vehicle driving state parameters and road surface adhesion coefficients using a combination of federal Kalman filtering and an intelligent bionic antlion optimization algorithm. Firstly, according to the research purpose of the paper and the focus on the accuracy of the establishment of the three degrees of freedom dynamics model, fully considering the road conditions, the paper adopts the Dugoff tire model and finally completes the establishment of the vehicle state estimation model. Secondly, the drive state estimation algorithm is developed utilizing the principles of federal Kalman filtering and volume Kalman filtering. At the same time, robust estimation theory is introduced into the sub-filter, and the antlion optimization module is designed at the lower layer of the main filter to enhance the accuracy of estimates. It is easy to see that the design of the Antlion federal Kalman travel state estimation algorithm has noticeably enhanced accuracy and traceability, according to the result. Thirdly, a joint estimation algorithm of state estimation and road surface adhesion coefficient has been devised to enhance the stability and precision of the estimation process. Finally, the results showed that the joint estimation algorithm has high accuracy in estimating vehicle driving state parameters such as the center of mass lateral deflection angle and road surface adhesion coefficient by simulation. Full article

The objective of this research is to achieve biologically autonomous control by utilizing a whole-brain network model, drawing inspiration from biological neural networks to enhance the development of bionic intelligence. Here, we constructed a whole-brain neural network model of Caenorhabditis elegans (C. elegans), which characterizes the electrochemical processes at the level of the cellular synapses. The neural network simulation integrates computational programming and the visualization of the neurons and synapse connections of C. elegans, containing the specific controllable circuits and their dynamic characteristics. To illustrate the biological neural network (BNN)’s particular intelligent control capability, we introduced an innovative methodology for applying the BNN model to a 12-legged robot’s movement control. Two methods were designed, one involving orientation control and the other involving locomotion generation, to demonstrate the intelligent control performance of the BNN. Both the simulation and experimental results indicate that the robot exhibits more autonomy and a more intelligent movement performance under BNN control. The systematic approach of employing the whole-brain BNN for robot control provides biomimetic research with a framework that has been substantiated by innovative methodologies and validated through the observed positive outcomes. This method is established as follows: (1) two integrated dynamic models of the C. elegans’ whole-brain network and the robot moving dynamics are built, and all of the controllable circuits are discovered and verified; (2) real-time communication is achieved between the BNN model and the robot’s dynamical model, both in the simulation and the experiments, including applicable encoding and decoding algorithms, facilitating their collaborative operation; (3) the designed mechanisms using the BNN model to control the robot are shown to be effective through numerical and experimental tests, focusing on ‘foraging’ behavior control and locomotion control. Full article