Search Results (17)

This article reports the design, implementation, and formative perception-based evaluation of an early-stage virtual reality (VR) prototype that integrates a virtual cane, localized haptic feedback, 3D audio, and a three-layer bioinspired sensing framework. The prototype was implemented in Unity 2022.3 using the XR Interaction Toolkit and URP and was structured according to design science research methodology (DSRM). The bat–whisker–contact framework was used as a functional abstraction to organize distal auditory reference or warning, proximal haptic feedback, and contact confirmation; it was not evaluated against a non-bioinspired baseline. The completed evaluation consisted of an anonymous, voluntary, post-use questionnaire administered to 25 sighted participants who could select which visual-input configurations to experience. The analysis focused on reported clarity, tolerability, initial signal interpretability, and design feedback; it did not include objective navigation metrics or assess clinical efficacy, training transfer, accessibility outcomes, or orientation-and-mobility performance in blind or low-vision users. General responses suggested favorable perceived clarity and multimodal usefulness, while cane length, floor-versus-wall/obstacle differentiation, and reported discomfort identified priorities for technical refinement. In the simulated no-vision condition (n = 21), participants reported high reliance on the cane response, whereas reported initial insecurity or doubt and basic mental map ratings remained mixed. The study contributes an early-stage technological artifact and a formative basis for subsequent controlled evaluations with objective performance measures, reference conditions, and target users or orientation and mobility specialists. Full article

In edge deployment scenarios, low-light image enhancement faces a trade-off between model complexity and perceptual quality, limiting lightweight models under resource constraints. To address this problem, this paper proposes a perceptual quality optimization model inspired by biological visual mechanisms. Specifically, a GT-Mean loss is introduced to simulate the luminance adaptation property of the mammalian retina, effectively mitigating optimization bias caused by exposure inconsistency in imaging sensors, while the LPIPS loss, aligned with the perceptual preferences of the human visual system (HVS), is incorporated to enhance subjective visual quality. From a structural perspective, inspired by the multi-scale perception of insect compound eyes, biologically selective attention, and color constancy mechanisms, the proposed model integrates an efficient texture-aware attention module, an enhanced multi-scale feature fusion strategy, and a chrominance denoising module. Experimental results demonstrate that, while maintaining an extremely low parameter count of only 0.52 M, the proposed model consistently outperforms existing lightweight methods on the LOL series datasets in terms of PSNR, SSIM, and LPIPS. This work provides an efficient perceptual quality optimization solution for bioinspired visual sensing under resource-constrained conditions. Full article

To address the challenges of severe background interference and unstable grasping of irregular maintenance tools in complex railway ballast environments, this paper proposes a robotic system that integrates enhanced visual perception with bio-inspired soft grasping. The core components of the system include a lightweight detection network (RA-YOLO), asymmetric “Fin Ray” soft fingers, and a visual servoing control framework. By embedding the CBAM attention mechanism and incorporating Mosaic data augmentation, RA-YOLO achieves robust feature extraction under complex backgrounds. The fingertip topology is optimized using the Yeoh constitutive model and finite element analysis, thereby improving stiffness under heavy loads and overall adaptability. Experimental results demonstrate that proposed RA-YOLO achieved a mAP@0.5 of 93.6% on the standard test set with an inference speed of 105 FPS. The visual-servo localization experiment an average Euclidean positioning error of 1.03 mm, with the maximum component-wise absolute error remaining below 2.5 mm. In system-level grasping experiments involving five categories of irregular tools, the integrated system achieved an overall grasping success rate of 91.8%, indicating its potential for automated tool recovery in unstructured railway maintenance environments. Full article

Insects can achieve rapid and precise collision detection despite having limited neural resources. This efficiency provides a vital reference for the development of artificial collision detection systems. Existing bio-inspired models typically include LGMD-based and correlation-based methods. Methods in the former category suffer from a non-linear dependency of warning time on the object’s contrast against the background due to the strong reliance on inter-frame intensity differences. While the latter effectively describe motion perception by leveraging local motion information derived from a delay-and-correlation mechanism, they lack precise spatial boundaries, failing to isolate the actual moving target across irrelevant background dynamics. In this paper, we propose a bio-inspired visual system with a motion-contour-guided mechanism to suppress false-positive background movement while achieving contrast-independent looming warning generation. Specifically, the proposed visual system is composed of two synergistic pathways. The first pathway is designed to extract motion cues and spatial perception of motion via neuronal ensemble coding, whereas the second pathway is developed to extract the contour of the moving target by employing geometric contour evolution. By integrating this derived contour with localized motion cues, the system analyzes the dynamic evolution of the target’s boundary to identify potential collision threats. Benefiting from this fusion of structure and motion, experimental results demonstrate that the proposed visual system is more robust than conventional bio-inspired models in collision detection across distinct contrast scenarios. Full article

Multi-modal Magnetic Resonance Imaging (MRI) provides complementary information for clinical diagnosis, yet its large-scale storage, privacy sensitivity, and annotation cost pose significant challenges. Inspired by biological vision systems, which integrate multi-sensory inputs and compress experiences into compact memory representations, we propose a bio-inspired framework termed Contrast-Guided Multi-modal Dataset Distillation (CGMDD). In biological perception, different sensory channels observe the same environment from complementary perspectives, while hierarchical neural processing ensures perceptual consistency across modalities. Meanwhile, memory systems such as the associated medial temporal lobe structures consolidate redundant experiences into efficient representations for long-term storage. Motivated by these principles, CGMDD treats multi-modal MRI as multi-view perceptual signals and introduces a hierarchical cross-modal contrastive learning mechanism that enforces perceptual alignment across modalities, analogous to multi-level processing in the visual cortex. Furthermore, we design a dynamic dataset distillation strategy that mimics memory consolidation by compressing large-scale data into compact, informative synthetic representations through gradient-based optimization. The proposed framework jointly optimizes perceptual alignment and memory compression in an end-to-end manner, achieving a biologically plausible integration of perception and learning. Experimental results on two MRI datasets demonstrate that CGMDD can compress the original dataset to 5% of its size while maintaining competitive performance, even with only 30% of the labels. These findings highlight the effectiveness of bio-inspired mechanisms in building efficient, robust, and privacy-preserving computer vision systems. Full article

Bio-inspired quadrupedal robots exhibit superior adaptability and mobility in unstructured environments, making them suitable for complex task scenarios such as navigation, obstacle avoidance, and tracking in a variety of environments. Visual perception plays a critical role in enabling autonomous behavior, offering a cost-effective alternative to multi-sensor systems. This paper proposes an image segmentation-guided visual tracking framework to enhance both perception and motion control in quadruped robots. On the perception side, a cascaded convolutional neural network is introduced, integrating a global information guidance module to fuse low-level textures and high-level semantic features. This architecture effectively addresses limitations in single-scale feature extraction and improves segmentation accuracy under visually degraded conditions. On the control side, segmentation outputs are embedded into a biologically inspired central pattern generator (CPG), enabling coordinated generation of limb and spinal trajectories. This integration facilitates a closed-loop visual-motor system that adapts dynamically to environmental changes. Experimental evaluations on benchmark image segmentation datasets and robotic locomotion tasks demonstrate that the proposed framework achieves enhanced segmentation precision and motion flexibility, outperforming existing methods. The results highlight the effectiveness of vision-guided control strategies and their potential for deployment in real-time robotic navigation. Full article

Unmanned Aerial Vehicle (UAV) trajectory planning in complex three-dimensional environments with threats remains a challenging optimization problem requiring efficient algorithms and threat detection capabilities. This study proposes the Conservative Enhanced Dwarf Mongoose Optimization Algorithm (CEDMOA), which introduces four key innovations to the original DMOA: hybrid population initialization, adaptive vocalization parameters, elite-guided learning strategy, and intelligent restart mechanisms. This work proposed the integration of CEDMOA with a novel vision-based threat detection system using YOLO object detection technology, enabling the identification and incorporation of threats into the optimization process. CEDMOA was comprehensively evaluated on the CEC2022 benchmark test suite, demonstrating superior performance compared to other state-of-the-art algorithms in solution quality and convergence stability. The results show the approach successfully generates an optimal collision-free flight trajectory in complex environments in UAV trajectory planning with both static and dynamic threats. Combining metaheuristic optimization with computer vision technology provides a robust framework for autonomous navigation that adapts to changing threat conditions. Experimental results validate the effectiveness of both the enhanced algorithm and the vision-based threat integration approach for practical UAV operations. Full article

This paper presents the design and experimental evaluation of a bio-inspired gecko robot, focusing on mechanical design, vision-based obstacle perception, and rhythmic locomotion control as enabling technologies for future obstacle avoidance in complex environments. The robot features a 17-degrees-of-freedom mechanical structure with a flexible spine and multi-jointed limbs, providing a physical basis for adaptive locomotion. For perception, a custom obstacle detection dataset was constructed from the robot’s onboard camera view and used to train a YOLOv5-based detection model. Experimental results show that the trained model achieves a mean average precision (mAP) of 0.979 and a maximum F1-score of 0.97 at an optimal confidence threshold, demonstrating reliable real-time obstacle perception under diverse indoor conditions. For motion control, a central pattern generator (CPG) based on Hopf oscillators is implemented to generate rhythmic locomotion. Experimental evaluations confirm stable diagonal gait generation, with coordinated joint trajectories oscillating at 1 Hz. The flexible spine exhibits periodic lateral deflection with peak amplitudes of ±15°, ±10°, and ±8° across spinal joints, enhancing locomotion continuity and turning capability. Physical robot experiments further demonstrate smooth straight-line crawling enabled by the coupled limb–spine motion. While visual perception and CPG-based locomotion are experimentally validated as independent subsystems, their real-time closed-loop integration is not implemented in this study. Instead, this work establishes a system-level framework and experimental baseline for future perception–motion coupling, providing a foundation for closed-loop obstacle avoidance and autonomous navigation in bio-inspired gecko robots. Full article

The widespread application of organoids in disease modeling and drug development is significantly constrained by challenges in automated quantitative analysis. In bright-field microscopy images, organoids exhibit complex characteristics, including irregular morphology, blurred boundaries, and substantial scale variations, largely stemming from their dynamic self-organization that mimics in vivo tissue development. Existing convolutional neural network-based methods are limited by fixed receptive fields and insufficient modeling of inter-channel relationships, making them inadequate for detecting such evolving biological structures. To address these challenges, we propose a novel detection head, termed Interactive Dual-Perception Head (IDP-Head), inspired by hierarchical perception mechanisms in the biological visual cortex. Integrated into the RTMDet framework, IDP-Head comprises two bio-inspired components: a Large-Kernel Global Perception Module (LGPM) to capture global morphological dependencies, analogous to the wide receptive fields of cortical neurons, and a Progressive Channel Synergy Module (PCSM) that models inter-channel semantic collaboration, echoing the integrative processing of multi-channel stimuli in neural systems. Additionally, we construct a new organoid detection dataset to mitigate the scarcity of annotated data. Extensive experiments on both our dataset and public benchmarks demonstrate that IDP-Head achieves a 5-percentage-point improvement in mean Average Precision (mAP) over the baseline model, offering a biologically inspired and effective solution for high-fidelity organoid detection. Full article

To enable intelligent inspection of underground cable systems, this study presents a gecko-inspired quadruped robot that integrates multi-degree-of-freedom motion with a deep learning-based visual detection system. Inspired by the gecko’s flexible spine and leg structure, the robot exhibits strong adaptability to confined and uneven tunnel environments. The motion system is modeled using the standard Denavit–Hartenberg (D–H) method, with both forward and inverse kinematics derived analytically. A zero-impact foot trajectory is employed to achieve stable gait planning. For defect detection, the robot incorporates a binocular vision module and an enhanced YOLOv8 framework. The key improvements include a lightweight feature fusion structure (SlimNeck), a multidimensional coordinate attention (MCA) mechanism, and a refined MPDIoU loss function, which collectively improve the detection accuracy of subtle defects such as insulation aging, micro-cracks, and surface contamination. A variety of data augmentation techniques—such as brightness adjustment, Gaussian noise, and occlusion simulation—are applied to enhance robustness under complex lighting and environmental conditions. The experimental results validate the effectiveness of the proposed system in both kinematic control and vision-based defect recognition. This work demonstrates the potential of integrating bio-inspired mechanical design with intelligent visual perception to support practical, efficient cable inspection in confined underground environments. Full article

Creating grayscale images from a color reality has been an inherent human practice since ancient times, but it became a technological challenge with the advent of the first black-and-white televisions and digital image processing. Decolorization is a process that projects visual information from a three-dimensional feature space to a one-dimensional space, thus reducing the dimensionality of the image while minimizing the loss of information. To achieve this, various strategies have been developed, including the application of color channel weights and the analysis of local and global image contrast, but there is no universal solution. In this paper, we propose a bio-inspired approach that combines findings from neuroscience on the architecture of the visual system and color coding with evidence from studies in the psychology of art. The goal is to simplify the decolorization process and facilitate its control through color-related concepts that are easily understandable to humans. This new method organizes colors in a scale that links activity on the retina with a system of opponent and complementary channels, thus allowing the adjustment of the perception of warmth and coolness in the image. The results show an improvement in chromatic contrast, especially in the warmth and coolness categories, as well as an enhanced ability to preserve subtle contrasts, outperforming other approaches in the Ishihara test used in color blindness detection. In addition, the method offers a computational advantage by reducing the process through direct pixel-level operation. Full article

In recent research, dendritic neuron-based models have shown promise in effectively learning and recognizing object motion direction within binary images. Leveraging the dendritic neuron structure and On–Off Response mechanism within the primary cortex, this approach has notably reduced learning time and costs compared to traditional neural networks. This paper advances the existing model by integrating bio-inspired components into a learnable dendritic neuron-based artificial visual system (AVS), specifically incorporating mechanisms from horizontal and bipolar cells. This enhancement enables the model to proficiently identify object motion directions in grayscale images, aligning its threshold with human-like perception. The enhanced model demonstrates superior efficiency in motion direction recognition, requiring less data (90% less than other deep models) and less time for training. Experimental findings highlight the model’s remarkable robustness, indicating significant potential for real-world applications. The integration of bio-inspired features not only enhances performance but also opens avenues for further exploration in neural network research. Notably, the application of this model to realistic object recognition yields convincing accuracy at nearly 100%, underscoring its practical utility. Full article

Pixel-level classification of very-high-resolution images is a crucial yet challenging task in remote sensing. While transformers have demonstrated effectiveness in capturing dependencies, their tendency to partition images into patches may restrict their applicability to highly detailed remote sensing images. To extract latent contextual semantic information from high-resolution remote sensing images, we proposed a gaze–saccade transformer (GSV-Trans) with visual perceptual attention. GSV-Trans incorporates a visual perceptual attention (VPA) mechanism that dynamically allocates computational resources based on the semantic complexity of the image. The VPA mechanism includes both gaze attention and eye movement attention, enabling the model to focus on the most critical parts of the image and acquire competitive semantic information. Additionally, to capture contextual semantic information across different levels in the image, we designed an inter-layer short-term visual memory module with bidirectional affinity propagation to guide attention allocation. Furthermore, we introduced a dual-branch pseudo-label module (DBPL) that imposes pixel-level and category-level semantic constraints on both gaze and saccade branches. DBPL encourages the model to extract domain-invariant features and align semantic information across different domains in the feature space. Extensive experiments on multiple pixel-level classification benchmarks confirm the effectiveness and superiority of our method over the state of the art. Full article

Bio-inspired models based on the lobula giant movement detector (LGMD) in the locust’s visual brain have received extensive attention and application for collision perception in various scenarios. These models offer advantages such as low power consumption and high computational efficiency in visual processing. However, current LGMD-based computational models, typically organized as four-layered neural networks, often encounter challenges related to noisy signals, particularly in complex dynamic environments. Biological studies have unveiled the intrinsic stochastic nature of synaptic transmission, which can aid neural computation in mitigating noise. In alignment with these biological findings, this paper introduces a probabilistic LGMD (Prob-LGMD) model that incorporates a probability into the synaptic connections between multiple layers, thereby capturing the uncertainty in signal transmission, interaction, and integration among neurons. Comparative testing of the proposed Prob-LGMD model and two conventional LGMD models was conducted using a range of visual stimuli, including indoor structured scenes and complex outdoor scenes, all subject to artificial noise. Additionally, the model’s performance was compared to standard engineering noise-filtering methods. The results clearly demonstrate that the proposed model outperforms all comparative methods, exhibiting a significant improvement in noise tolerance. This study showcases a straightforward yet effective approach to enhance collision perception in noisy environments. Full article

The visual system plays a vital role in the daily life of humans, as more than 90 percent of the external information received by the human brain throughout the day comes from the visual system. However, how the human brain processes the received visual information remains a mystery. The information received from the external through the visual system can be divided into three main categories, namely, shape features, color features, and motion features. Of these, motion features are considered the key to deciphering the secrets of the visual system due to their independence and importance. In this paper, we propose a novel bio-inspired motion direction detection mechanism using direction-selective ganglion cells to explore the mystery of motion information extraction and analysis. The mechanism proposed in this paper is divided into two parts: local motion direction detection neurons and global motion direction detection neurons; the former is used to extract motion direction information from the local area, while the latter infers global motion direction from the local motion direction information. This mechanism is more consistent with the biological perception of the human natural visual system than the previously proposed model and has a higher biological plausibility and greater versatility. It is worth mentioning that we have overcome the problem in which the previous motion direction detection model could only be applied in the binary background by introducing the horizontal cells. Through the association formed by horizontal cells and bipolar cells, this model can be applied to recognizing problems of motion direction detection on a grayscale background. To further validate the effectiveness of the proposed model, a series of experiments with objects of different sizes, shapes, and positions are conducted by computer simulation. According to the simulation results, this model has been proven to have high accuracy rates regardless of objects’ sizes, shapes, and positions in all experiments. Furthermore, the proposed model is verified to own more stable accuracy rates and stronger noise immunity by comparing it with the recognized superior classical convolutional neural network in a background of different percentage noise. Full article