Skip to Content
MachinesMachines
  • Article
  • Open Access

1 June 2026

39 Pages

An Integrated Visual Perception and Soft Robotic Grasping System for Adaptive Handling of Railway Maintenance Tools

,
,
,
,
and
1
School of Computer, Baoji University of Arts and Sciences, Baoji 721016, China
2
Shaanxi Key Laboratory of Advanced Manufacturing and Evaluation of Robot Key Components, Baoji University of Arts and Sciences, Baoji 721016, China
3
State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China
*
Author to whom correspondence should be addressed.

Abstract

To address the challenges of severe background interference and unstable grasping of irregular maintenance tools in complex railway ballast environments, this paper proposes a robotic system that integrates enhanced visual perception with bio-inspired soft grasping. The core components of the system include a lightweight detection network (RA-YOLO), asymmetric “Fin Ray” soft fingers, and a visual servoing control framework. By embedding the CBAM attention mechanism and incorporating Mosaic data augmentation, RA-YOLO achieves robust feature extraction under complex backgrounds. The fingertip topology is optimized using the Yeoh constitutive model and finite element analysis, thereby improving stiffness under heavy loads and overall adaptability. Experimental results demonstrate that proposed RA-YOLO achieved a mAP@0.5 of 93.6% on the standard test set with an inference speed of 105 FPS. The visual-servo localization experiment an average Euclidean positioning error of 1.03 mm, with the maximum component-wise absolute error remaining below 2.5 mm. In system-level grasping experiments involving five categories of irregular tools, the integrated system achieved an overall grasping success rate of 91.8%, indicating its potential for automated tool recovery in unstructured railway maintenance environments.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.