Search Results (252)

Permanent lunar habitation will require robotic systems that can maintain infrastructure, recover from local failures, and acquire new operational capabilities under limited Earth supervision. Existing planetary robots are largely fixed-function specialists, while end-to-end foundation-model policies remain difficult to validate and extend for safety-critical surface operations. We present SELENE (Self-Evolving Lunar Embodied ageNt Ecosystem), an architectural proposal for contract-governed lunar robotic autonomy centered on a shared Atomic Action Library $\mathbb{A}$. The key abstraction is the Atomic Action Contract: a typed skill interface that specifies parameters, preconditions, goal predicates, execution bindings, safety envelopes, runtime reports, and validation metadata. Through this contract, a VLM-driven Cognitive Agent plans over executable skills, a multi-modal Execution Agent realizes them through optimization-based controllers, Vision–Language–Action (VLA) policies, Vision–Language–Navigation (VLN) policies, or reinforcement-learned policies, and an offline Evolutionary Agentic Framework synthesizes and registers new candidate contracts without modifying the planner or the execution interface. This paper presents an architecture-level validation of that contract mechanism. We instantiate SELENE across two heterogeneous pathways on LunarBot and its simulation counterpart, with optimization-based control supported as a third execution modality. A pre-trained VLA policy adapted from 100 teleoperated demonstrations achieves 29/30 task success (96.7 percent) in in-domain trials on the physical LunarBot. A curriculum–RL policy instantiates the traversal pathway in simulated lunar-gravity terrain. Together, these results show that the Atomic Action Contract can serve as a common registration and dispatch interface across heterogeneous control modalities. The same contract layer also defines the path toward runtime gap-triggered self-evolution, mission-grade admission, and lunar-environment validation in subsequent system-level studies. Full article

Strawberry production is economically important but remains highly dependent on labour-intensive harvesting. The delicate texture, irregular distribution, and non-uniform maturity of strawberry fruit create substantial challenges for mechanised and robotic operations. This review examines the development of strawberry-harvesting technologies from the broader perspectives of crop value, cultivation management, harvesting methods, robotic systems, post-harvest handling, and sustainable production. The nutritional and economic significance of strawberries is first outlined, followed by an analysis of cultivation environments, production patterns, and crop-management practices that influence fruit accessibility and robotic operation. The historical transition from manual harvesting to mechanised and intelligent harvesting is then reviewed. Particular attention is given to the principal technologies of strawberry-harvesting robots, including mobile platforms, robotic manipulators, path planning and obstacle avoidance, end-effectors, visual recognition, multispectral sensing, and software control. Robotic systems designed for elevated and ridge-based cultivation are also compared to clarify the influence of cultivation layout on platform configuration and harvesting strategy. In addition, the integration of harvesting with fruit transfer, post-harvest handling, and sustainable cultivation is discussed. The reviewed studies indicate that effective robotic harvesting depends on the coordinated design of cultivation systems, perception, motion planning, compliant manipulation, and system control. Future research should prioritise robust perception under occlusion, low-damage harvesting, improved operational speed, scenario adaptability, cost reduction, and closer integration between agronomic practices and robotic design. Full article

This article presents the development and proof-of-concept testing of a vision-based safety monitoring tool for operators in simulated robotic cells in RoboDK. The proposed method uses a virtual camera placed above the cell and image processing techniques to analyze the relationship between the operator and the workspace swept by the robot. In an initial stage, the robot movement is recorded as a mask of the swept space, and areas irrelevant to the process can be excluded by user-defined polygons. In the monitoring stage, the operator is identified in the video stream by HSV segmentation, after which an adjustable clearance zone is generated around the detected contour. Based on the intersections between the operator, clearance, swept space mask and the mask of the current robot movement, the application provides four discrete states: SAFE, WARNING, DANGER and COLLISION. For the experimental validation in the virtual environment, the virtual contact moment is estimated separately, while the COLLISION state is defined as the intersection between the inflated operator contour and the current robot motion mask. Therefore, in this study, COLLISION does not indicate measured physical contact, but an image-based imminent-collision condition used for early warning. The test scenario was carried out in a virtual palletizing cell, which includes an articulated arm robot, conveyors, manipulated objects and a mobile dummy acting as an operator. The obtained results support the use of the method as an applicative simulation solution for the evaluation of the early detection of risk situations. The study is limited to the virtual environment and represents a basis for future research on the development of visual monitoring systems to increase safety in collaborative and industrial robotic cells. Full article

Long-horizon mobile manipulation requires a robot to execute a sequence of heterogeneous subtasks such as navigation, picking, and articulated-object manipulation in indoor environments. Standard reinforcement learning suffers from reward sparsity and inefficient exploration in this setting, and hierarchical methods often fail at the hand-off between consecutive subtasks when the terminal state of one subtask is kinematically infeasible for the next. We propose a motion planning-augmented hierarchical reinforcement learning architecture to resolve the fundamental trade-offs between sample efficiency and hand-off reliability in long-horizon mobile manipulation. The mission is decomposed into subtasks via a Semi-Markov Decision Process; within each subtask, a collision-free reference trajectory generated by RRT* in the full joint configuration space is embedded into the reward as a per-step shaping signal; and a region-goal mechanism, defined analytically from inverse kinematics feasibility, replaces rigid coordinate hand-offs with a continuous feasible region. The architecture is evaluated in the ManiSkill-HAB simulation under teleport-free sequential execution and challenging initialization. The proposed method improves subtask success rate and sample efficiency over the baseline across all six evaluated subtasks, and the advantage compounds along the long-horizon task chain. Full article

This study investigates the station planning problem of a mobile manipulator for robotic 3D concrete printing. The problem is formulated as a station planning problem considering two trajectory-level performance objectives: kinematic dexterity and structural stiffness. A directional dexterity metric based on the minimum normalized velocity directional manipulability along the task path is used to evaluate the worst-case motion capability of the manipulator during trajectory execution. A stiffness-related metric based on the maximum absolute Z-axis deformation of the end-effector is used to evaluate the worst-case deformation under operational loads. These two trajectory-level criteria are normalized and integrated through a weighted scalarization strategy, and a genetic algorithm is employed to search for station configurations under reachability constraints. Case studies on representative wall geometries show that the proposed method improves motion performance and reduces deformation compared with non-optimized station placements. The results indicate that the proposed framework provides an effective station planning strategy for mobile manipulators in trajectory-following robotic tasks. Full article

As robots and humans start to share common spaces and perform collaborative tasks, it has become critical to facilitate information exchange between them for communicating and interpreting each other’s intentions. By overlaying virtual objects on a view of the physical world, mixed reality (MR) technology offers a compelling approach for designing innovative models of human–robot interaction (HRI). For robot manipulators, mobile MR frameworks that allow a user to communicate a goal position for the robot’s end effector have been widely studied. However, HRI applications that may require other relevant information for the manipulator to complete more complex tasks remain unexplored. Thus, we propose an MR-enhanced HRI framework, deployed on a touchscreen tablet, that utilizes a virtual arrow object to communicate force intent (i.e., location, direction, and magnitude) to the manipulator and provide visual force feedback to the user. To evaluate the system performance and user experience, we conducted a user study with 25 participants who used a manipulator robot to complete four insertion subtasks, reporting a task success score of 96%, a usability overall mean score of 4.35 out of 5, and a low task load index of 21.49 out of 100. The results show that the MR-HRI framework is intuitive to operate, allowing users to successfully perform assigned tasks by effectively communicating their intentions through the virtual arrow. Full article

Protected horticulture moves fragile pots, plug trays, seedlings, harvested products, and carriers through narrow, humid, and crowded spaces. Transport robots must therefore integrate locomotion, perception, localization, handling, placement, scheduling, and human–robot interaction rather than operate as simple carts. This structured narrative review reorganizes evidence from seedling transplanting, nursery operations, harvest support, manipulation, perception, and autonomous navigation around the complete transport chain: target recognition, pickup, loading, loaded navigation, docking, unloading or placement, payload protection, and workflow feedback. The synthesis covers mobile platforms, payload support, perception and localization, motion control, gentle handling, digital support, and fleet coordination. Three barriers remain: short laboratory tests rarely provide season-long evidence; many prototypes are too specialized for variable workflows; and benchmarks seldom combine motion accuracy, handling reliability, payload quality, and resilience. Progress will require modular platforms, robust sensing, payload-safe control, standardized interfaces, and closer co-design between robotics and horticultural operations. Full article

In this work, we present a decentralized, event-driven control architecture for collaborative rigid object manipulation using omnidirectional wheeled mobile robots. Unlike fixed manipulators, mobile manipulation requires complex coordination between robots, making robustness and fault tolerance critical. Our framework is implemented in ROS2, in which each robot operates independently, with control, kinematic, and motor nodes that communicate via structured message passing. This decentralized design enhances fault tolerance, as individual component failures do not compromise the entire system. To enable perception, an ArUco-based vision system is employed to estimate robot and object poses, supporting the execution of three coordinated subtasks: approaching, grasping, and transporting. The proposed scheme is validated in a Gazebo simulation through different experiments, in which two robots successfully manipulate individual cubes or a beam. Results demonstrate that the proposed event-driven, decentralized control strategy enables consistent coordination, fault-tolerant operation under agent failures, and successful task execution in collaborative manipulation scenarios. Full article

This paper presents a Digital Twin (DT)-based framework for the control, monitoring, and intelligent optimization of an Assembly/Disassembly/Repair Mechatronic Production Line (A/D/R MPL), developed as a laboratory platform aligned with Industry/Education 4.0/5.0 paradigms. The A/D/R MPL is assisted by two complementary cyber–physical robotic systems: an Assembly/Disassembly/Replacement Cyber–Physical Robotic System (A/D/R CPRS), and a Mobile Cyber–Physical Robotic System (MCPRS), enabling both fixed and mobile intelligent operations. The CPRS is equipped with an industrial robotic manipulator (IRM) responsible for A/D/R tasks, while the A/D Mechatronic Line (A/D ML) consists of seven interconnected workstations (WS1–WS7) dedicated to storage, transport, quality control, and final product handling. MCPRS includes a wheeled mobile robot (WMR), carrying a robotic manipulator (RM) and Mobile Visual Servoing System (MVSS). Each workstation is connected to a local slave programmable logic controller (PLC), which communicates via PROFIBUS with a master PLC located at the CPRS level. Additional communication infrastructures include LAN PROFINET and LAN Ethernet for local integration, and WAN Ethernet connectivity enabled through open platform Communication-Unified Architecture (OPC-UA), ensuring interoperability, scalability, and remote accessibility. Also, MODBUS TCP as serial industrial communication is used between the master PLC and the MCPRS. Virtual environment supports task planning through Augmented Reality (AR) and real-time monitoring through Virtual Reality (VR). The system behaviour is modelled with synchronized hybrid Petri Nets (SHPNs) which describe the discrete and hybrid dynamics of A/D/R processes. Artificial intelligence (AI) techniques are integrated into the DT framework for optimal task scheduling and adaptive decision-making. As a laboratory-scale implementation, the proposed system provides a comprehensive platform for experimentation, validation, and education. It supports Education 4.0/5.0 objectives by facilitating hands-on learning, human–machine interaction, and the integration of emerging technologies such as AI, Digital Twins, AR/VR, and cyber–physical systems. At the same time, it embodies Industry 4.0/5.0 principles, including interoperability, decentralization, sustainability, robustness, and human-centric design. Full article

As human space missions become longer and more autonomous, robots are expected to assume broader responsibilities in inspection, maintenance, logistics, scientific support, and crew assistance. Among available robot forms, humanoid robotic astronauts are especially relevant because their anthropomorphic embodiment is compatible with human-centered habitats, tools, interfaces, and procedures. Their deployment in orbital and planetary environments, however, introduces challenges that differ from those of terrestrial humanoids, including floating-base dynamics, intermittent contact, whole-body coordination, constrained perception, and delayed supervision. This review contributes a mission-oriented and astronaut-centered synthesis of humanoid robotic astronauts, distinguishing itself from platform-by-platform or morphology-only surveys. It treats these systems as mission-compatible embodied agents whose feasibility depends on the coupling among mission context, morphology, contact behavior, perception, autonomy, and validation evidence. The primary goals are threefold: to classify representative platforms according to mission context, to synthesize the core technical foundations required for mission-compatible operation, and to identify cross-cutting deployment bottlenecks and benchmarking priorities for future development. Representative systems are organized into intravehicular assistance, extravehicular operations and on-orbit servicing, and surface exploration or transitional scenarios, showing how mission demands shape embodiment, mobility, manipulation, autonomy, and validation strategies. This review further summarizes recent progress in microgravity dynamics and contact mechanics, multimodal perception and scene understanding, whole-body motion planning and control, teleoperation and supervised autonomy, and evaluation and benchmarking methods. The analysis indicates that humanoid robotic astronauts are not simple extensions of terrestrial humanoids but astronaut-oriented embodied systems for mission-constrained environments. Three priorities are identified for future development: contact-rich whole-body intelligence under support transitions, delay-tolerant supervised autonomy with explicit authority handoff, and systematic benchmarking pipelines that connect simulation, ground analogs, short-duration microgravity tests, human-in-the-loop trials, and mission-context demonstrations. Full article

This article presents a modeling and cooperative kinematic control framework for heterogeneous mobile manipulators operating in a shared task space. The proposed approach integrates systems with different kinematic structures into a unified pose–shape representation, derived from individual and cooperative Jacobian models, enabling coordinated motion under a common formulation and extendable to multiple robots through a hierarchical architecture. The control strategy exploits system redundancy via null-space projection to incorporate secondary objectives without affecting the primary task. In particular, collision-free obstacle avoidance of the mobile bases and safe joint configuration of the robotic arms are achieved simultaneously while preserving formation tracking. The stability of the cooperative system is established using Lyapunov theory, ensuring asymptotic convergence of tracking errors. The proposed method is validated through numerical simulations in MATLAB under two representative scenarios, demonstrating its capability to handle heterogeneous configurations, maintain coordination, and execute safe and scalable cooperative behaviors. Full article

Robotics integration across manufacturing, healthcare, and hazardous environments demands robust performance evaluation. This study proposes a comprehensive Task–Environment–System–Metric (TESM) framework to link operational tasks and environmental constraints with quantifiable metrics. Based on TESM, a multi-level evaluation system is established, covering kinematic/dynamic performance, perception, human–robot interaction (HRI), reliability, and lifecycle economics. We systematically review key evaluation methodologies, including mechanistic modeling, digital twin simulation, physical testing, and multi-criteria decision-making (MCDM). Furthermore, typical engineering applications—ranging from industrial manipulators and mobile robots to collaborative and field systems are analyzed to demonstrate practical implementation. Despite significant progress, challenges persist regarding unified standards, testing fidelity, and the “black box” nature of data-driven assessments in safety-critical scenarios. This review concludes by identifying future research directions, such as establishing benchmark testing platforms, improving lifecycle assessment schemes, and developing modular evaluation tools. These advancements aim to ensure the scalable and reliable deployment of robotic systems in complex engineering environments. Full article

Mobile manipulators have become essential platforms for autonomous tasks that demand high-quality performance and efficient operational processes. This paper presents a complete grocery pick-and-pack system for a mobile manipulator, integrating a graphical user interface (GUI) with an end-to-end vision-based grasp detection pipeline designed for lightweight computation. The system is evaluated on the Grocery Pick-and-Pack Benchmark (Level-3), the most challenging level due to deformable objects, dimensional constraints, and strict grasp-point requirements. Experimental results demonstrate an average success rate of 92% across five item classes, with the deformable sweet bag the most challenging at 60% and an average execution time of 7.5 s on an edge device. The system achieves strong computational efficiency, reflected by a compute-to-speed ratio (CSR) of 0.008, with a total model size of only 30.9 MB. Performance is further validated across multiple hardware platforms and under real competition scenarios in the European Robotics League 2025. The findings highlight the practical impact of lightweight, vision-based mobile manipulation and provide insights into current challenges and future research directions for autonomous robotic applications. Full article

Accurate detection of cardboard boxes is essential to mobile manipulators to perform pick-and-place operations in warehouses. Conventional object detection methods like YOLOv11 struggle in low-texture and occluded environments. This paper presents YOLO-REFB, a novel object detection framework for real-time cardboard box detection in robotic manipulation using a dual-arm mobile robot (DAMR) operating in indoor warehouse environments. The proposed approach enhances the network by integrating the Rectangular Edge Fusion Block (REFB) into the YOLOv11 architecture; it focuses on learning the geometric and structural features of cardboard boxes. Enhanced edge information extraction and feature fusion improve training stability and localization accuracy. A custom dataset of 3501 annotated images, collected under varied conditions, was utilized. The images were randomly assigned to training and validation sets while keeping an 80:20 ratio. They were manually annotated and trained using Roboflow software, ensuring precise alignment of bounding boxes with cardboard box edges for accurate comparison with existing YOLO models. The model outperformed existing YOLO variants (YOLOv8n and YOLOv5n) in terms of precision (89.29%), recall (83.95%), and F1-score (86.54%). YOLO-REFB achieved improved localization metrics, including mean Average Precision (mAP)@0.5 (91.68%) and mAP@0.5:0.95 (68.61%). The inclusion of REFB was essential to performance gains, enabling effective detection of objects in challenging environments. Future developments may include 3D pose estimation and multi-object grasp planning for advanced robotic manipulation. Full article

In flexible manufacturing systems, the composite mobile manipulator (CMM) is subject to nonlinear inertial disturbances arising from the dynamic coupling between the mobile platform and the robotic arm. These disturbances significantly impair positioning precision during grasping tasks. This paper addresses the dynamic decoupling of multi-body nonlinear inertial disturbances within CMM systems. Departing from the conventional “stop-then-plan” serial execution paradigm, we propose a full-cycle spatiotemporally coupled trajectory optimization method. The operation cycle is bifurcated into two synergistic stages: “dynamic calibration” and “static execution.” The dynamic calibration trajectory is pre-planned and executed synchronously during platform movement to actively compensate for inertial-induced pose deviations. Concurrently, the static execution trajectory is optimized and then triggered immediately upon platform standstill, ensuring a seamless and precise transition to the “Grasping Pose”. It is worth noting that the temporal characteristic central to this framework lies in the concurrent execution of static trajectory optimization and platform transit: by the time the platform reaches its destination, the pre-planned trajectory is already available for immediate triggering, achieving zero task-switching wait time at the planning layer. The term “zero-latency” here does not imply a fixed-cycle real-time response at the control layer, but rather the complete elimination of decision latency afforded by the parallel planning architecture. This framework eliminates computational latency, markedly enhancing operational efficiency. Key innovations include two novel constraints. First, the Adaptive Task-space Bounded Search Constraint (ATBSC) framework restricts optimization to a geometry-inspired search region, thereby enhancing search efficiency and ensuring controllable deviations. Second, the Multi-Rigid-Body Coupling Constraint (MRBCC) system explicitly models inertial transmission across motion phases to suppress pose fluctuations. The proposed framework is developed and validated within an obstacle-free workspace. In simulation-based validation on a UR10 6 degree-of-freedom manipulator model, experimental results indicate that ATBSC increases valid solution density to 84.7% and reduces average deviation by 72.8%. Furthermore, under the tested conditions, MRBCC mitigates end-effector position errors by 79.7–81.0% with a 97.5% constraint satisfaction rate. The improved Cuckoo Search algorithm (ICSA), serving as the solver component of the proposed framework, achieves an 11.9% lower fitness value and a 13.1% faster convergence rate compared to the standard Cuckoo Search algorithm in the tested scenarios, suggesting its effectiveness as a reliable solver for the constrained multi-objective trajectory optimisation problem. Full article