Previous Article in Journal
Design of a Compact Ultra-Wideband Bio-Inspired Antenna Based on the Antennal Structure of Allomyrina dichotoma
Previous Article in Special Issue
A Bumblebee-Inspired Spatial Memory Navigation Framework for Robotic Odor Source Localization
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Hierarchical Whole-Body Control for Tendon-Cable-Driven Humanoids via Reference-Residual Policy and Offline-Learned Tendon Mapping

1
School of Optical-Electrical and Computer Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China
2
Institute of Machine Intelligence, University of Shanghai for Science and Technology, Shanghai 200093, China
3
Shanghai DroidUp Co., Ltd., Shanghai 200433, China
4
Department of Informatics, University of Hamburg, 20146 Hamburg, Germany
*
Author to whom correspondence should be addressed.
Biomimetics 2026, 11(9), 607; https://doi.org/10.3390/biomimetics11090607 (registering DOI)
Submission received: 1 July 2026 / Revised: 3 August 2026 / Accepted: 19 August 2026 / Published: 26 August 2026
(This article belongs to the Special Issue Bio-Inspired Robotics and Applications 2026)

Abstract

Tendon-cable transmission can reduce distal-limb inertia in full-size humanoids, but its elasticity, hysteresis, backlash, and multi-joint coupling introduce state-dependent joint-to-motor discrepancies. We present a hierarchical whole-body tracking framework for the 28-DoF Droid X3 that separates high-level motion learning from transmission compensation. A reference-residual policy is trained in simulation by single-stage proximal policy optimization (PPO) using a unified robot-space motion representation, globally anchored tracking rewards, hierarchical hard-example sampling, and tendon-oriented domain randomization. In simulation checkpoint evaluation, more than 90% of 12,674 tested reference motions are completed. Independently, a state-conditioned mapper is trained offline through a differentiable motor–joint forward model identified from physical motor-excitation data and connected in series between the frozen policy and the low-level motor controller. Randomized repeated Mapping-OFF/ON trials are conducted on two nominally identical Droid X3 units. Within every robot–motion block, the frozen PPO checkpoint, reference trajectory, controller settings, safety bounds, and frozen mapper weights are held fixed; complete trials are the statistical units. OFF converts desired joint positions with the robot-specific fixed static calibration, whereas ON feeds the complete policy-level desired-joint vector and measured plant state to the frozen mapper, which directly outputs the complete motor-position command. Across the complete physical trials, the aggregate action-completion rate is 68% with Mapping OFF and 79% with Mapping ON, an increase of 11 percentage points. Representative walk, squat, and dance trajectories illustrate lower tracking errors under Mapping ON, while individual frames and selected temporal fragments are used only for visualization.

Graphical Abstract

1. Introduction

Humanoid robots can operate in human-built environments without requiring infrastructure designed for specialized machines. Tendon-cable-driven architectures additionally place part of the actuation away from the limb extremities and introduce compliant transmission. In this paper, “lightweight” is used only in a platform-specific sense: Droid X3 has a total mass of approximately 28 kg, and its remote-transmission layout is intended to reduce distal-limb mass and inertia. No controlled mass or segment-inertia comparison is reported, and compliance is not treated as evidence of certified contact safety. Cable elasticity, pulley friction, backlash, hysteresis, and multi-joint coupling make the actuator-to-joint relation state-dependent and nonlinear. Combined with an underactuated floating base and intermittent foot contact, these effects complicate accurate whole-body tracking.
Reference-motion tracking has become a central paradigm for humanoid control. Here, it denotes a feedback policy conditioned on a time-indexed target trajectory and trained to reduce errors in joint configuration, body-link pose, velocity, and global-anchor state, while preserving balance and feasible contacts. It is distinct from open-loop joint playback, unconditional motion generation, motion planning, and upstream human-pose estimation. DeepMimic [1] and subsequent studies [2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23] extend this formulation to large motion libraries, teleoperation interfaces, and heterogeneous motion sources.
The literature nevertheless leaves several gaps that are especially relevant to the platform studied here. Some teleoperation systems separate upper- and lower-body objectives or introduce specialized modules to preserve stability [9,10,11]; long-horizon systems explicitly introduce localization feedback because open-loop tracking can accumulate position and heading drift [20,21]. Multi-source motion studies further show that skeleton definition, retargeting quality, sampling rate, and source-specific noise affect tracking feasibility and generalization [15,16,22]. Finally, most general motion trackers are evaluated on rigidly actuated humanoids, whereas full-size tendon-cable transmission introduces state-dependent actuator-to-joint errors that are not represented by an ideal independent-joint interface. Our scope is this last transmission-aware tracking problem; we do not claim to establish outdoor navigation, standardized human-contact safety, or general human–robot interaction performance.
This paper focuses on the Droid X3 experimental unit, a full-size tendon-cable-driven bipedal humanoid developed by Shanghai DroidUp Co., Ltd. [24]. Its remote-transmission layout is intended to reduce distal-limb inertia, but this mechanical motivation is not treated as a measured safety result. The mapping between joint-side motion and actuator-side output is nonlinear and affected by cable elastic deformation, friction, backlash, hysteresis, tension variation, and parameter drift; multi-joint tendon coupling may further cause one actuation chain to influence several joints, or several chains to jointly determine one joint’s response. For a bipedal system, these transmission uncertainties interact with the underactuated floating base, foot–ground contact switching, and whole-body center-of-mass regulation, making accurate joint-space execution difficult.
We therefore propose a hierarchical reference-residual tracking framework for Droid X3. The high-level actor receives proprioceptive history and a unified reference command and produces a bounded residual around the reference joint target. It is optimized directly by single-stage PPO without a subsequent teacher–student distillation stage. A separate state-conditioned mapper is trained offline from physical motor–joint excitation data. At deployment, the frozen mapper uses the desired joint position and measured joint/motor state to output a bounded motor-position command. The robot’s original fixed static calibration is retained as the Mapping-OFF baseline. This serial design preserves a joint-space policy interface while isolating transmission compensation from high-level motion learning.
The main contributions of this paper are as follows:
  • A transmission-aware hierarchical control architecture. A simulation-trained reference-residual policy and an independently trained state-conditioned mapper are connected in series at deployment. The mapper converts desired joint positions and the measured plant state into motor-position commands, while the original fixed static calibration is retained as the Mapping-OFF baseline.
  • A globally anchored, multi-source, single-stage training pipeline. Heterogeneous motions are retargeted to a common robot-space representation. Global-anchor rewards, motion- and segment-level adaptive sampling, and tendon-oriented domain randomization are integrated into one PPO stage that directly produces the deployable actor.
  • Randomized repeated physical validation. Mapping OFF and ON are evaluated in randomized repeated trials on two nominally identical Droid X3 units. Within each robot–motion block, the frozen PPO checkpoint, reference motion, controller settings, safety bounds, and frozen mapper weights are held fixed; complete trials are used as the statistical units. Walk, squat, and dance provide multiple motion conditions, while the two separately assembled cable transmissions provide a cross-unit hardware check. The aggregate complete-trial action-completion rates are 68% for Mapping OFF and 79% for Mapping ON.

2. Related Work

2.1. Humanoid Motion Tracking

Reference-conditioned imitation and reinforcement learning provide a scalable route to humanoid whole-body control. Early studies reproduced dynamic human motions with dense pose rewards or adversarial motion priors [1,25]. More recent trackers include joint, link, root-velocity, and contact objectives and extend training from individual skills to large motion libraries or multiple embodiments [2,4,6,17,18].
These methods generally expose an idealized joint-space interface to the policy. Tendon-cable transmission weakens this assumption because elasticity, friction, backlash, hysteresis, calibration error, and coupling make the motor-to-joint response state dependent. On a full-size biped, transmission error also interacts with contact transitions and whole-body balance.
Our architecture retains a joint-space reference-residual policy but introduces a separately trained state-conditioned joint-to-motor mapper at the hardware interface. The encoder bias, response delay, equivalent stiffness/damping, and mapping residual are randomized during policy training; the physical mapper itself is trained offline and is absent from the simulation loop.

2.2. Multi-Source Motion Data and Global Consistency

Large motion libraries provide broad behavioral priors, but source-dependent skeletons, coordinate frames, sampling rates, and noise affect feasibility after retargeting. Recent work uses multi-source motion banks, video-derived interaction data, imperfect motion fragments, and diagnostic benchmarks to increase coverage and expose failure modes [13,15,21,22,23]. These findings motivate explicit robot-space normalization and data-quality filtering.
Long-horizon tracking further requires global spatial consistency. Studies of humanoid teleoperation and closed-loop tracking address retargeting, expert selection, localization feedback, and cumulative drift caused by gait error and contact disturbance [10,11,19,20,21].
We map all sources to a common Droid X3 representation containing joint states and key-link kinematics. A torso anchor constrains global position, orientation, and velocity, while anchor-relative link terms preserve whole-body geometry. The experiments evaluate stored reference sequences and physical execution; streaming teleoperation and external localization remain interface extensions rather than validated contributions.

2.3. Sim-to-Real Transfer via Domain Randomization

Large heterogeneous libraries exhibit long-tailed categories and nonuniform segment difficulty, while deployment introduces a separate simulation-to-reality gap. Prior work addresses these issues through adaptive sampling, closed-loop fine-tuning, data augmentation, and robust simulation design [13,18,22,23].
Domain randomization commonly perturbs mass, friction, inertia, and joint damping. For tendon-driven systems, the encoder bias, response delay, equivalent stiffness/damping, and mapping residual provide additional approximations to the calibration error, compliant lag, tension-dependent response, and coupling.
We combine motion-level failure and novelty sampling with segment-level hard-example sampling in a single PPO stage. Tendon-oriented perturbations are applied only to the simulated low-level response. The physical mapper is instead fitted from dedicated motor-excitation recordings and connected to the frozen policy at deployment.

2.4. Tendon-Cable Actuation

Compliant and indirect actuation has been studied in contact control, low-latency teleoperation, and safety-critical whole-body control [26,27,28], but explicit motor-to-joint mapping remains less developed for full-size tendon-cable-driven motion tracking. Configuration and transmission-state sensing provide a complementary perspective. Mao et al. [29], for example, study whole-body motion control for a six-bar tensegrity robot equipped with 24 flexible sensors; their framework also reconstructs robot shape and applies multimodal models to state recognition and fault diagnosis. Although related through flexible-cable state perception, configuration reconstruction, health monitoring, and whole-structure control, their substantially different robot morphology, sensing arrangement, and task formulation preclude treating the system as a directly comparable whole-body-control baseline for the present humanoid. Their sensing and diagnostic perspective motivates richer tendon-state sensing, online anomaly detection, and health monitoring as future extensions of the present framework.
Tendon-cable transmission combines remote actuation with compliant coupling, but the resulting elasticity, friction, backlash, hysteresis, tension drift, and multi-joint interaction violate independent-joint assumptions. Existing motion trackers typically address hardware mismatch through coarse randomization—for example, armature terms for reducer inertia in GMT [4] or velocity-dependent odometry noise in CLONE [11]—rather than an identified state-conditioned transmission map. This paper targets that interface on a full-size tendon-cable-driven biped.

3. Platform and Problem Formulation

3.1. The Droid X3 Platform

Droid X3 is a full-size humanoid engineering prototype developed by Shanghai DroidUp Co., Ltd. [24]. The experimental unit is approximately 1.68 m tall, has a measured mass of approximately 28 kg, and comprises a floating base and 28 actuated body joints distributed across the legs, waist, and upper limbs. Its actuated joints use chain–cable transmission.
The remote-transmission layout is intended to reduce distal-limb mass and inertia relative to joint-mounted actuation. Here, however, “lightweight” refers only to the measured total mass and this design intent; no segment-inertia comparison is reported. Similarly, compliance is a mechanical property rather than evidence of certified contact safety. The control-relevant consequence is that the same joint target can produce different responses under different transmission states, motion histories, and contact loads.

3.2. System Overview

The system comprises a robot-space motion library, a reference-residual policy, a state-conditioned joint-to-motor mapper, a fixed static-calibration baseline, and the physical low-level controller. At 50 Hz, the policy combines the current reference with proprioceptive history to produce a bounded residual joint target. During Mapping ON, the mapper converts this desired joint target and the measured plant state directly into a motor-position command. During Mapping OFF, the original fixed static calibration provides the motor-position command instead. The policy is trained in parallel MuJoCo simulations [30]; the mapper is fitted independently from physical motor-excitation trajectories.
This separation retains a common joint-space policy interface while localizing hardware-specific compensation to the mapper.
The closed-loop control pipeline operates at 50 Hz and proceeds in four stages per control step t. First, a reference command generator G queries the reference-motion sequence M at the current phase, conditioned on the robot state x t , to produce a time-aligned motion command:
g t = G ( M , t , x t ) = q t r e f , q ˙ t r e f , p t , B r e f , R t , B r e f , v t , B r e f , ω t , B r e f ,
where g t aggregates the reference joint pose/velocity and the pose/velocity of the tracked body-link set B, serving as the high-level motion prior. Second, the reference-residual policy π θ maps a length-H proprioceptive history o t H : t p , the command g t , and the previous action a t 1 to a residual action:
a t π θ a t o t H : t p , g t , a t 1 , a t R n j ,
where π θ is a Gaussian policy and n j is the number of actuated joints. Third, the residual is scaled by the per-joint range S and added to the reference joint target, then clipped to the soft joint limits to form the upper-layer desired joint target:
q t d e s = clip q t r e f + S a t , q m i n s o f t , q m a x s o f t ,
where the reference prior q t r e f defines the nominal motion and S bounds the residual amplitude. Fourth, during physical Mapping ON, the independently trained mapper converts the desired joint target and current plant state into a motor-position command:
x t p l a n t = q t K : t e n c , p t K : t m , p ˙ t K : t m , i t K : t m ,
p t m , m a p = M ϕ ( q t d e s , x t p l a n t ) ,
p t , r , ON m , c m d = clip p t m , m a p , p m i n m , p m a x m .
Here, q e n c denotes the measured joint position, while p m , p ˙ m , and i m are the measured motor position, motor velocity, and motor current. The mapper output p t m , m a p has motor-position units. Mapping OFF replaces this learned conversion with the robot’s fixed static calibration C r q t d e s + b r . The mapper is absent during nominal rigid-joint PPO training, where q t d e s is applied directly as a simulated joint target; it is inserted only on the physical robot after PPO, the differentiable forward model, and the mapper have been trained and frozen. The measured hardware evidence comprises randomized repeated Mapping-OFF/ON trials on Robot 1 and Robot 2, as detailed in Section 5.3.

4. Method

The high-level controller uses an asymmetric actor–critic: the actor receives deployable observations, whereas the critic additionally uses a privileged simulation state during PPO training and is discarded afterward. Physical excitation data first identify a differentiable motor–joint forward model; the tendon mapper is then trained separately through the frozen forward model and receives no PPO gradient. Figure 1 retains the original three-phase framework layout; the caption clarifies the separation between PPO training and offline mapper fitting.

4.1. Reference Motion Representation

Raw motions from open-source human MoCap, motion video, retargeted robot trajectories, and small-scale self-collected data are converted to the Droid X3 configuration by retargeting, forward kinematics, temporal resampling, and feasibility filtering. The public-source collection process included AMASS [31] and other open motion resources, but the final storage-group names do not retain a complete clip-level mapping to every upstream source. Exact reproduction of the processed library additionally requires clip identifiers, preprocessing parameters, and the historical split manifest; the recoverable archive statistics and remaining provenance limitations are reported in Section 5.1.
For a motion sequence of length T, the reference motion is represented as
M = { m t } t = 1 T , m t = { q t r e f , q ˙ t r e f , p t , B r e f , R t , B r e f , v t , B r e f , ω t , B r e f } .
Here, q t r e f and q ˙ t r e f denote the robot joint position and velocity references; p t , B r e f and R t , B r e f denote the world-frame position and orientation of the key body-link set B; and v t , B r e f and ω t , B r e f denote the corresponding linear and angular velocities.
The tracked links comprise the pelvis, bilateral thigh, shank, and foot links, the torso, and bilateral upper-arm, forearm, and wrist links. Combining joint and link targets constrains both local articulation and whole-body geometry, avoiding the under-constrained behavior of sparse end-point tracking.
To accommodate global-coordinate differences across data sources, training uses an anchor-aligned reference transform. Let the robot’s current anchor position and yaw be ( p t , A , ψ t , A ) and the reference anchor be ( p t , A r e f , ψ t , A r e f ) . For any body link b B , the reference link pose is re-expressed relative to the current anchor through a yaw alignment:
yaw offset : Δ ψ t = ψ t , A ψ t , A r e f ,
horizontal offset : Δ p t , A x y = p t , A , x p t , A , x r e f p t , A , y p t , A , y r e f 0 ,
aligned position : p ^ t , b r e f = p t , A r e f + Δ p t , A x y + R z ( Δ ψ t ) p t , b r e f p t , A r e f ,
aligned orientation : R ^ t , b r e f = R z ( Δ ψ t ) R t , b r e f ,
where R z denotes the yaw rotation about the world vertical axis. The translation term contains no vertical component; consequently, and the reference anchor is aligned to the current horizontal position, while its recorded height is preserved. This transform is used for anchor-relative link rewards. The global-anchor reward is evaluated against the unaligned reference anchor, so horizontal position and yaw errors are not removed from the global objective.

4.2. Observations, Policy, and Residual Action

We formulate whole-body motion tracking as a reference-conditioned Markov decision process:
M = 𝒮 , 𝒜 , 𝒫 , , γ .
The policy observation consists of proprioceptive history, the reference-motion command, and the previous action:
o t = [ o t H : t p , g t , a t 1 ] , a t π θ ( a t o t ) .
The current implementation uses a 5-frame history. The actor observation contains projected gravity, IMU angular velocity, joint positions relative to the default pose, joint velocities, the previous action, reference joint position and velocity, reference base linear and angular velocity, the gravity direction under the reference pose, and the height of both feet relative to the base. Expanding the reference-command shorthand g t , the deployment observation is
o t a c t o r = [ q t r e f , q ˙ t r e f , v A r e f , ω A r e f , g A r e f , h f e e t r e f , g t p r o j , ω t i m u , q t q 0 , q ˙ t , a t 1 ] t H : t .
The command includes velocity and foot-height cues in addition to pose, allowing the actor to infer motion phase and contact transitions. The history window provides short-term temporal context for sensing and execution lag.
The critic uses asymmetric observations, accessing more complete simulation-privileged information only during training. Beyond the actor observation, the critic can access noiseless anchor position error, anchor orientation error, body-link position/orientation, base linear velocity, reference base height, and key body-link states:
o t c r i t i c = [ o t a c t o r ( n o i s e l e s s ) , e A p , e A R , p t , B , R t , B , v b a s e , h A r e f , p ^ t , B r e f , R ^ t , B r e f ] .
This design reduces the variance of value-function estimation during training while ensuring that the final deployed actor does not depend on simulation-privileged states.
We parameterize the action as “reference-sequence target plus network residual” rather than as raw joint torque or a fully free instantaneous command. For the tendon-cable-driven Droid X3, accurate torque inversion is difficult and susceptible to tension drift and backlash, while a fully free position command enlarges exploration and tends to produce high-frequency, non-smooth output.
The two learned components act at different interfaces. The policy residual refines a joint-space reference; downstream, the mapper converts the desired joint target and measured transmission state into the motor-position command. The fixed static calibration is retained as the Mapping-OFF baseline. The actor and mapper are trained separately and connected in series only at deployment.
The policy outputs a residual action a t , and the nominal joint target follows Equation (3): the reference joint target q t r e f provides the main motion trend, while the scaled residual S a t locally corrects current pose deviation, contact-state change, and retargeting error before clipping to the soft joint limits, forming the policy-level desired target q t d e s . In simulation, q t d e s is directly executed by the joint-level PD controller. On the physical robot, the offline-trained mapper converts q t d e s and the current plant state into a motor-position command before clipping, as defined in Equations (17)–(19). Thus, S limits the policy’s joint-space correction, whereas M ϕ handles the subsequent joint-to-motor conversion under the tendon-transmission state.
The action scale S defines a conservative residual envelope. It is derived from actuator limits so that S a t remains within the admissible deviation from q t r e f under the joint-level position servo. For each joint group j,
S j = κ j τ j limit k j ,
where τ j limit is the maximum continuous torque, k j the position-servo proportional gain, and κ j a conservative factor selected for the motor–tendon assembly. Under the quasi-static approximation τ k j Δ q , the constraint k j S j κ j τ j limit bounds the torque induced by the residual offset.
Because the legs, waist, shoulders, forearms, and wrists differ in stiffness and torque rating, each joint group uses a separate S j . This hardware-dependent scaling is more informative than a single global residual amplitude. The archived experiment record does not retain the group-wise numerical values of S j , κ j , τ j limit , and k j ; Equation (16) therefore documents the scale construction rather than a complete reproducible numerical configuration.

4.3. Tendon Mapping Network

For physical deployment, M ϕ is a state-conditioned mapper that directly outputs a motor-position command. Its input comprises q t d e s and a K-step history of measured joint position, motor position, motor velocity, and motor current:
x t p l a n t = q t K : t e n c , p t K : t m , p ˙ t K : t m , i t K : t m ,
p t m , m a p = M ϕ ( q t d e s , x t p l a n t ) ,
p t , r , ON m , c m d = clip p t m , m a p , p m i n m , p m a x m .
Joint history describes the execution error and motion direction, motor position and velocity describe the actuator-side state, and current provides a load-related proxy. The input q t d e s is the complete desired-joint vector produced by the policy interface, including the reference target and policy residual defined in Equation (3). The mapper output p t m , m a p is the complete motor-position command, not an additive correction to the static calibration, and is sent to the low-level motor controller after command clipping.
For the Mapping-OFF baseline, the mapper conversion is disabled and the original robot-specific static calibration is used:
p t , r , OFF m , c m d = clip C r q t d e s + b r , p m i n m , p m a x m ,
where C r and b r are the fixed joint-to-motor calibration matrix and offset for unit r. In the retained Robot 1 comparison, OFF and ON therefore differ in the joint-to-motor conversion module while retaining the same frozen high-level PPO checkpoint and controller settings.
The mapper is trained offline from dedicated system-identification trajectories collected on the physical robot. For each motor in a coupled chain, multiple groups of bounded sinusoidal/cosinusoidal position commands are executed:
p t , k , m , c m d = p ¯ k , + A k , sin ( 2 π t / T k , ) + B k , cos ( 2 π t / T k , ) ,
where k denotes the excited motor and indexes the excitation group. Across groups, the center position p ¯ k , , period T k , , and sine/cosine amplitudes A k , and B k , are varied within joint-specific safety limits. Varying the center and amplitudes changes the swept position interval, while varying the period changes the excitation speed; the resulting trajectory set therefore samples different positions, motion directions, and velocity levels within the safe operating range. During every real-robot trajectory, commanded and measured motor positions, motor velocity, motor current, and the encoder positions of all affected joints are acquired synchronously at the control rate. Exciting one motor while observing the complete coupled chain exposes both one-to-many and many-to-one transmission effects. Complete trajectories, rather than adjacent frames, form the intended partition unit so that phase, hysteresis, and motion direction remain intact. The archived record does not retain the historical training/validation/test counts, so no retrospective split is reported.
The synchronized trajectories form offline tuples D = { x t p l a n t , p t m , c m d , q t + 1 e n c } t = 1 N . They are first used to identify a differentiable forward motor–joint model F ψ :
q ^ t + 1 e n c = F ψ ( x t p l a n t , p t m , c m d ) ,
L i d = 1 N t = 1 N q ^ t + 1 e n c q t + 1 e n c 2 2 .
After identification, F ψ is frozen. The mapper remains separate from PPO and is optimized through this differentiable forward model:
p ^ t m , c m d = clip M ϕ ( q t + 1 d e s , x t p l a n t ) , p min m , p max m ,
q ^ t + 1 m a p = F ψ ( x t p l a n t , p ^ t m , c m d ) ,
L m a p = 1 N t = 1 N q ^ t + 1 m a p q t + 1 d e s 2 2 .
Because q ^ t + 1 m a p depends on M ϕ through the frozen differentiable model F ψ , the joint-space error is differentiable with respect to the mapper parameters. The forward model is used only during offline fitting. Deployment uses the frozen mapper for Mapping ON and the fixed static calibration for Mapping OFF. The current archive does not retain the network architecture, optimizer, split counts, or held-out identification errors for F ψ and M ϕ , so these quantities are not retrospectively specified.
This design preserves a unified joint-space policy while separating the learned state-conditioned joint-to-motor conversion from the static Mapping-OFF baseline. The mapper can address only states represented by its identification data; generalization to long-term wear, temperature drift, and unseen tension states is not established.

4.4. Reward Design and Termination

The reward combines global consistency, whole-body coordination, contact tracking, and command regularization. Tracking terms use the bounded kernel K ( e , σ ) = exp ( e 2 2 / σ 2 ) , whereas penalty terms discourage abrupt action changes, joint-limit violations, and self-collision. These training constraints do not replace hardware-fault detection or emergency stopping.
The torso frame serves as the global anchor. Its position, orientation, and velocity constrain global motion, while averages over 14 tracked links constrain anchor-relative body geometry and velocity. Foot and base terms reinforce contact-relevant tracking. Table 1 lists the complete weighted objective.
An episode terminates at the end of the reference, at timeout, or when the anchor height, anchor orientation, or key-end-effector height exceeds a prescribed deviation. Failure terminations are fed to the adaptive sampler to increase the probability of the associated motion and temporal segment.

4.5. Adaptive Sampling and Domain Randomization

Reference libraries are typically imbalanced in category frequency, clip length, difficulty, and source quality. Uniformly sampling such a library can overexpose easy locomotion, whereas emphasizing the hardest segments too early can destabilize PPO updates.
The loader packages joint and link kinematics into contiguous tensors and supports CPU/GPU preloading, cross-GPU sharding, and optional motion-group partitioning. The archived runs use cross-GPU sharding but do not specify motion groups or group-level ratios; group balancing is therefore an available interface rather than a reported active factor.
Motion-level sampling mixes uniform coverage, failure-based difficulty, and novelty. For motion i, the capped failure score D i , novelty score N i , and uniform score U i are
f i = n i f a i l max ( n i s a m p l e , 1 ) , D i = Norm ( min ( f i , β c a p ) ) ,
N i = Norm 1 n i a s s i g n e d + 1 , U i = 1 N .
A warmup-and-ramp factor ρ ( t ) schedules the nonuniform weights:
w f ( t ) = ρ ( t ) w f t a r g e t , w n ( t ) = ρ ( t ) w n t a r g e t , w u ( t ) = 1 w f ( t ) w n ( t ) .
The final motion-level sampling probability is
p i = Norm w u ( t ) U i + w f ( t ) D i + w n ( t ) N i .
When the library is partitioned into motion groups by source or category, group-level probabilities can be applied:
P ( i ) = P ( group ( i ) ) P ( i group ( i ) ) .
Within each motion, temporal bins maintain failure and tracking-error statistics. An exponential moving average and an optional smoothing kernel define the segment probabilities:
F i , b α C i , b + ( 1 α ) F i , b ,
F ˜ i , b = SmoothKernel ( F i , b ; λ , k ) , p i , b = Norm F ˜ i , b + ϵ / B i .
Here, F i , b is the difficulty estimate for bin b of motion i, C i , b is its current failure or error signal, and B i is the number of bins. The archived configuration uses α = 0.001 , λ = 0.8 , a uniform mixture of 0.1 , target failure and novelty weights of 0.5 and 0.3 , β c a p = 2.0 , a 100 s warmup, and a 300 s cosine ramp. Its kernel size is k = 1 , so SmoothKernel reduces to the identity and does not spread probability to neighboring bins in the reported runs.
The resulting hierarchy separates library coverage from within-motion difficulty: motion probabilities preserve nonzero coverage, segment probabilities focus on difficult intervals, and the schedule limits early overconcentration. Section 5.5 reports the available archived training diagnostics; because the retained runs use different motion archives, they are not treated as a controlled isolation of individual sampling terms.
Domain randomization. The randomized parameter vector ξ P ( ξ ) perturbs the reference, robot body, contact, observations, and equivalent tendon execution, giving x t + 1 = f ξ ( x t , u t , c t ) . Tendon execution is approximated through response delay, stiffness/damping scaling, and mapping residual; the physical learned mapper is not evaluated in simulation. Table 2 lists the recorded ranges.
At reset, reference pose and joint targets are perturbed and clipped to the soft limits. External velocity disturbances, torso center-of-mass offsets, encoder bias, and foot-friction changes broaden the simulated operating range. Tendon-execution perturbations expose the policy to low-level response mismatch without asserting direct coverage of measured physical tension states.

4.6. Single-Stage Training and Deployment

We train a deployable actor directly with single-stage proximal policy optimization (PPO) [32]. PPO is an on-policy actor–critic algorithm that updates the policy using a clipped probability-ratio objective, limiting the size of each update relative to the data-collecting policy. “Single stage” refers specifically to optimization of the high-level reference-residual actor and critic in the simulation without a subsequent teacher-to-student distillation stage. The tendon mapping network is not part of the PPO computation graph: it is trained independently and offline from real-robot trajectory recordings after policy training, and is subsequently connected in series between the frozen policy output and the robot-side low-level controller during deployment.
We optimize the policy with PPO using a clipped surrogate objective, where the advantage A ^ t is computed by generalized advantage estimation (GAE) [33]. With actor parameters θ and critic parameters η , the combined objective is maximized:
J ( θ , η ) = E t [ min ρ t ( θ ) A ^ t , clip ( ρ t ( θ ) , 1 ϵ , 1 + ϵ ) A ^ t c v V η ( s t ) R ^ t 2 + c h H π θ ( · o t ) ] ,
where the probability ratio, GAE advantage, and temporal-difference residual are
ρ t ( θ ) = π θ ( a t o t ) π θ old ( a t o t ) , A ^ t = l = 0 T t 1 ( γ λ ) l δ t + l , δ t = r t + γ V η ( s t + 1 ) V η ( s t ) .
where ρ t ( θ ) is the probability ratio between the current and previous policies, ϵ the clipping range, A ^ t the GAE advantage with TD residual δ t , and γ and λ the discount and GAE factors; H [ · ] is the policy-entropy bonus, and c v and c h weight the value loss and entropy regularization. The critic is trained on asymmetric privileged observations to reduce value-estimation variance, while the actor consumes only proprioceptive history and reference commands available at deployment.
The actor and critic are both multilayer perceptrons with hidden sizes of 1024, 1024, 512, and 256, ELU activations, and running observation normalization; the action distribution is Gaussian with an initial standard deviation of 1.0 . Training runs 8192 parallel environments in MuJoCo with a rollout length of 24 steps and up to 3 × 10 5 iterations. The physics step is 0.005 s with a control decimation of 4, yielding a 50 Hz policy command-update rate. The serial actor–mapper path has been run in the physical closed loop on the RK3588, while separate offline inference was checked on the RTX 4090. Per-module mean/tail latency, jitter, resident/peak memory, and deadline-miss rate are not numerically reported. The key hyperparameters are summarized in Table 3.
Unlike frameworks that first train a privileged teacher and then distill a deployable student [4,5], our implementation directly optimizes the deployable actor. The reference-sequence target supplies a motion prior, hierarchical adaptive sampling concentrates updates on hard motions and failure segments, and domain randomization introduces robustness perturbations during the same actor–critic optimization stage. This is an architectural and workflow distinction only: without a teacher–student implementation matched for observations, architecture, training samples, and tuning budget, the present paper does not claim a quantitative performance advantage over distillation.
Deployment interface and evaluated scope. The reported experiments replay complete robot-space reference sequences spanning locomotion, bending, dance, and coordinated upper-limb motion. Tracking failures update the data-quality and adaptive-sampling statistics. A future streaming or task-level front end could use the same command representation, but this interface compatibility is not an end-to-end validation.
No streaming teleoperation, input-delay/jitter, packet-loss, missing-pose, operator-workload, or usability experiment is reported.
External localization and world-frame drift correction are also outside the evaluated system; the anchor reward alone is not evidence of localization-based drift rejection.

5. Experiments

This section reports the qualitative multi-category tracking evidence, physical multi-robot mapper records, the implemented policy design, and archived adaptive-sampling diagnostics. Numerical entries that could not be traced to an archived experimental record have been removed rather than reconstructed.

5.1. Experimental Setup

Platform and simulation. Policies are trained in parallel MuJoCo/MjLab environments with a 0.005 s physics step and a control decimation of four, yielding a 50 Hz command rate. Table 3 lists the PPO configuration. Physical trials use the Droid X3 platform described in Section 3.1; all reported physical records were collected indoors on a level laboratory floor.
Dataset audit and split provenance. Table 4 reports the recoverable composition of the processed archive: 94,359 source sequences and 39,482,115 non-overlapping frames at 50 Hz (219.345 h). Sequences are packaged into 127,091 overlapping windows of at most 512 frames using a regular stride of 448 frames and an endpoint-aligned final window. The windows contain 46,135,401 frames in total, but this repeated-frame count is not interpreted as independent data duration. Public subsets can be regenerated from their cited sources, whereas Pico-record and small self-collected subsets require the corresponding local recordings. The robot-space library is produced by retargeting, temporal resampling, conditional feasibility screening, and windowing. The screening conditions comprise a prescribed robot-height envelope, finite-difference joint-acceleration checks, and robot joint-limit checks. The exact numerical thresholds, historical source-level split manifest, clip identifiers, mapper trajectory-level split manifest, and preprocessing-script revision associated with the reported frozen checkpoint were not retained. The processing stages can therefore be reimplemented for available source data, but neither the complete historical library nor the checkpoint’s training assignment can be reconstructed exactly from the public sources alone. Consequently, the existing checkpoint is not presented as a same-source-unseen or cross-source benchmark.
The archived evaluation categories include walking/turning, deep squat/bend, high-leg/kick, dance/martial arts, large upper-limb motion, coordinated arm–leg motion, and long sequences. Simulation evaluation of the trained frozen checkpoint over 12,674 tested reference motions achieved an aggregate action-completion rate above 90%. This is a descriptive checkpoint-level result over the tested collection. Because the historical source-level assignment manifest was not retained, it is not interpreted as a source-disjoint or cross-source generalization statistic.
Evaluation metrics. The tracking metrics used are mean deviations from the reference: torso-anchor position and yaw errors ( E a n c h o r p o s , E a n c h o r y a w ), anchor-relative link-position error E b o d y p o s , link-velocity error E v e l , and joint error E j o i n t . The action rate is E a c t i o n = T 1 t a t a t 1 2 2 . A rollout succeeds if it completes the reference without a failure termination. Physical trials additionally report per-joint position MAE and torso-orientation error, as defined in Section 5.3.
Experimental protocol. Category-level tracking uses complete references from the archived evaluator. Because the original per-category and per-ablation rollout manifests were not retained, no reconstructed numerical category or policy-ablation results are reported. The adaptive-sampling subsection compares three archived training records that use different motion archives and therefore reports training diagnostics rather than a controlled one-factor ablation. Independent-seed metadata for the archived simulation runs are unavailable, so no simulation-side inferential statistics are reported. The verified aggregate action-completion rate above 90% over 12,674 tested reference motions is retained as a descriptive result of frozen-checkpoint evaluation, without a cross-source or significance claim. The physical protocol uses the same frozen PPO checkpoint, reference motions, controller settings, safety bounds, and frozen mapper weights on two nominally identical Droid X3 units. Within each robot–motion block, complete Mapping-OFF/ON trials are repeated and their order is randomized; a complete trial, rather than an individual 50 Hz frame or a displayed temporal segment, is the statistical unit. OFF uses the fixed conversion in Equation (20), whereas ON uses the learned conversion in Equation (19). The figures below show randomly selected temporal segments for time-resolved visualization and are not used as independent replicates.
Closed-loop timing scope. The actor–mapper command path is configured to execute serially on the on-robot RK3588 at a 50 Hz control rate (20 ms period). The retained reference, command, and feedback logs are also sampled at 50 Hz and therefore cannot resolve within-cycle inference, communication latency, or jitter. The configured control rate is reported as an implementation setting, not as a worst-case deadline guarantee; sub-cycle latency, memory, and deadline-miss distributions were not measured.

5.2. Complex Whole-Body Motion Tracking

The archived evaluator contains complete references spanning walking and turning, deep squat and bending, high-leg and kicking motions, dance and martial-arts motions, large upper-limb excursions, coordinated arm–leg motion, and long sequences. The original per-category rollout manifest is not available. In simulation checkpoint evaluation over 12,674 tested reference motions, the trained frozen checkpoint achieves an aggregate action-completion rate above 90%, where completion requires reaching the end of the reference without a failure termination. We report this aggregate descriptive result and the evaluated motion scope, but do not infer source-wise generalization or statistical significance. We therefore retain qualitative physical poses, but do not retain the earlier difficulty-scaled numerical category table or infer category ordering from reconstructed values. Figure 2 provides representative physical poses.
The robot also completed a sequential batch of heterogeneous references without losing tracking before the final motion. This is an operational-continuity observation for that session, not a standardized endurance result; uninterrupted duration, interventions, thermal evolution, and pre/post-transmission error were not recorded.

5.3. Tendon Mapping Validation and Transmission Characterization

Randomized repeated Mapping-OFF/ON trials are conducted on Robot 1 and Robot 2 using multiple types of physical reference trajectories. The two units have the same dimensions, link geometry, 28-DoF configuration, and tendon-cable layout, but their cable transmissions are assembled independently. Within each robot–motion block, the frozen high-level PPO checkpoint, reference motion, controller settings, safety bounds, and frozen mapper weights are held fixed, and the OFF/ON order is randomized. OFF uses the unit-specific fixed conversion C r q t d e s + b r , whereas ON feeds the complete policy-level desired-joint vector q t d e s and measured plant state to M ϕ , which directly outputs the complete motor-position command. The mapper is not retrained or fine-tuned for Robot 2. The statistical analysis includes the complete repeated trials across the tested reference types. The plotted walk, squat, and dance trajectories are randomly selected temporal fragments from those physical trials; unequal frame counts indicate different visualization boundaries rather than different checkpoints or experimental units.
Representative physical executions and Mapping-OFF/ON comparisons are provided in Video S1.
Figure 3 summarizes the physical tracking-error comparisons and the cross-unit Mapping-ON records.
At the complete-trial level, the aggregate action-completion rate is 68% for Mapping OFF and 79% for Mapping ON, corresponding to an increase of 11 percentage points. Completion requires reaching the end of the full physical reference trajectory without a failure termination. These condition-specific physical results are distinct from the above-90% checkpoint-level completion result over 12,674 tested reference motions. The completion rates are reported descriptively; no statistical-significance claim is made.
Multi-motion and multi-robot comparison. The displayed temporal-segment records are summarized using per-joint trajectory MAE:
E joint MAE = 1 T J t = 1 T j = 1 J q t , j ref q t , j enc ,
where J = 28 . The torso-orientation error is the mean geodesic angle between reference and measured orientations. Each displayed metric is computed over all frames of the selected trajectory fragment. The repeated-trial evaluation uses each complete trial as one independent unit to check consistency across reference types and robot units; the 50 Hz frames and displayed fragments are not treated as independent replicates or as a basis for a significance claim.
Table 5 lists the corresponding segment summaries, and Figure 4 resolves the Robot 1 OFF/ON records in time to show phase-dependent error trends for all three motions.
In the displayed Robot 1 fragments, the ON trajectory is lower than the corresponding OFF trajectory by 12.1 % , 14.7 % , and 18.0 % in joint-position MAE for walk, squat, and dance; the corresponding illustrative torso-orientation differences are 3.2 % , 36.0 % , and 23.2 % . Their unweighted fragment-level means are 0.1308 and 0.1113 rad/joint and 6 . 179 and 4 . 820 , respectively. These numbers visualize representative trajectories and are not substituted for the randomized complete-trial statistics. The displayed physical Robot 2 Mapping-ON fragments yield 0.1088 and 0.1109 rad/joint for squat and dance, respectively; the corresponding torso-orientation errors are 4 . 538 and 3 . 795 .

5.4. Policy-Side Design Scope

The implemented policy combines the robot-space reference, a learned residual, and action-rate regularization. The earlier manuscript included numerical rows for direct-target, reference-only, and residual-only variants that were not linked to independent archived runs. Those reconstructed values and the associated table have been removed. Consequently, the present paper describes the implemented policy structure but does not claim a controlled factorial ablation of reference conditioning, residual learning, smoothing, and mapper effects. The physical mapper is absent from PPO training and is evaluated separately by the randomized physical Mapping-OFF/ON protocol in Section 5.3.

5.5. Single-Stage Training Diagnostics and Adaptive Sampling

The retained records provide three single-stage PPO training runs on different motion archives. Their adaptive-sampling parameters are the same, so the runs characterize training behavior under different archive compositions rather than isolate uniform, motion-level, and segment-level sampling factors. The earlier interpolated motion-level-only row has been removed because it was not an independent run. Table 6 summarizes the archived training-run diagnostics.
Archive A reaches reward 20 at 10,551 iterations, Archive B at 1412 iterations, and Archive C at 1604 iterations. Archive C has the highest retained mean reward and the lowest final sampling entropy among these runs. Because the motion archives differ, the numerical gaps cannot be attributed solely to a sampling component. Figure 5 and Figure 6 show the three archived training curves; their legacy legend names are run identifiers rather than validated one-factor ablation labels.

6. Conclusions and Discussion

We presented a hierarchical whole-body tracking framework for the 28-DoF Droid X3. A reference-residual actor is trained in simulation from a unified, globally anchored motion representation, while a separately trained mapper converts desired joint targets and measured plant state into motor-position commands. The static calibration provides the Mapping-OFF baseline. This separation preserves a common policy representation across motion sources and confines transmission compensation to the deployment layer.
In simulation evaluation over 12,674 tested reference motions, the trained frozen checkpoint achieves an aggregate action-completion rate above 90%. This checkpoint-level result is descriptive because the retained archive does not support a retrospective source-disjoint or cross-source breakdown.
Among the three retained training runs, Archive C has the highest final reward-derived score and the lowest sampling entropy; the runs use different motion archives and therefore do not constitute a controlled sampler ablation. The physical study uses randomized repeated Mapping-OFF/ON trials on two nominally identical Droid X3 units while holding the PPO checkpoint, mapper weights, reference motions, and controller settings fixed. The complete-trial action-completion rate is 68% for Mapping OFF and 79% for Mapping ON. The time-series figure and per-trajectory table report randomly selected physical segments for visualization; trial-level statistics use complete repeated trials as the independent units.
The modular architecture allows the motion library, sampling process, and hardware mapper to be revised without changing the high-level joint-space interface.

Scope and Limitations

Dataset provenance and reproducibility. The archive-level source, frame, duration, and window counts are recoverable, but the historical train/validation/test manifest, complete clip-to-upstream-source mapping, numerical feasibility thresholds, preprocessing-script revision, and mapper trajectory-level split manifest are unavailable. The documented processing stages support method-level reimplementation on available source data, but do not support a byte-identical reconstruction of the complete historical library or frozen checkpoint. A future release should include versioned source and split manifests, fixed thresholds, preprocessing code, and complete-trajectory mapper partitions.
Hardware and mapper coverage. Randomized repeated Mapping-OFF/ON trials were conducted on Robot 1 and Robot 2 using the same frozen PPO checkpoint and identical frozen mapper weights. Conditions were compared within robot and motion so that unit-specific cable transmission did not replace the within-unit mapper toggle. Complete trials are the independent statistical units; the displayed temporal segments are illustrative only. The two units have the same dimensions, link geometry, 28-DoF configuration, and tendon-cable layout, while their separately assembled cable transmissions provide unit-specific hardware conditions. Across the evaluated complete physical trials, the aggregate action-completion rates are 68% for Mapping OFF and 79% for Mapping ON. Pretension, temperature, wear, payload, and motion-speed strata were not directly controlled, so the cross-unit result is not interpreted as a controlled test of any one of these physical factors.
Environment and duration. The evaluation is limited to indoor level-floor reference tracking. Outdoor navigation, uneven or deformable terrain, long-distance navigation, complex obstacle negotiation, load carrying, and contact-rich manipulation are not evaluated. Completion of a heterogeneous motion batch provides only a session-level continuity check; total uninterrupted duration, intervention count, thermal evolution, long-duration cable wear, actuator degradation, calibration drift, recalibration intervals, and pre/post-transmission error were not quantified. Scheduled re-identification, richer transmission-state sensing, online anomaly detection, and health monitoring [29] are relevant future directions.
Teleoperation and user interaction. The robot-space interface can accept future streaming commands, but no end-to-end teleoperation, input-delay/jitter/dropout benchmark, missing-pose recovery test, operator study, NASA-TLX/SUS assessment, or standardized human–robot-interaction evaluation is reported. Accordingly, real-time teleoperation and operator usability are not claimed as validated contributions.
Computation. The serial actor–mapper path is configured at 50 Hz on the RK3588, but the retained 50 Hz traces cannot resolve within-cycle timing. P50/P95/P99 latency, jitter, memory, deadline misses, and scaling are unreported; the configured update rate is not presented as a real-time deadline benchmark.
Safety and failure handling. Action clipping and training penalties do not constitute a field-safety system. This study does not evaluate emergency-stop latency, watchdog and communication-timeout behavior, current/temperature protection, cable-break detection, fall protection, recovery control, or human-contact safety. These hardware-level mechanisms, thresholds, and response times require separate validation before outdoor, long-horizon, or close-proximity deployment.

Supplementary Materials

The following supporting information can be downloaded at https://www.mdpi.com/article/10.3390/biomimetics11090607/s1, Video S1: Physical whole-body reference-motion tracking and Mapping-OFF/ON comparisons on the Droid X3 humanoid.

Author Contributions

Conceptualization, W.G. and H.M.; methodology, W.G.; writing—original draft preparation, W.G.; writing—review and editing, W.G., H.M., J.C., Q.L. and J.Z. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the 2025 Shanghai Key Technologies Research and Development Program—“New Energy” Project (Grant No. 25DZ3001401).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable; the reported experiments involved robot-control evaluation and did not recruit human participants or report identifiable participant information.

Data Availability Statement

The processed archive composition, derived tracking-error records, and reported aggregate diagnostics are described in the article and accompanying project material. Raw robot system-identification trajectories, complete trial manifests, historical dataset-split manifests, and all training checkpoints are not publicly archived with this manuscript. Further inquiries can be directed to the corresponding author.

Acknowledgments

The authors would also like to thank Shanghai DroidUp Co., Ltd. for providing experimental equipment, technical support, and valuable suggestions during this research.

Conflicts of Interest

W.G., H.M. and Q.L. are affiliated with Shanghai DroidUp Co., Ltd., which provided the experimental robot, technical support, and suggestions for this study. The remaining authors declare no other conflicts of interest.

References

  1. Peng, X.B.; Abbeel, P.; Levine, S.; Van de Panne, M. DeepMimic: Example-guided deep reinforcement learning of physics-based character skills. ACM Trans. Graph. (TOG) 2018, 37, 143. [Google Scholar]
  2. Luo, Z.; Cao, J.; Merel, J.; Winkler, A.; Huang, J.; Kitani, K.; Xu, W. Universal humanoid motion representations for physics-based control. In Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria, 7–11 May 2024. [Google Scholar]
  3. He, T.; Xiao, W.; Lin, T.; Luo, Z.; Xu, Z.; Jiang, Z.; Kautz, J.; Liu, C.; Shi, G.; Wang, X.; et al. HOVER: Versatile neural whole-body controller for humanoid robots. In Proceedings of the 2025 IEEE International Conference on Robotics and Automation (ICRA), Atlanta, GA, USA, 19–23 May 2025; pp. 9989–9996. [Google Scholar]
  4. Chen, Z.; Ji, M.; Cheng, X.; Peng, X.; Peng, X.B.; Wang, X. GMT: General motion tracking for humanoid whole-body control. arXiv 2025, arXiv:2506.14770. [Google Scholar]
  5. Yang, C.; Sun, Y.; Ye, P.; Chen, X.; Yu, C.; Chen, T. Efficiently learning general motion tracking policy for high dynamic humanoid whole-body control. arXiv 2025, arXiv:2512.19043. [Google Scholar]
  6. Luo, Z.; Yuan, Y.; Wang, T.; Li, C.; Chen, S.; Castañeda, F.; Cao, Z.A.; Li, J.; Minor, D.; Ben, Q.; et al. SONIC: Supersizing motion tracking for natural humanoid whole-body control. arXiv 2025, arXiv:2511.07820. [Google Scholar]
  7. Yao, Y.; Luo, C.; Du, J.; He, W.; Lu, J.G. GBC: Generalized behavior-cloning framework for whole-body humanoid imitation. arXiv 2025, arXiv:2508.09960. [Google Scholar]
  8. Wang, Y.; Yang, M.; Zeng, W.; Zhang, Y.; Xu, X.; Jiang, H.; Ding, Z.; Lu, Z. From experts to a generalist: Toward general whole-body control for humanoid robots. arXiv 2025, arXiv:2506.12779. [Google Scholar]
  9. He, T.; Luo, Z.; He, X.; Xiao, W.; Zhang, C.; Zhang, W.; Kitani, K.; Liu, C.; Shi, G. OmniH2O: Universal and dexterous human-to-humanoid whole-body teleoperation and learning. arXiv 2024, arXiv:2406.08858. [Google Scholar]
  10. Ze, Y.; Chen, Z.; Araújo, J.P.; Cao, Z.A.; Peng, X.B.; Wu, J.; Liu, C.K. TWIST: Teleoperated whole-body imitation system. arXiv 2025, arXiv:2505.02833. [Google Scholar]
  11. Li, Y.; Lin, Y.; Cui, J.; Liu, T.; Liang, W.; Zhu, Y.; Huang, S. CLONE: Closed-loop whole-body humanoid teleoperation for long-horizon tasks. arXiv 2025, arXiv:2506.08931. [Google Scholar]
  12. Truong, T.E.; Liao, Q.; Huang, X.; Tevet, G.; Liu, C.K.; Sreenath, K. BeyondMimic: From motion tracking to versatile humanoid control via guided diffusion. arXiv 2025, arXiv:2508.08241. [Google Scholar]
  13. Sun, Z.; Huang, B.S.; Peng, Y.; Li, X.; Ma, J.; Sun, Y.; Li, Z.; Jiang, H.; Gao, B.; Bing, Z.; et al. MOSAIC: Bridging the sim-to-real gap in generalist humanoid motion tracking and teleoperation with rapid residual adaptation. arXiv 2026, arXiv:2602.08594. [Google Scholar]
  14. Zhao, S.; Ze, Y.; Wang, Y.; Liu, C.K.; Abbeel, P.; Shi, G.; Duan, R. ResMimic: From general motion tracking to humanoid whole-body loco-manipulation via residual learning. arXiv 2025, arXiv:2510.05070. [Google Scholar]
  15. Araújo, J.P.; Ze, Y.; Xu, P.; Wu, J.; Liu, C.K. Retargeting matters: General motion retargeting for humanoid motion tracking. arXiv 2025, arXiv:2510.02252. [Google Scholar]
  16. Pan, Y.; Qiao, R.; Chen, L.; Chitta, K.; Pan, L.; Mai, H.; Bu, Q.; Zhao, H.; Zheng, C.; Luo, P.; et al. Agility meets stability: Versatile humanoid control with heterogeneous data. arXiv 2025, arXiv:2511.17373. [Google Scholar]
  17. Xue, Y.; Lin, Y.; Dong, W.; Tang, Y.; Wang, J.; Pang, J.; Zhou, M.; Liu, M.; Zhang, W. Scalable and general whole-body control for cross-humanoid locomotion. arXiv 2026, arXiv:2602.05791. [Google Scholar]
  18. Zhang, Z.; Wen, K.; Xu, M.; He, J.; Li, C.; Miki, T.; Schwarke, C.; Zhang, C.; Peng, X.B.; Hutter, M. Learning whole-body humanoid locomotion via motion generation and motion tracking. arXiv 2026, arXiv:2604.17335. [Google Scholar]
  19. Li, J.; Tang, B.; Wu, F. TeleGate: Whole-body humanoid teleoperation via gated expert selection with motion prior. arXiv 2026, arXiv:2602.09628. [Google Scholar]
  20. Zhu, T.; Cai, G.; Yang, Z.; Ren, G.; Xie, H.; Wang, Z.; Wu, J.; Wang, J.; Yang, X.; Mu, Y.; et al. CLOT: Closed-loop global motion tracking for whole-body humanoid teleoperation. arXiv 2026, arXiv:2602.15060. [Google Scholar]
  21. Li, Y.; Ma, L.; Lin, Y.; Du, Y.; Liu, M.; Hu, K.; Cui, J.; Zhu, Y.; Liang, W.; Jia, B.; et al. OmniClone: Engineering a robust, all-rounder whole-body humanoid teleoperation system. arXiv 2026, arXiv:2603.14327. [Google Scholar]
  22. Wang, Y.; Zhao, Q.; Lau, Y.F.; Yu, R.; Tsui, H.W.; Chen, Q.; Wang, J.; Pang, J.; Tan, P. HumanX: Toward agile and generalizable humanoid interaction skills from human videos. arXiv 2026, arXiv:2602.02473. [Google Scholar]
  23. Zhang, Z.; Lu, H.; Lian, Y.; Chen, Z.; Liu, Y.; Lin, C.; Xue, H.; Zeng, Z.; Qi, Z.; Zheng, S.; et al. Learning athletic humanoid tennis skills from imperfect human motion data. arXiv 2026, arXiv:2603.12686. [Google Scholar]
  24. Shanghai DroidUp Co., Ltd. Bipedal Humanoid Robot Product Series. Available online: https://www.droidup.com/product (accessed on 27 July 2026).
  25. Peng, X.B.; Ma, Z.; Abbeel, P.; Levine, S.; Kanazawa, A. AMP: Adversarial motion priors for stylized physics-based character control. ACM Trans. Graph. (TOG) 2021, 40, 144. [Google Scholar]
  26. Lu, Q.; Feng, Y.; Shi, B.; Piseno, M.; Bao, Z.; Liu, C.K. GentleHumanoid: Learning upper-body compliance for contact-rich human and object interaction. arXiv 2025, arXiv:2511.04679. [Google Scholar]
  27. Xiong, Z.; Fang, L.; Huang, J.; Yamazaki, K.; Zhang, H.; Gan, C. ExtremControl: Low-latency humanoid teleoperation with direct extremity control. arXiv 2026, arXiv:2602.11321. [Google Scholar]
  28. Lee, K.; Park, S.; Park, G.; Kim, M.J.; Park, J. Safety-critical whole-body control for humanoid robots via input-to-state safe control barrier functions. arXiv 2026, arXiv:2605.25546. [Google Scholar]
  29. Mao, Z.; Wang, J.; Zhang, J.; Ohgi, J.; Zheng, Y.; Peng, Y.; Zhao, L.; Su, Q.; Huang, W.; Xu, B. Fine-tuned multimodal large language model for autonomous state cognition system of shape-recognition 6-bar tensegrity integrated with flexible sensors. Microsyst. Nanoeng. 2026, 12, 228. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  30. Todorov, E.; Erez, T.; Tassa, Y. MuJoCo: A physics engine for model-based control. In Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vilamoura, Portugal, 7–12 October 2012; pp. 5026–5033. [Google Scholar]
  31. Mahmood, N.; Ghorbani, N.; Troje, N.F.; Pons-Moll, G.; Black, M.J. AMASS: Archive of motion capture as surface shapes. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019; pp. 5442–5451. [Google Scholar]
  32. Schulman, J.; Wolski, F.; Dhariwal, P.; Radford, A.; Klimov, O. Proximal policy optimization algorithms. arXiv 2017, arXiv:1707.06347. [Google Scholar]
  33. Schulman, J.; Moritz, P.; Levine, S.; Jordan, M.; Abbeel, P. High-dimensional continuous control using generalized advantage estimation. In Proceedings of the International Conference on Learning Representations (ICLR), San Juan, PR, USA, 2–4 May 2016. [Google Scholar]
Figure 1. Overview of the proposed framework using the original three-phase layout. Phase 1 constructs the unified multi-source motion library and adaptive sampler. Phase 2 trains the reference-residual PPO policy in simulation; the reference mapping S denotes the fixed residual scaling, and the physical learned mapper is excluded from PPO. Before Phase 3 deployment, synchronized real-robot excitation data identify the differentiable forward model F ψ , through which the state-conditioned mapper is trained offline and then frozen. During Mapping ON, the frozen mapper converts the complete policy-level desired-joint target and measured plant state into the complete motor-position command; Mapping OFF instead uses the fixed static calibration.
Figure 1. Overview of the proposed framework using the original three-phase layout. Phase 1 constructs the unified multi-source motion library and adaptive sampler. Phase 2 trains the reference-residual PPO policy in simulation; the reference mapping S denotes the fixed residual scaling, and the physical learned mapper is excluded from PPO. Before Phase 3 deployment, synchronized real-robot excitation data identify the differentiable forward model F ψ , through which the state-conditioned mapper is trained offline and then frozen. During Mapping ON, the frozen mapper converts the complete policy-level desired-joint target and measured plant state into the complete motor-position command; Mapping OFF instead uses the fixed static calibration.
Biomimetics 11 00607 g001
Figure 2. Representative physical poses under one reference-residual controller, illustrating large upper-limb excursions and coordinated arm–leg postures. These are qualitative frames rather than standardized gesture classes or independent samples; quantitative metrics are computed over complete reference sequences.
Figure 2. Representative physical poses under one reference-residual controller, illustrating large upper-limb excursions and coordinated arm–leg postures. These are qualitative frames rather than standardized gesture classes or independent samples; quantitative metrics are computed over complete reference sequences.
Biomimetics 11 00607 g002
Figure 3. Physical tracking-error summary for randomly selected trajectory fragments from the repeated trial sets. Panels (a,b) compare Robot 1 examples using the static joint-to-motor conversion (OFF) and the learned mapper conversion (ON). Under Mapping ON, the frozen mapper receives the complete policy-level desired-joint vector and measured plant state and directly outputs the complete motor-position command. Panels (c,d) compare measured physical Mapping-ON examples from Robot 1 and Robot 2 using identical frozen mapper weights. Complete randomized trials, rather than these displayed fragments, are the statistical units. Downward arrows above the bars indicate the relative reduction in the displayed tracking error from Mapping OFF to Mapping ON.
Figure 3. Physical tracking-error summary for randomly selected trajectory fragments from the repeated trial sets. Panels (a,b) compare Robot 1 examples using the static joint-to-motor conversion (OFF) and the learned mapper conversion (ON). Under Mapping ON, the frozen mapper receives the complete policy-level desired-joint vector and measured plant state and directly outputs the complete motor-position command. Panels (c,d) compare measured physical Mapping-ON examples from Robot 1 and Robot 2 using identical frozen mapper weights. Complete randomized trials, rather than these displayed fragments, are the statistical units. Downward arrows above the bars indicate the relative reduction in the displayed tracking error from Mapping OFF to Mapping ON.
Biomimetics 11 00607 g003
Figure 4. Time-resolved real-robot tracking errors for randomly selected walk, squat, and dance fragments with Mapping OFF and ON: (a) walk joint-position MAE; (b) walk torso-orientation error; (c) squat joint-position MAE; (d) squat torso-orientation error; (e) dance joint-position MAE; and (f) dance torso-orientation error. Thin curves show per-frame errors; thick curves show 25-frame (0.5 s) moving averages. Statistical pairing is performed at the complete-trial level, not frame by frame.
Figure 4. Time-resolved real-robot tracking errors for randomly selected walk, squat, and dance fragments with Mapping OFF and ON: (a) walk joint-position MAE; (b) walk torso-orientation error; (c) squat joint-position MAE; (d) squat torso-orientation error; (e) dance joint-position MAE; and (f) dance torso-orientation error. Thin curves show per-frame errors; thick curves show 25-frame (0.5 s) moving averages. Statistical pairing is performed at the complete-trial level, not frame by frame.
Biomimetics 11 00607 g004
Figure 5. EMA-smoothed training reward for the three archived runs on different motion archives. Archive C has the highest retained final reward and Archive B reaches reward 20 first. Legacy labels embedded in the plot identify the original records but do not establish a controlled sampling ablation.
Figure 5. EMA-smoothed training reward for the three archived runs on different motion archives. Archive C has the highest retained final reward and Archive B reaches reward 20 first. Legacy labels embedded in the plot identify the original records but do not establish a controlled sampling ablation.
Biomimetics 11 00607 g005
Figure 6. Sampling entropy for the three archived runs. The curves document nonzero sampling diversity under their respective motion archives; differences cannot be assigned to a single sampling factor because the archive composition is not controlled. Legacy labels embedded in the plot identify the original records only.
Figure 6. Sampling entropy for the three archived runs. The curves document nonzero sampling diversity under their respective motion archives; differences cannot be assigned to a single sampling factor because the archive composition is not controlled. Legacy labels embedded in the plot identify the original records only.
Biomimetics 11 00607 g006
Table 1. Tracking rewards and regularization penalties. A is the torso anchor, B is the set of 14 tracked links, d R is geodesic rotation error, and superscript “rel” denotes anchor-relative coordinates.
Table 1. Tracking rewards and regularization penalties. A is the torso anchor, B is the set of 14 tracked links, d R is geodesic rotation error, and superscript “rel” denotes anchor-relative coordinates.
TermDefinitionWeight
Global-anchor position exp p A p A r e f 2 2 / 0 . 3 2 0.5
Global-anchor orientation exp d R ( R A , R A r e f ) 2 / 0 . 4 2 0.5
Global-anchor linear velocity exp v A v A r e f 2 2 / 1 . 0 2 1.0
Key-body position 1 | B | b B exp p b r e l p ^ b r e f , r e l 2 2 / 0 . 3 2 1.0
Key-body orientation 1 | B | b B exp d R ( R b r e l , R ^ b r e f , r e l ) 2 / 0 . 4 2 1.0
Key-body linear velocity 1 | B | b B exp v b v b r e f 2 2 / 1 . 0 2 1.0
Key-body angular velocity 1 | B | b B exp ω b ω b r e f 2 2 / π 2 1.0
Feet position exp p F p F r e f 2 2 / 0 . 5 2 0.8
Base orientation exp d R ( R base , R base r e f ) 2 / 0 . 5 2 0.5
Base linear velocity exp v base v base r e f 2 2 / 1 . 0 2 0.5
Base angular velocity exp ω base ω base r e f 2 2 / π 2 0.5
Action smoothness a t a t 1 2 2 −0.3
Joint limit n limit ( q t ) −10
Self-collision n collision −10
Table 2. Domain-randomization configuration. Episode-level variables are sampled at reset and observation noise is sampled per control step. Multiplicative ranges are marked by ×.
Table 2. Domain-randomization configuration. Episode-level variables are sampled at reset and observation noise is sampled per control step. Multiplicative ranges are marked by ×.
LayerParameterRange/Unit
Reference inputRoot position ( x , y , z )±0.05/±0.05/±0.01 m
Root orientation (r/p/y)±0.1/±0.1/±0.2 rad
Joint reference offset±0.1 rad
Robot bodyTorso CoM offset ( x / y / z )±0.025/±0.05/±0.05 m
Encoder bias±0.01 rad
ContactFoot friction coefficient [ 0.3 , 1.2 ]
Push velocity (every 1–3 s)±0.5 m/s, ±0.78 rad/s
Observation noiseProjected gravity±0.05
Base angular velocity±0.2 rad/s
Joint position±0.01 rad
Joint velocity±0.5 rad/s
Tendon executionResponse delay, τ d e l a y 0–2 steps (0–40 ms)
Equiv. stiffness/damping, k e f f , d e f f ×[0.8, 1.2]
Mapping residual, δ M ± 0.05  rad
Table 3. PPO training hyperparameters for the Droid X3 tracking task.
Table 3. PPO training hyperparameters for the Droid X3 tracking task.
ParameterValueParameterValue
Parallel environments8192Discount factor, γ 0.99
Rollout length24GAE factor, λ 0.95
Learning epochs5Clip range, ϵ 0.2
Mini-batches4Value loss coef., c v 1.0
Learning rate 1 × 10 3 (adaptive)Entropy coef., c h 0.005
Desired KL0.01Max gradient norm1.0
Hidden layers ( 1024 , 1024 , 512 , 256 ) ActivationELU
Initial action std1.0Control frequency50 Hz
Table 4. Recoverable composition of the processed motion archive. Windows may overlap; duration is computed from non-overlapping source frames. Boldface identifies the aggregate total row.
Table 4. Recoverable composition of the processed motion archive. Windows may overlap; duration is computed from non-overlapping source frames. Boldface identifies the aggregate total row.
Source GroupSequencesFramesDuration (h)Windows
LAFAN157608,8183.3821386
Pico-record993,9510.522213
SEED63,23522,945,495127.47577,623
TWIST231,05815,833,85187.96647,869
Total94,35939,482,115219.345127,091
Table 5. Randomly selected physical trajectory fragments from repeated trials on two Droid X3 units at 50 Hz. OFF denotes the fixed static joint-to-motor conversion. Under ON, the frozen mapper receives the complete policy-level desired-joint vector and measured plant state and directly outputs the complete motor-position command; no robot-specific static-calibration command is added. Unequal frame counts reflect different visualization boundaries. These rows are illustrative and are not the repeat-level statistical units.
Table 5. Randomly selected physical trajectory fragments from repeated trials on two Droid X3 units at 50 Hz. OFF denotes the fixed static joint-to-motor conversion. Under ON, the frozen mapper receives the complete policy-level desired-joint vector and measured plant state and directly outputs the complete motor-position command; no robot-specific static-calibration command is added. Unequal frame counts reflect different visualization boundaries. These rows are illustrative and are not the repeat-level statistical units.
UnitMotionConditionFramesDuration
(s)
Joint MAE
(Rad/Joint)
Torso Error
(Deg)
1WalkOFF76815.360.12965.369
1WalkON79015.800.11395.197
1SquatOFF83316.660.13006.657
1SquatON73814.760.11094.261
1DanceOFF104120.820.13276.510
1DanceON107721.540.10895.000
2SquatON83316.660.10884.538
2DanceON113522.700.11093.795
Table 6. Archived training-run diagnostics. Runs A–C use different motion archives with the same recorded adaptive-sampling parameters. Iterations are measured to reward 20; reward score is mean reward normalized by the common reference peak 36.67, and the episode-length proxy is not a measured hard-motion success rate. Here, ↓ denotes lower-is-better and ↑ denotes higher-is-better. Boldface identifies Archive C, the retained run discussed below; it does not indicate the best value in every column.
Table 6. Archived training-run diagnostics. Runs A–C use different motion archives with the same recorded adaptive-sampling parameters. Iterations are measured to reward 20; reward score is mean reward normalized by the common reference peak 36.67, and the episode-length proxy is not a measured hard-motion success rate. Here, ↓ denotes lower-is-better and ↑ denotes higher-is-better. Boldface identifies Archive C, the retained run discussed below; it does not indicate the best value in every column.
RecordIter. ↓Reward Score (%) ↑Episode-Length Proxy (%) ↑Entropy
Archive A (run 0609)10,55152.331.20.743
Archive B (run 0610)141270.961.80.709
Archive C (run 0608)160478.172.30.665
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Gan, W.; Chen, J.; Li, Q.; Mou, H.; Zhang, J. Hierarchical Whole-Body Control for Tendon-Cable-Driven Humanoids via Reference-Residual Policy and Offline-Learned Tendon Mapping. Biomimetics 2026, 11, 607. https://doi.org/10.3390/biomimetics11090607

AMA Style

Gan W, Chen J, Li Q, Mou H, Zhang J. Hierarchical Whole-Body Control for Tendon-Cable-Driven Humanoids via Reference-Residual Policy and Offline-Learned Tendon Mapping. Biomimetics. 2026; 11(9):607. https://doi.org/10.3390/biomimetics11090607

Chicago/Turabian Style

Gan, Wencong, Jiehui Chen, Qingdu Li, Haiming Mou, and Jianwei Zhang. 2026. "Hierarchical Whole-Body Control for Tendon-Cable-Driven Humanoids via Reference-Residual Policy and Offline-Learned Tendon Mapping" Biomimetics 11, no. 9: 607. https://doi.org/10.3390/biomimetics11090607

APA Style

Gan, W., Chen, J., Li, Q., Mou, H., & Zhang, J. (2026). Hierarchical Whole-Body Control for Tendon-Cable-Driven Humanoids via Reference-Residual Policy and Offline-Learned Tendon Mapping. Biomimetics, 11(9), 607. https://doi.org/10.3390/biomimetics11090607

Article Metrics

Article metric data becomes available approximately 24 hours after publication online.
Back to TopTop