REVIEW 4 major objections 5 minor 29 references
Phase-Based Multi-Gait Learning for a Salamander-Like Robot
T0 review · 4 major / 5 minor · reviewed 2026-08-03 · deepseek-v4-flash
Pith's one-line read The paper claims that a salamander-like robot can learn 22 distinct omnidirectional gaits from a single policy that outputs only five signed phase velocities, with no reference motions or hand-designed gait patterns.
desk verdict A genuinely useful hardware gait-learning result that is undermined by a circular ablation and a missing baseline comparison. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing mechanism is the phase variable φ_i for each of five body parts (four legs and the spine), updated by φ_i ← φ_i + ω_i Δt with signed phase velocity ω_i ∈ [-π/2, π/2] as the only action. The trajectory generator maps each phase to joint angles via fixed sinusoidal templates (e.g., θ = A cos φ, A sin φ + θ_offset), so the policy cannot alter amplitude or waveform; it can only speed up, slow down, or reverse each body part's rhythmic cycle. Two auxiliary mechanisms carry the argument: a phase coverage reward that encourages each leg to traverse its full 2π phase range, and a symmetry group C2×C2 whose transformations are applied to states and actions as data augmentation, makin
What would settle it
Train the same framework on a command at a very low speed (long stance phase) or on a terrain where optimal gaits require asymmetric leg cycles; then check whether the learned policy can produce the required stance/swing asymmetry. If the fixed sinusoidal template forces a symmetric duty cycle that fails on that command, the expressivity limitation is demonstrated. Alternatively, directly measure foot-contact phases on the physical robot and compare the stance/swing duty cycles against the sinusoidal template's prediction.
Extended reading notes
Core claim
The central discovery is that a learning framework based on bidirectional phase variables—one per leg plus the spine—can yield a single controller that tracks 22 translational and rotational commands on a salamander-like quadruped without reference motions. Each body part's phase evolves by a signed phase velocity that the policy outputs, and a fixed sinusoidal trajectory generator converts phases to joint angles. A phase coverage reward (mean plus minimum leg coverage) prevents static or under-explored phase behavior, while a C2×C2 symmetry augmentation (front-back and left-right reflections applied to states and actions) biases the policy toward equivariant, symmetric behavior. The authors
Load-bearing premise
The framework's success rests on the premise that all needed gaits can be expressed by one signed phase velocity per body part feeding a fixed sinusoidal joint template with constant amplitude and offset; if a desired gait requires different joint waveforms, amplitudes, or asymmetric stance/swing timing, no policy in this action family could produce it.
Editorial extensions
If this is right
- If correct, a single policy, not a library of per-gait policies, suffices for a sprawling quadruped to execute 22 distinct translational and rotational commands.
- The phase-based action space abstracts away joint-angle trajectories, suggesting that the same framework could be transferred to other bio-inspired morphologies by redefining the per-body-part phase mapping.
- Symmetry-based data augmentation acts as a physics-informed prior that improves sample efficiency and enforces motion-level and task-level symmetry without extra real-world interaction.
- Smooth gait transitions emerge naturally from phase continuity and random phase initialization, even though the policy was never trained on sequential command switches.
- The framework removes the need for motion capture datasets or expert-designed CPG parameters for bio-inspired robots, which is especially relevant for morphologies without recorded motion data.
Reading between the lines
- The expressiveness of the discovered gaits is bounded by the sinusoidal template: with constant amplitude and offset, any behavior requiring swing/stance asymmetry, variable amplitude, or multi-frequency joint patterns is inexpressible; testing on slow walking or uneven terrain would reveal this ceiling.
- The paper's symmetry claim is specifically about C2×C2 (front-back and left-right) reflections; gaits that are not symmetric under this group—such as turning with a preferred direction or asymmetric terrain adaptation—would likely require a different or additional inductive bias.
- The coverage reward applies only to leg phases, not the spine, yet the spine still produces effective motion; understanding how the spine phases self-organize under the leg-driven reward could yield a simpler design principle for body-limb coordination.
- The 22 commands are discrete samples of a continuous command space; the policy's ability to interpolate to arbitrary directions and turning rates is not measured, so the true omnidirectional capability is an open empirical question.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a phase-based reinforcement learning framework for a salamander-like quadruped robot. Each of five body parts (four legs and spine) is assigned a phase variable, and the policy outputs only five phase velocities (Eq. 7). The reward includes task progress, turning, undesired-motion penalties, and a phase-coverage term (Eq. 14). Morphological symmetry is injected via C2×C2 data augmentation (Sec. III-D, Table II). The authors report that a single policy learns 22 omnidirectional gait commands, with simulations and real-robot experiments showing forward/backward, lateral, rotational, curved, diagonal, and oblique movements, plus smooth transitions between gaits. Ablations are presented for the coverage reward and symmetry augmentation.
Significance. If the results hold, the paper makes a useful contribution: it shows that a very low-dimensional phase-frequency action space, trained without reference motions, can produce a varied omnidirectional gait repertoire on a bio-inspired quadruped, and it demonstrates lateral and in-place rotational locomotion on physical hardware. The real-robot phase trajectories (Figs. 6–7) and the smooth command-switching behavior are valuable empirical evidence. The symmetry augmentation is a clean and principled component. However, the quantitative evaluation has a circularity problem in the coverage-reward ablation, and the claims of 'discovering' dynamic and symmetric gaits are partly built into the reward and augmentation. With more careful evaluation and more modest framing, the core result could still stand.
major comments (4)
- [§IV-D, Table IV, Eq. (14)] The comparison between 'Ours' and 'w/o Cov' uses the cumulative reward as the evaluation metric, but the full method includes the non-negative phase coverage reward r_coverage = mean(c) + min(c) in its total return (Eq. 14) with weight w6 = 0.01 (Table III). The baseline omits this term. Therefore the higher cumulative reward for 'Ours' is structurally inflated by the very reward being ablated; Table IV does not demonstrate any behavioral benefit. The qualitative hardware phase data (Fig. 7) are more informative, but the quantitative claim that the coverage reward improves gaits is unsupported. Please re-evaluate with reward-independent metrics (e.g., achieved distance, turning error, phase coverage values, success rate), and report repeated training seeds rather than only variance across commands.
- [§III-A, Eqs. (1)–(7), Table III] The action space is limited to five phase velocities; the leg joint trajectories are fixed to A·cos(φj), A·sin(φj)+θ_offset, A·cos(φj), and the spine to A·cos(φS), with constant A=π/12 and θ_offset=31π/180. Thus the policy cannot modulate amplitude, joint offset, or waveform shape. The claim that the framework 'discovers' novel gaits such as lateral walking and in-place rotation is therefore conditional on those behaviors being expressible in this one-parameter-per-body-part family. This is a load-bearing scope limitation for the 'diverse repertoire' claim. Please either test expressiveness directly (e.g., by comparing with a variable-amplitude or direct-joint-action baseline) or explicitly state that the discovered gaits are confined to this sinusoidal template.
- [§III-D, Table II, §IV-B, Fig. 5] The symmetry of the learned behaviors is presented as a success of the method, but it is largely enforced by construction: the C2×C2 data augmentation explicitly transforms both states and actions (Table II), and the reward is G-invariant. Consequently, the central-symmetric trajectories in Fig. 5 and the paired phase patterns in Fig. 6 are expected consequences of the augmentation, not emergent discoveries. Please separate what is induced by the inductive bias from what is genuinely learned, and avoid wording that implies symmetry emerges independently. The useful empirical question is how much augmentation helps sample efficiency and robustness, not whether the policy becomes symmetric.
- [§IV-B and §IV-C] The claim that this is 'the first to demonstrate that a salamander-like robot can achieve lateral, in-place rotational, and diagonal movements' is difficult to verify from the cited literature and may be too strong, especially since the action space and trajectory generator are specifically designed to allow such phase patterns. The authors should either provide a more detailed comparison with prior salamander-like robot controllers or temper the claim.
minor comments (5)
- [General] The term 'dynamic' is used throughout (abstract, Sec. I, Sec. IV-D) but never formally defined. It appears to be identified with phase coverage and with periodic leg oscillation. Please give a precise criterion.
- [§III-B] The pose stack and phase stack assume a fixed period T* = 5 s, but the policy can change phase velocities, so actual gait periods may vary. Please clarify how the stack length is chosen when the executed gait is not strictly T*-periodic.
- [Table IV] The table reports variance within each gait category, but no variance over independent training runs. Given that PPO is stochastic, a single training run cannot support claims of 'consistently outperforms' or 'significantly lower variances'. Please add multi-seed statistics or state the number of seeds.
- [Eq. (11)] The sign convention for r_turn = δ ω* Δψ should be stated explicitly: for ω* = -1 (clockwise), a positive Δψ would be penalized, which may be intended depending on the yaw convention. Please make the convention clear.
- [References] The reference ordering appears unusual (e.g., [7] appears before [2] in the bibliography list). Please ensure the bibliography is in a consistent, journal-compliant order.
Circularity Check
Coverage-reward ablation is evaluated on a metric that includes the ablated reward term, making the quantitative 'improvement' partly by construction; the central multi-gait repertoire is otherwise supported by independent hardware evidence.
-
self definitional
[Sec. III-C (Eq. 14) and Sec. IV-D (Table IV)]
"r_coverage = mean(c)+min(c) ... The total reward is computed as a weighted sum of the above terms, with corresponding weights w_i for i=1,...,6 ... For evaluation, we compute the total undiscounted cumulative reward ... The quantitative results in Table. IV show that our approach consistently outperforms the no-coverage baseline across all gait types. This improvement stems from the inclusion of the phase coverage reward."
The comparison metric is the same total cumulative reward that includes r_coverage (Eq. 14) with weight 0.01. The w/o Cov baseline is trained without that term, so when both policies are scored on the full reward, the full method holds a structural advantage in the very metric used to claim the reward's benefit. The paper uses this reward-based comparison as the quantitative evidence that the coverage reward 'improves' gaits, so that specific claim reduces to the definition of the reward rather than to an independent behavioral metric. The separate phase-trajectory evidence in Fig. 7 is more independent but is qualitative and itself measures the phase coverage that the reward explicitly promotes.
full rationale
The paper's central contribution—a phase-velocity policy that tracks 22 translational/rotational commands—is not itself circular: the commands in Table I are task specifications, not gait definitions, and the learned phase coordinations (trot, lateral, in-place rotation) are demonstrated on the physical robot via phase plots and trajectories. The sinusoidal phase template (Eqs. 1–7) is an explicit ansatz rather than a hidden circular input. Symmetry-based augmentation is openly described as an inductive bias ('enforcing both motion-level and task-level symmetry'), so observing symmetric behaviors is a sanity check of that design choice, not a derived prediction. No load-bearing self-citation chain was found; references to the authors' prior CPG design [29] are contextual. The one genuine circularity is the coverage-reward ablation: comparing cumulative rewards computed from a total reward that includes the ablated r_coverage term makes the quantitative superiority of the full method partly self-validating. Because the robot's omnidirectional repertoire is still supported by reward-independent observations, the overall circularity is partial rather than total.
Assumptions & free parameters
free parameters (6)
- Joint amplitude A =
π/12 rad
- Joint offset θ_offset =
31π/180 rad
- Reward shaping parameters α, β, ζ, ε, δ =
1, 1.5, 0.5, 2.2, 0.75
- Reward weights w_i =
[0.1, 0.1, 0.1, 0.1, 0.1, 0.01]
- Desired gait period T* =
5 s
- Sim-to-real dynamics parameters =
not reported
assumptions (6)
- standard math In a G-symmetric MDP, the optimal policy is G-equivariant and the optimal value function G-invariant (Sec. II-C, citing [25]).
- domain assumption The robot's morphology is symmetric under front-back and left-right reflections, with the Table II relabelings as the correct group action.
- domain assumption The MuJoCo model, after tuning friction/mass/PID, faithfully reproduces the physical robot's dynamics.
- ad hoc to paper Phase coverage ratio cov_i = (2π − d_max)/2π is a valid proxy for motion quality/dynamicity.
- domain assumption Leg and spine joint commands of a single sinusoid per joint (Eqs. 1–4) can express all useful gaits for this robot.
- domain assumption Pose changes measured over T* windows are a sufficient feedback signal for command-following.
Cite this review
Pith. "Pith review of Phase-Based Multi-Gait Learning for a Salamander-Like Robot." pith.science (2026). https://pith.science/paper/VVB6DTMR
@misc{pith2026251108299,
author = {Pith},
title = {Pith review of: Phase-Based Multi-Gait Learning for a Salamander-Like Robot},
year = {2026},
howpublished = {\url{https://pith.science/paper/VVB6DTMR}},
note = {Machine review of arXiv:2511.08299}
}
read the original abstract
Salamander-like robots are designed inspired by the skeletal structure of their biological counterparts. However, existing controllers cannot fully exploit these morphological features and largely rely on predefined patterns or joint trajectories, which prevents the generation of diverse and flexible gaits and limits their applicability in real-world scenarios. In this paper, we propose a phase-based learning framework that enables the robot to acquire a diverse repertoire of gaits without using reference motions. Each body part is controlled by a phase variable capable of forward and backward evolution, with a phase coverage reward to promote the exploration of the leg phase space. Additionally, morphological symmetry of the robot is incorporated via data augmentation, improving sample efficiency and enforcing both motion-level and task-level symmetry in learned behaviors. Extensive experiments show that the robot successfully acquires 22 representative gaits exhibiting both dynamic and symmetric movements, demonstrating the effectiveness of the proposed learning framework.
Figures
Figures from the paper (2 more)
Reference graph
Works this paper leans on
-
[22]
Cpg-rl: Learning central pattern genera- tors for quadruped locomotion,
G. Bellegarda and A. Ijspeert, “Cpg-rl: Learning central pattern genera- tors for quadruped locomotion,”IEEE Robot. Autom. Lett., vol. 7, no. 4, pp. 12 547–12 554, 2022
2022
-
[1]
From cineradiography to biorobots: an approach for designing robots to emulate and study animal locomotion,
K. Karakasiliotis, R. Thandiackal, K. Melo, T. Horvat, N. K. Mahabadi, S. Tsitkov, J.-M. Cabelguen, and A. J. Ijspeert, “From cineradiography to biorobots: an approach for designing robots to emulate and study animal locomotion,”J. Roy. Soc. Interface, vol. 13, no. 119, p. 20151089, 2016
2016
-
[2]
Inverse kinematics and reflex based controller for body- limb coordination of a salamander-like robot walking on uneven terrain,
T. Horvat, K. Karakasiliotis, K. Melo, L. Fleury, R. Thandiackal, and A. J. Ijspeert, “Inverse kinematics and reflex based controller for body- limb coordination of a salamander-like robot walking on uneven terrain,” inProc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2015, pp. 195–201
2015
-
[3]
Diffusion model-based path follower for a salamander-like robot,
Z. Liu, Y . Liu, and Y . Fang, “Diffusion model-based path follower for a salamander-like robot,”IEEE Trans. Neural Netw. and Learn. Syst., vol. 36, no. 8, pp. 14 399–14 413, 2025
2025
-
[4]
Autonomous visual navigation with head stabilization control for a salamander-like robot,
Z. Liu, Y . Liu, Y . Fang, and X. Guo, “Autonomous visual navigation with head stabilization control for a salamander-like robot,”IEEE/ASME Trans. Mechatronics, 2025
2025
-
[5]
Fast and efficient locomotion via learned gait transitions,
Y . Yang, T. Zhang, E. Coumans, J. Tan, and B. Boots, “Fast and efficient locomotion via learned gait transitions,” inProc. Conf. Robot Learn., 2022, pp. 773–783
2022
-
[6]
Minimizing energy con- sumption leads to the emergence of gaits in legged robots,
Z. Fu, A. Kumar, J. Malik, and D. Pathak, “Minimizing energy con- sumption leads to the emergence of gaits in legged robots,” inProc. Conf. Robot Learn., 2022, pp. 928–937
2022
-
[7]
Spine controller for a sprawling posture robot,
T. Horvat, K. Melo, and A. J. Ijspeert, “Spine controller for a sprawling posture robot,”IEEE Robot. Autom. Lett., vol. 2, no. 2, pp. 1195–1202, 2017
2017
Show all 29 references
-
[8]
Salaman- dra robotica ii: an amphibious robot to study salamander-like swimming and walking gaits,
A. Crespi, K. Karakasiliotis, A. Guignard, and A. J. Ijspeert, “Salaman- dra robotica ii: an amphibious robot to study salamander-like swimming and walking gaits,”IEEE Trans. Robot., vol. 29, no. 2, pp. 308–320, 2013
2013
-
[9]
Transition gradient from standing to traveling waves for energy-efficient slope climbing of a gecko-inspired robot,
W. Haomachai, Z. Dai, and P. Manoonpong, “Transition gradient from standing to traveling waves for energy-efficient slope climbing of a gecko-inspired robot,”IEEE Robot. Autom. Lett., vol. 9, no. 3, pp. 2423– 2430, 2024
2024
-
[10]
Allgaits: Learning all quadruped gaits and transitions,
G. Bellegarda, M. Shafiee, and A. Ijspeert, “Allgaits: Learning all quadruped gaits and transitions,” inProc. IEEE Int. Conf. Robot. Autom., 2025, pp. 15 929–15 935
2025
-
[11]
Saytap: Language to quadrupedal locomotion,
Y . Tang, W. Yu, J. Tan, H. Zen, A. Faust, and T. Harada, “Saytap: Language to quadrupedal locomotion,” inProc. Conf. Robot Learn., 2023, pp. 3556–3570
2023
-
[12]
Learning free gait transition for quadruped robots via phase-guided controller,
Y . Shao, Y . Jin, X. Liu, W. He, H. Wang, and W. Yang, “Learning free gait transition for quadruped robots via phase-guided controller,”IEEE Robot. Autom. Lett., vol. 7, no. 2, pp. 1230–1237, 2021
2021
-
[13]
Skill latent space based multigait learning for a legged robot,
X. Liu, J. Wu, Y . Xue, C. Qi, G. Xin, and F. Gao, “Skill latent space based multigait learning for a legged robot,”IEEE Trans. Ind. Electron., vol. 72, no. 2, pp. 1743–1752, 2025
2025
-
[14]
Animal gaits on quadrupedal robots using motion matching and model-based control,
D. Kang, S. Zimmermann, and S. Coros, “Animal gaits on quadrupedal robots using motion matching and model-based control,” inProc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2021, pp. 8500–8507
2021
-
[15]
Animal motions on legged robots using nonlinear model predictive control,
D. Kang, F. De Vincenti, N. C. Adami, and S. Coros, “Animal motions on legged robots using nonlinear model predictive control,” inProc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2022, pp. 11 955–11 962
2022
-
[16]
Learning agile robotic locomotion skills by imitating animals,
X. Bin Peng, E. Coumans, T. Zhang, T.-W. Lee, J. Tan, and S. Levine, “Learning agile robotic locomotion skills by imitating animals,”Proc. Robot.: Sci. Syst., pp. 12–16, 2020
2020
-
[17]
Imitate and repurpose: Learning reusable robot movement skills from human and animal behaviors,
S. Bohez, S. Tunyasuvunakool, P. Brakel, F. Sadeghi, L. Hasenclever, Y . Tassa, E. Parisotto, J. Humplik, T. Haarnoja, R. Hafneret al., “Imitate and repurpose: Learning reusable robot movement skills from human and animal behaviors,”arXiv preprint arXiv:2203.17138, 2022
2022 arXiv
-
[18]
Lifelike agility and play in quadrupedal robots using reinforcement learning and generative pre-trained models,
L. Han, Q. Zhu, J. Sheng, C. Zhang, T. Li, Y . Zhang, H. Zhang, Y . Liu, C. Zhou, R. Zhaoet al., “Lifelike agility and play in quadrupedal robots using reinforcement learning and generative pre-trained models,”Nature Mach. Intell., vol. 6, no. 7, pp. 787–798, 2024
2024
-
[19]
Emergent real-world robotic skills via unsupervised off-policy rein- forcement learning,
A. Sharma, M. Ahn, S. Levine, V . Kumar, K. Hausman, and S. Gu, “Emergent real-world robotic skills via unsupervised off-policy rein- forcement learning,” inProc. Robot.: Sci. Syst., 2020
2020
-
[20]
Dynamics- aware unsupervised discovery of skills,
A. Sharma, S. Gu, S. Levine, V . Kumar, and K. Hausman, “Dynamics- aware unsupervised discovery of skills,” inInternational Conference on Learning Representations, 2020
2020
-
[21]
Contrastive intrinsic control for unsupervised reinforcement learning,
M. Laskin, H. Liu, X. B. Peng, D. Yarats, M. NYU, A. Rajeswaran, and P. Abbeel, “Contrastive intrinsic control for unsupervised reinforcement learning,” inProc. Adv. Neural Inf. Process. Syst., 2022, pp. 34 478– 34 491
2022
-
[23]
Visual cpg-rl: Learning central pattern generators for visually-guided quadruped locomotion,
G. Bellegarda, M. Shafiee, and A. Ijspeert, “Visual cpg-rl: Learning central pattern generators for visually-guided quadruped locomotion,” inProc. IEEE Int. Conf. Robot. Autom., 2024, pp. 1420–1427
2024
-
[24]
Morphological symme- tries in robotics,
D. O. Apraez, G. Turrisi, V . Kostic, M. Martin, A. Agudo, F. Moreno- Noguer, M. Pontil, C. Semini, and C. Mastalli, “Morphological symme- tries in robotics,”Int. J. Robot. Res., vol. 44, no. 10-11, pp. 1743–1766, 2025
2025
-
[25]
Leveraging symmetry in rl-based legged locomotion control,
Z. Su, X. Huang, D. O. Apraez, Y . Li, Z. Li, Q. Liao, G. Turrisi, M. Pontil, C. Semini, Y . Wuet al., “Leveraging symmetry in rl-based legged locomotion control,” inProc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2024, pp. 6899–6906
2024
-
[26]
Symmetry considerations for learning task symmetric robot policies,
M. Mittal, N. Rudin, V . Klemm, A. Allshire, and M. Hutter, “Symmetry considerations for learning task symmetric robot policies,” inProc. IEEE Int. Conf. Robot. Autom., 2024, pp. 7433–7439
2024
-
[27]
Prox- imal policy optimization algorithms,
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov, “Prox- imal policy optimization algorithms,”arXiv preprint arXiv:1707.06347, 2017
2017 arXiv
-
[28]
Mujoco: A physics engine for model- based control,
E. Todorov, T. Erez, and Y . Tassa, “Mujoco: A physics engine for model- based control,” inProc. IEEE/RSJ Int. Conf. Intell. Robots Syst., 2012, pp. 5026–5033
2012
-
[29]
A novel design methodology of cpg model for a salamander-like robot,
Y . Liu, Z. Liu, Y . Fang, H. Liu, and X. Guo, “A novel design methodology of cpg model for a salamander-like robot,”IEEE Robot. Autom. Lett., vol. 9, no. 7, pp. 6115–6122, 2024
2024
Reviewed August 3, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.