REVIEW 3 major objections 5 minor 52 references
Physics-Guided Biomechanical Gait Adaptation for Humanoid Locomotion on Extreme Sloped Terrains
T0 review · 3 major / 5 minor · reviewed 2026-07-10 · grok-4.5
Pith's one-line read A two-stage physics-guided training scheme produces a fully proprioceptive humanoid policy that walks continuous outdoor grass slopes up to 32.1° without collapsing into a crouched low-CoM gait.
desk verdict Solid engineering advance on under-served steep-slope humanoid locomotion; the outdoor 32° grass result is real, the soft-prior transfer story is the only soft link. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
HumoSlope: a two-stage framework whose Stage-I slope-adaptive ZMP regularizer (terrain-aligned deviation from a force-weighted support anchor) supplies a balance prior, and whose Stage-II Biomechanical Slope Gait Adapter (BSGA) gates CoM-height, hip/knee, and swing-leg soft rewards from a five-dimensional PCA terrain descriptor available only at training time.
What would settle it
Deploy the identical proprioceptive actor, trained without the BSGA reward gates or without the slope-adaptive ZMP term, on the same outdoor grass slope of measured grade ≥30°; if that ablated policy still completes continuous traversal while keeping mean CoM height comparable to the full model, the claimed necessity of the two-stage physics-guided adaptation is falsified.
Extended reading notes
Core claim
Generic model-free rewards for humanoid slope locomotion converge to an undesired low-center-of-mass crouched gait. HumoSlope prevents that degeneration by first installing a slope-adaptive ZMP regularizer evaluated on the local support plane, then using a privileged macroscopic terrain descriptor to gate soft biomechanical priors that modulate CoM height and lower-limb coordination. The resulting actor remains purely proprioceptive yet achieves continuous blind traversal of outdoor grass slopes up to 32.1° and simulated compound slopes up to 36°.
Load-bearing premise
A five-number PCA summary of a privileged height-scan patch, together with soft reward gates fitted from Stage-I rollouts, is rich enough that a purely proprioceptive actor can later walk unseen outdoor grass slopes without any online terrain sensing.
Editorial extensions
If this is right
- Humanoid policies trained with ordinary tracking-and-survival rewards will systematically prefer low-CoM crouches on continuous inclines unless the balance metric is evaluated on the local support plane.
- Training-time macroscopic slope descriptors can encode uphill/downhill joint-work asymmetry without requiring the deployed controller to carry cameras or depth sensors.
- Compound uphill–downhill tracks with friction tiers normalized to tan(θ) become a stricter and more informative benchmark than isolated constant ramps.
- Once the Stage-I balance prior exists, soft biomechanical gates alone are enough to convert a crouched warm-start into a faster, more upright slope gait.
Reading between the lines
- The same local-plane ZMP construction may transfer to other persistent gravitational biases such as walking under constant external force or on banked curves.
- If the PCA descriptor can be replaced by a short history of proprioceptive accelerations, the entire pipeline could become fully unsupervised with respect to height maps.
- Abrupt slope transitions will remain a failure mode until some form of look-ahead cue is added, exactly as the paper’s own limitations section anticipates.
- Peak knee-torque diagnostics from the ablations suggest that uncontrolled crouching is not merely aesthetic; it is a measurable overload that limits maximum grade.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper presents HumoSlope, a two-stage physics-guided RL framework for blind humanoid locomotion on continuous steep slopes. Stage I trains a proprioceptive actor–critic with a slope-adaptive ZMP regularizer that evaluates balance deviation on the local inclined support plane rather than a world-horizontal reference, producing a terrain-consistent balance prior. Stage II warm-starts from that actor and introduces the Biomechanical Slope Gait Adapter (BSGA), which uses a training-only five-dimensional PCA terrain descriptor (Eq. 1) extracted from height-scan patches to gate soft reward priors for slope-conditioned CoM height (Eq. 3), uphill/downhill lower-limb asymmetry (Eq. 4), and swing-hip guidance fitted from Stage-I rollouts (Eq. 5). The deployed actor remains purely proprioceptive. On held-out compound slope-track benchmarks the method reaches 77.1% success at 30° and a max grade of 36°, outperforming proprioceptive and one exteroceptive baseline; outdoor Unitree G1 demos show continuous traversal of grass slopes up to 32.1° with qualitative posture adaptation.
Significance. Continuous steep slopes are a distinct and under-studied regime for humanoid RL: they impose a persistent gravitational bias rather than discrete foothold selection, and generic rewards readily induce low-CoM “Groucho” gaits. The combination of a terrain-aligned ZMP prior with biomechanically motivated, descriptor-gated soft rewards is a concrete and transferable design pattern. Strengths include a held-out compound-track protocol with friction-tier normalization, three-checkpoint averaging, a full ablation suite (Table 2), biomechanical diagnostics (Fig. 5), and real outdoor video evidence on deformable grass. If the claimed transfer holds, the work supplies both a practical recipe for extreme-slope humanoid locomotion and a clear demonstration that physics- and biomechanics-informed reward shaping can mitigate posture degeneration without online exteroception.
major comments (3)
- [§4.2 Real-world experiments / Abstract] The headline outdoor claim (continuous blind traversal of grass slopes up to 32.1°) rests on qualitative figures (Figs. 1, 6) and narrative description. Unlike the simulation protocol (Table 1: three checkpoints × three friction tiers, SR/MXD/T_trav), the real-world section supplies no repeated-trial success rates, distance statistics, failure modes, or wetness/friction conditions. Because the load-bearing transfer argument is that Stage-II soft priors (Eqs. 3–5) remain informative once the privileged PCA descriptor is removed and the surface becomes deformable grass, quantitative outdoor metrics (or at least a clear statement of trial counts and observed failure modes) are needed to support the central claim at the strength asserted in the abstract.
- [§3.2 Eqs. (3)–(5); Table 2; Fig. 6] Table 2 shows that removing BSGA collapses SR to 0% at 20°, while Stage I alone retains 100% SR but with markedly lower CoM height and longer traversal time. This establishes necessity of BSGA in simulation, yet leaves open whether the fitted swing-hip trend (Eq. 5) and asymmetric CoM offsets (Eq. 3) are tuned to rigid sim geometry. A sensitivity or re-fit experiment (e.g., perturbing β0, β1 or b_up/b_down and re-evaluating both sim and real posture) would strengthen the causal link between the claimed physics-guided mechanism and the outdoor posture adaptation shown in Fig. 6.
- [§3.1 Slope-Adaptive ZMP Regularization] The slope-adaptive ZMP regularizer (Sec. 3.1) is a point-mass apparent-force surrogate with a contact-force-weighted support anchor. The paper correctly notes that a full ZMP/ZML formulation is noisy in massively parallel RL, but does not quantify how often the terrain-aligned intersection falls outside the actual support polygon or how sensitive r_ta_zmp is to the smoothing constant ε and scale σ_zmp. A short diagnostic (distribution of d_ta_zmp on steep segments, or ablation of the force-weighted anchor versus a simple mid-foot anchor) would make the Stage-I contribution more transparent and reproducible.
minor comments (5)
- [§3.2 / Implementation] Reward weights (w_com, w_bio, w_swing), ascent/descent offsets, and the PCA clip threshold θ_clip are free parameters listed only conceptually; a table or appendix of numerical values (and any tuning protocol) would aid reproducibility.
- [Fig. 5] Fig. 5 panels lack error bands or trial counts; given the three-checkpoint averaging used in Table 1, the same protocol should be stated for the biomechanical diagnostics.
- [§4.1 / Table 1] The friction-tier definition µ = tan(|θ|) + ∆ is clear, but the text should note whether the same tiers were used for the Max Grade sweep column of Table 1.
- [Eq. (1) and Eq. (4)] Minor notation: 1_up / 1_down appear both as indicators and as gating factors; a single sentence clarifying that they are binary regime flags would avoid ambiguity.
- [§2 Dynamic Balance] Related-work discussion of multi-contact ZMP/ZML (Caron et al., Brecelj & Petrič) is appropriate; a brief remark on why those geometric formulations were not used as hard constraints (rather than soft rewards) would help readers unfamiliar with the RL setting.
Circularity Check
No significant circularity: empirical two-stage RL method whose success metrics are external held-out tracks and real-world demos, not quantities forced by the Stage-I fits or soft priors.
full rationale
HumoSlope is an engineering RL pipeline (PPO actor-critic with asymmetric observations). Stage I adds a terrain-aligned ZMP deviation reward (point-mass surrogate on the local support plane estimated from stance foot); Stage II gates soft, low-weight biomechanical priors (CoM height target, hip/knee directional biases, swing hip-pitch reference) using a training-only 5-D PCA descriptor of the privileged height scan. The swing coefficients (Eq. 5) are fitted from Stage-I rollouts and used only as a soft training prior, not as a claimed first-principles prediction of an external observable. Performance claims (SR/MXD/Ttrav on held-out compound slope tracks up to 36°, real outdoor grass up to 32.1°) are measured against external environments and ablations that remove components; they are not recovered by construction from the fitted priors or the PCA definition. Biomechanical motivation cites independent human-locomotion literature. Minor co-author citations exist on unrelated topics and are not load-bearing for the slope claims. No self-definitional loop, no fitted quantity re-labeled as prediction, no uniqueness theorem imported from the authors, and no renaming of a known result. The derivation chain is therefore self-contained against external benchmarks.
Assumptions & free parameters
free parameters (4)
- BSGA reward weights (w_com, w_bio, w_swing) and ascent/descent offsets (b_up, b_down)
- Linear coefficients β0, β1 for swing-hip target (Eq. 5)
- ZMP deviation scale σ_zmp and support-anchor smoothing ε
- PCA clip threshold θ_clip and normalized slope intensity ρ_slope
assumptions (4)
- domain assumption Evaluating ZMP deviation on the local inclined support plane (rather than a world-horizontal plane) yields a terrain-consistent balance prior useful for RL.
- domain assumption Human uphill/downhill joint-work asymmetries (hip propulsion, knee braking) transfer as useful soft priors for a bipedal humanoid of different morphology.
- ad hoc to paper A five-dimensional PCA descriptor of a height-scan patch is a sufficient macroscopic slope cue for gating rewards and for the privileged critic.
- standard math PPO with asymmetric actor-critic and domain randomization is a valid optimization procedure for the claimed sim-to-real transfer.
invented entities (3)
-
HumoSlope two-stage framework
-
Biomechanical Slope Gait Adapter (BSGA)
-
Slope-adaptive ZMP regularizer (terrain-aligned d_zmp^ta)
Cite this review
Pith. "Pith review of Physics-Guided Biomechanical Gait Adaptation for Humanoid Locomotion on Extreme Sloped Terrains." pith.science (2026). https://pith.science/paper/V5KEN4WC
@misc{pith2026260707830,
author = {Pith},
title = {Pith review of: Physics-Guided Biomechanical Gait Adaptation for Humanoid Locomotion on Extreme Sloped Terrains},
year = {2026},
howpublished = {\url{https://pith.science/paper/V5KEN4WC}},
note = {Machine review of arXiv:2607.07830}
}
abstract
Model-free reinforcement learning has enabled impressive humanoid locomotion; however, control on steep slopes remains largely unexplored. Unlike flat or discrete terrains, sloped terrains impose a persistent gravitational bias that demands simultaneous stability and posture control. Consequently, under generic reward formulations, policies can converge to slow, conservative low-center-of-mass (CoM) crouched gaits. In this work, we propose a novel two-stage physics-guided framework, dubbed HumoSlope, dedicated to robust humanoid locomotion on diverse sloped terrains. Specifically, Stage I establishes a terrain-consistent balance prior by introducing a slope-adaptive Zero Moment Point (ZMP) regularizer evaluated directly on the local inclined support plane rather than a world-horizontal reference. To prevent the resulting policy from defaulting to a crouched posture, Stage II introduces the Biomechanical Slope Gait Adapter (BSGA). Utilizing extracted macroscopic terrain descriptors as privileged, training-only signals, BSGA dynamically gates soft reward priors to modulate CoM height and lower-limb coordination based on the estimated slope geometry -- encouraging hip-dominant uphill propulsion and knee-oriented downhill braking. Crucially, the deployed actor remains entirely proprioceptive, requiring no online exteroceptive sensing. Extensive Sim-to-Real experiments demonstrate that our framework effectively mitigates posture degeneration and enables blind, continuous traversal of outdoor grass slopes up to 62.7% ($32.1^\circ$), validating a physics-guided approach to challenging slope terrain adaptation.
Figures
Figures from the paper (3 more)
Reference graph
Works this paper leans on
- [1]
-
[2]
J. Hwangbo, J. Lee, A. Dosovitskiy, D. Bellicoso, V . Tsounis, V . Koltun, and M. Hutter. Learn- ing agile and dynamic motor skills for legged robots.Science robotics, 4(26):eaau5872, 2019
work page 2019
-
[3]
I. Radosavovic, T. Xiao, B. Zhang, T. Darrell, J. Malik, and K. Sreenath. Real-world humanoid locomotion with reinforcement learning.Science Robotics, 9(89):eadi9579, 2024
work page 2024
-
[4]
Blind Bipedal Stair Traversal via Sim-to-Real Reinforcement Learning
J. Siekmann, K. Green, J. Warila, A. Fern, and J. Hurst. Blind bipedal stair traversal via sim- to-real reinforcement learning.arXiv preprint arXiv:2105.08328, 2021
work page Pith review arXiv 2021
-
[5]
H. Wang, Z. Wang, J. Ren, Q. Ben, T. Huang, W. Zhang, and J. Pang. Beamdojo: Learning agile humanoid locomotion on sparse footholds.arXiv preprint arXiv:2502.10363, 2025
work page Pith review arXiv 2025
-
[6]
Z. Zhuang, S. Yao, and H. Zhao. Humanoid parkour learning.arXiv preprint arXiv:2406.10759, 2024
work page Pith review arXiv 2024
-
[7]
Learning Humanoid Locomotion over Challenging Terrain
I. Radosavovic, S. Kamat, T. Darrell, and J. Malik. Learning humanoid locomotion over chal- lenging terrain.arXiv preprint arXiv:2410.03654, 2024
work page Pith review arXiv 2024
-
[8]
Advancing Humanoid Locomotion: Mastering Challenging Terrains with Denoising World Model Learning
X. Gu, Y .-J. Wang, X. Zhu, C. Shi, Y . Guo, Y . Liu, and J. Chen. Advancing humanoid loco- motion: Mastering challenging terrains with denoising world model learning.arXiv preprint arXiv:2408.14472, 2024
work page Pith review arXiv 2024
Show all 52 references
-
[9]
H. Song, H. Zhu, T. Yu, Y . Liu, M. Yuan, W. Zhou, H. Chen, and H. Li. Gait-adaptive per- ceptive humanoid locomotion with real-time under-base terrain reconstruction.IEEE Robotics and Automation Letters, 2026
2026
-
[10]
Suliman, E
W. Suliman, E. Davydenko, E. Chaikovskaia, and R. Gorbachev. Reinforcement learning- based footstep control for humanoid robots on complex terrain.IEEE Access, 2025
2025
-
[11]
Unitree RL lab: Reinforcement learning implementation for unitree robots, based on IsaacLab, 2024
Unitree Robotics. Unitree RL lab: Reinforcement learning implementation for unitree robots, based on IsaacLab, 2024. URLhttps://github.com/unitreerobotics/unitree_rl_ lab
2024
-
[12]
T. A. McMahon, G. Valiant, and E. C. Frederick. Groucho running.Journal of applied physi- ology, 62(6):2326–2337, 1987
1987
-
[13]
X. B. Peng, G. Berseth, K. Yin, and M. Van De Panne. Deeploco: Dynamic locomotion skills using hierarchical deep reinforcement learning.Acm transactions on graphics (tog), 36(4): 1–13, 2017
2017
-
[14]
Vukobratovi ´c and J
M. Vukobratovi ´c and J. Stepanenko. On the stability of anthropomorphic systems.Mathemat- ical biosciences, 15(1-2):1–37, 1972
1972
-
[15]
W. Xie, C. Bai, J. Shi, J. Yang, Y . Ge, W. Zhang, and X. Li. Humanoid whole-body loco- motion on narrow terrain via dynamic balance and reinforcement learning. In2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 4751–4758. IEEE, 2025
2025
-
[16]
Vernillo, M
G. Vernillo, M. Giandolini, W. B. Edwards, J.-B. Morin, P. Samozino, N. Horvais, and G. Y . Millet. Biomechanics and physiology of uphill and downhill running.Sports Medicine, 47(4): 615–629, 2017
2017
-
[17]
T. J. Roberts and R. A. Belliveau. Sources of mechanical power for uphill running in humans. Journal of Experimental Biology, 208(10):1963–1970, 2005. 9
1963
-
[18]
A. E. Minetti, C. Moia, G. S. Roi, D. Susta, and G. Ferretti. Energy cost of walking and running at extreme uphill and downhill slopes.Journal of applied physiology, 2002
2002
-
[19]
K. Pearson. Liii. on lines and planes of closest fit to systems of points in space.The London, Edinburgh, and Dublin philosophical magazine and journal of science, 2(11):559–572, 1901
1901
-
[20]
Z. Xie, P. Clary, J. Dao, P. Morais, J. Hurst, and M. Panne. Learning locomotion skills for cassie: Iterative design and sim-to-real. InConference on Robot Learning, pages 317–329. PMLR, 2020
2020
-
[21]
Z. Li, X. B. Peng, P. Abbeel, S. Levine, G. Berseth, and K. Sreenath. Reinforcement learning for versatile, dynamic, and robust bipedal locomotion control.The International Journal of Robotics Research, 44(5):840–888, 2025
2025
-
[22]
Q. Ben, B. Xu, K. Li, F. Jia, W. Zhang, J. Wang, J. Wang, D. Lin, and J. Pang. Gallant: V oxel grid-based humanoid locomotion and local-navigation across 3d constrained terrains.arXiv preprint arXiv:2511.14625, 2025
2025
-
[23]
J. He, C. Zhang, F. Jenelten, R. Grandia, M. B ¨acher, and M. Hutter. Attention-based map encoding for learning generalized legged locomotion.Science Robotics, 10(105):eadv3604, 2025
2025
-
[24]
Agarwal, A
A. Agarwal, A. Kumar, J. Malik, and D. Pathak. Legged locomotion in challenging terrains using egocentric vision. InConference on robot learning, pages 403–415. PMLR, 2023
2023
-
[25]
J. Long, J. Ren, M. Shi, Z. Wang, T. Huang, P. Luo, and J. Pang. Learning humanoid locomo- tion with perceptive internal model. In2025 IEEE International Conference on Robotics and Automation (ICRA), pages 9997–10003. IEEE, 2025
2025
-
[26]
W. Sun, L. Chen, Y . Su, B. Cao, Y . Liu, and Z. Xie. Learning humanoid locomotion with world model reconstruction.arXiv preprint arXiv:2502.16230, 2025
2025 arXiv
-
[27]
Kumar, Z
A. Kumar, Z. Fu, D. Pathak, and J. Malik. Rma: Rapid motor adaptation for legged robots. arXiv preprint arXiv:2107.04034, 2021
2021 arXiv
-
[28]
Zhang, Y
Y . Zhang, Y . Seo, J. Chen, Y . Yuan, K. Sreenath, P. Abbeel, C. Sferrazza, K. Liu, R. Duan, and G. Shi. Rpl: Learning robust humanoid perceptive locomotion on challenging terrains.arXiv preprint arXiv:2602.03002, 2026
2026
-
[29]
Z. Gu, M. Yang, D. Zou, and D. Xu. Learning diffusion policy from primitive skills for robot manipulation.arXiv preprint arXiv:2601.01948, 2026
2026
-
[30]
Gu and L
Z. Gu and L. Wang. Limode: Rethinking lifelong robot manipulation from a mixture-of- dynamic-experts perspective.arXiv preprint arXiv:2606.26183, 2026
2026 arXiv
-
[31]
Sardain and G
P. Sardain and G. Bessonnet. Forces acting on a biped robot. center of pressure-zero moment point.IEEE Transactions on Systems, Man, and Cybernetics-Part A: Systems and Humans, 34 (5):630–637, 2004
2004
-
[32]
Z. Gu, J. Li, W. Shen, W. Yu, Z. Xie, S. McCrory, X. Cheng, A. Shamsah, R. Griffin, C. K. Liu, et al. Humanoid locomotion and manipulation: Current progress and challenges in control, planning, and learning.IEEE/ASME Transactions on Mechatronics, 31(2):2300–2330, 2026
2026
-
[33]
Kim, I.-W
J.-Y . Kim, I.-W. Park, and J.-H. Oh. Walking control algorithm of biped humanoid robot on uneven and inclined floor.Journal of intelligent and robotic systems, 48(4):457–484, 2007
2007
-
[34]
Seven, T
U. Seven, T. Akbas, K. C. Fidan, M. Yilmaz, and K. Erbatur. Humanoid robot walking control on inclined planes. In2011 IEEE International Conference on Mechatronics, pages 875–880. IEEE, 2011. 10
2011
-
[35]
Caron, Q.-C
S. Caron, Q.-C. Pham, and Y . Nakamura. Zmp support areas for multicontact mobility under frictional constraints.IEEE Transactions on Robotics, 33(1):67–80, 2016
2016
-
[36]
Brecelj and T
T. Brecelj and T. Petri ˇc. Zero moment line—universal stability parameter for multi-contact systems in three dimensions.Sensors, 22(15):5656, 2022
2022
-
[37]
R. C. Sheehan and J. S. Gottschall. At similar angles, slope walking has a greater fall risk than stair walking.Applied ergonomics, 43(3):473–478, 2012
2012
-
[38]
N. T. Pickle, A. M. Grabowski, A. G. Auyang, and A. K. Silverman. The functional roles of muscles during sloped walking.Journal of biomechanics, 49(14):3244–3251, 2016
2016
-
[39]
A. H. Dewolf, Y . Ivanenko, K. E. Zelik, F. Lacquaniti, and P. A. Willems. Kinematic patterns while walking on a slope at different speeds.Journal of Applied Physiology, 125(2):642–653, 2018
2018
-
[40]
R. W. Nuckols, K. Z. Takahashi, D. J. Farris, S. Mizrachi, R. Riemer, and G. S. Sawicki. Mechanics of walking and running up and downhill: A joint-level perspective to guide design of lower-limb exoskeletons.PloS one, 15(8):e0231996, 2020
2020
-
[41]
Papachatzis and K
N. Papachatzis and K. Z. Takahashi. Mechanics of the human foot during walking on different slopes.PLoS One, 18(9):e0286521, 2023
2023
-
[42]
X. B. Peng, P. Abbeel, S. Levine, and M. Van de Panne. Deepmimic: Example-guided deep re- inforcement learning of physics-based character skills.ACM Transactions On Graphics (TOG), 37(4):1–14, 2018
2018
-
[43]
C. Yao, C. Liu, L. Xia, M. Liu, and Q. Chen. Humanoid adaptive locomotion control through a bioinspired cpg-based controller.Robotica, 40(3):762–779, 2022
2022
-
[44]
J. Fang, Y . Jin, B. Wang, K. Zhou, M. Wang, and Z. Liu. Bio-inspired central pattern generator for adaptive gait generation and stability in humanoid robots on sloped surfaces.Biomimetics, 10(9):637, 2025
2025
-
[45]
Liang, Y
Y . Liang, Y . Zhao, and W. Yan. Terrain-adaptive bipedal locomotion via reinforcement learning with human-inspired stepping strategy. InInternational Conference on Intelligent Robotics and Applications, pages 624–636. Springer, 2025
2025
-
[46]
F. Jin, Y . Wang, P. Ma, G. Yang, P. Zhao, E. Li, and Z. Zhang. Teacher motion priors: Enhanc- ing robot locomotion over challenging terrain. In2025 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pages 1100–1107. IEEE, 2025
2025
-
[47]
Padulo, D
J. Padulo, D. Powell, R. Milia, and L. P. Ardig `o. A paradigm of uphill running.PloS one, 8 (7):e69006, 2013
2013
-
[48]
L. P. Kaelbling, M. L. Littman, and A. R. Cassandra. Planning and acting in partially ob- servable stochastic domains.Artificial Intelligence, 101(1):99–134, 1998. ISSN 0004-3702. doi:https://doi.org/10.1016/S0004-3702(98)00023-X. URLhttps://www.sciencedirect. com/science/arti...
1998 doi
-
[49]
˚Astr¨om
K. ˚Astr¨om. Optimal control of markov processes with incomplete state information.Jour- nal of Mathematical Analysis and Applications, 10(1):174–205, 1965. ISSN 0022-247X. doi:https://doi.org/10.1016/0022-247X(65)90154-X. URLhttps://www.sciencedirect. com/science/article/pii/...
1965 doi
-
[50]
Schulman, F
J. Schulman, F. Wolski, P. Dhariwal, A. Radford, and O. Klimov. Proximal policy optimization algorithms, 2017. URLhttps://arxiv.org/abs/1707.06347. 11
2017 arXiv
-
[51]
Mittal, P
M. Mittal, P. Roth, J. Tigue, A. Richard, O. Zhang, P. Du, A. Serrano-Mu ˜noz, X. Yao, R. Zurbr ¨ugg, N. Rudin, L. Wawrzyniak, M. Rakhsha, A. Denzler, E. Heiden, A. Borovicka, O. Ahmed, I. Akinola, A. Anwar, M. T. Carlson, J. Y . Feng, A. Garg, R. Gasoto, L. Gulich, Y . Guo, M...
2025 arXiv
-
[52]
Y . Seo, C. Sferrazza, H. Geng, M. Nauman, Z.-H. Yin, and P. Abbeel. Fasttd3: Simple, fast, and capable reinforcement learning for humanoid control.arXiv preprint arXiv:2505.22642, 2025. 12
2025 arXiv
Reviewed July 10, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.