REVIEW 5 major objections 4 minor 27 references
A Preliminary Study on A Physical Model Oriented Learning Algorithm with Application to UAVs
T0 review · 5 major / 4 minor · reviewed 2026-08-14 · deepseek-v4-flash
Pith's one-line read This paper proposes a physical-model-based learning algorithm that lets a target UAV improve its trajectory tracking by learning from other UAVs' flight errors in near real time, even when the UAVs differ in dynamics and reference path…
desk verdict A plausible ILC extension that stumbles on an unstated filter-sum condition in the main derivation; worth a referee but needs a fix. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing object is the unified learning signal of Eq. (21), $s_k=\Lambda_k^{-1}M_k^{-1}(\alpha_k\{s_k\}+L_k\{h_k\})$. Here $\Lambda_k$ is a diagonal scaling matrix that maps the target's reference trajectory onto the training UAV's reference, $M_k$ is a transfer-function matrix representing the dynamic mapping from the training UAV to the target UAV, $\alpha_k$ is a robust filter, and $L_k$ is the learning filter. The learning filter is chosen so that $\alpha_k I + F L_k \approx 0$, i.e., $L_k\approx \alpha_k F^{-1}$; this identity is what converts another UAV's tracking error into an approximately cancelling correction for the target. The convergence proof rests on the same style of condition used in robust iterative learning control: the weighted composite filter must have infinity norm below $1/N$ for $N$ training UAVs. Inserting the correction in the feedforward loop keeps stability of the target's tracking system unchanged.
What would settle it
Simulate the same tracking problem with two training UAVs and choose weights $\alpha_1=0.3$, $\alpha_2=0.4$ so that $\sum\alpha_k=0.7\neq1$. If the paper's convergence claim is exact, the target error should still collapse to the weighted combination; the derivation predicts a leftover $0.3\,T\{r_d\}$ term instead. Comparing the simulated error floor with this predicted residual directly settles whether the dropped term matters.
Extended reading notes
Core claim
The paper's central claim is that the target UAV's tracking error $h$ can be made to follow a weighted combination of training UAVs' errors $h_k$, rather than being driven by its own unlearned error. The unified learning algorithm uses $s_k=\Lambda_k^{-1}M_k^{-1}(\alpha_k\{s_k\}+L_k\{h_k\})$, where $\Lambda_k$ scales the target's reference path to the training UAV's scenario and $M_k$ maps the training UAV's open-loop dynamics to the target's. The paper derives $h\approx \sum_k \Lambda_k^{-1}M_k^{-1}(\alpha_k I+FL_k)\{h_k\}$ and designs the learning filters $L_k\approx \alpha_k F^{-1}$ so that each term $\alpha_k I+FL_k$ is small. Convergence is stated as an infinity-norm bound on the composite filters ($\|[\cdots]\|_\infty<1/N$ in the multi-UAV case), and because the learning signal enters only the feedforward path, it does not alter closed-loop stability. The numerical section shows the target tracking a sharp-turn reference with small overshoot while learning from a training UAV with different dynamics and a different reference.
Load-bearing premise
The derivation assumes that the target UAV's own tracking error, $T\{r_d\}$, cancels out of the final formula; that cancellation requires the learning weights to add to one, or that error to be zero, and the paper never states this requirement.
Editorial extensions
If this is right
- A fleet of UAVs with different airframes and different reference paths can pool their flight errors, so a new mission can be learned one sampling step before it begins instead of after many offline trials.
- Because the learning signal goes into the feedforward path, closed-loop stability is untouched; the only design check is the norm bound on the composite filters.
- The learning filter design has an explicit target, $L_k\approx \alpha_k F^{-1}$, so the algorithm is implementable whenever a model of the position loop's transfer function is available.
- The algorithm inherits iterative learning control's ability to reject repetitive tracking errors, but relaxes the requirement that the same task be repeated by the same system.
Reading between the lines
- The derivation between lines two and three of Eq. (11) drops the target's own baseline-error term $T\{r_d\}$; the final expression is exact only when $\sum\alpha_k=1$ or $T\{r_d\}=0$. The numerical example sets $\alpha_1=1$, which sidesteps the issue, but the general convergence claim depends on an unstated condition.
- The approximation $\|G\|\gg 1$, used to replace each training UAV's dynamics by the target's, becomes doubtful at frequencies where the position-control loop gain is not large; a Bode-magnitude comparison would show where the learning transfer guarantee should be restricted.
- A natural strengthening is to require the robust filters to satisfy $\sum_k\alpha_k=1$ (or to keep the residual term as an explicit disturbance), which would close the cancellation gap without changing the algorithm's structure.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes a feedforward learning algorithm for UAV trajectory tracking in which the learning signal is generated from the tracking errors and control signals of other ('training') UAVs. The claimed contribution is that, by explicitly using physical-model transformations (reference scaling matrices Lambda_k and dynamics-mapping matrices M_k), a target UAV can learn in near real time from training UAVs with different dynamics and different reference trajectories. Sections 3, 4, and 5 present formulations for heterogeneous scenarios, heterogeneous agents, and their unification, each followed by a numerical simulation; convergence is stated in terms of H-infinity norm conditions. The paper concludes that the algorithm demonstrates great learning efficiency and reliability.
Significance. The core idea is potentially useful: if the derivation were correct, it would turn ILC-style error updates into a one-shot, near-real-time transfer between different vehicles by using model knowledge to overcome heterogeneity. Algorithm 1 is concrete enough to implement, and the simulation plots in Figs. 3, 5, and 6 show plausible improvement over tracking without learning. However, the central error-propagation equations contain unstated cancellations and notational errors, and the numerical evidence is entirely qualitative. The contribution is incremental over the authors' prior ILC design [23], and the convergence conditions are not proved in this manuscript; the value of the paper is in the concept and preliminary demonstration rather than in a fully verified algorithm. No machine-checked proofs or reproducible code are provided, so the positive assessment rests on the analytic derivations, which currently require correction.
major comments (5)
- [Section 3, Eq. (11)] The step from the fourth displayed line to the fifth displayed line drops the term T{r_d} - sum_{k in Omega} Lambda_k^{-1} alpha_k T{Lambda_k r_d}. Since T is a diagonal LTI system and Lambda_k is a diagonal constant matrix, T{Lambda_k r_d} = Lambda_k T{r_d}, so the dropped term equals (1 - sum_k alpha_k) T{r_d}. Eq. (11) is therefore valid only if sum_k alpha_k = 1 or T{r_d} = 0, and this condition is not stated anywhere in Section 3 and is not included in the convergence condition (12). If it is not enforced, the actual target error contains the additional unlearned term (1 - sum_k alpha_k) T{r_d}, which can be large even when the H-infinity condition (12) holds. The numerical verification in Section 3.2 uses a single training UAV with alpha_1 = 1, so the missing condition is satisfied trivially and the flaw is invisible. This must be fixed by either imposing sum_k alpha_k = 1 as an explicit design constraint or carrying the residual term through the convergence analysis.
- [Section 4, Eq. (19)] The derivation of Eq. (19) is not valid as written. The substitution F{s_k} = h_k - T_k{r_d} requires F = F_k, while the text has only argued F_k approx F under ||G|| >> 1. In addition, the simplification of T{r_d} - sum M_k^{-1} alpha_k T_k{r_d} to zero requires both the approximation T_k approx T M_k and the same sum_k alpha_k = 1 condition from the previous comment; neither is stated. The displayed expression M^{-1}_k( sum_{k in Omega} alpha_k I + F L_k ){h_k} also has a free k on M^{-1}_k outside the sum, making the equation ill-formed. Please rewrite Eq. (19) with correct summation indices, state the approximations explicitly, and either impose sum_k alpha_k = 1 or include the residual terms in the convergence bound.
- [Section 2, Eq. (6)] From Eq. (5), alpha_k I + F L_k approx 0, the implied learning filter is L_k approx -alpha_k F^{-1}, not L_k approx alpha_k F^{-1} as written in Eq. (6). The missing negative sign would change the sign of the feedforward correction and, if implemented as printed, would amplify rather than cancel the error. Please correct Eq. (6) and state which sign is actually used in the numerical simulations.
- [Sections 3-5, Eqs. (12), (20), (23)] The convergence conditions are stated by reference to prior work [23] with the phrase 'designed such that the above condition is satisfied [23]', but no proof is given that the stated H-infinity condition bounds the target error in the heterogeneous multi-UAV setup. The conditions are derived from the error-propagation equations (11), (19), and (22), which currently contain the unstated cancellations described above. A self-contained proof, or a precise statement of how [23] applies after the added transformation matrices Lambda_k and M_k, is necessary to support the central convergence claim.
- [Sections 3.2, 4.2, and 5] The numerical studies report only qualitative statements such as 'very small overshoot and oscillations' and show trajectory plots without quantitative error metrics. No tracking-error norms, overshoot percentages, or comparisons with a no-learning baseline are provided. Since the central claim is a quantitative error-reduction property, the paper should report quantitative performance measures for the target UAV with and without the proposed learning signal.
minor comments (4)
- [Section 5, Eq. (21)] Eq. (21) uses the symbol s_k on both sides of the definition; the training UAV's stored learning signal and the contribution sent to the target UAV should be distinguished notationally.
- [Algorithm 1] The input list 'F_1, F_2, ..., F_k, F' is ambiguous because k is used both as a running index and as the last index; use explicit maximum index N or a different letter.
- [Throughout] There are typographical errors including 'scearios' in Section 2, 'feedforward look' in Section 4, and 'quad-robot' in Section 4; these should be corrected.
- [Figure 4] The Bode plot figure would benefit from clearer labeling of which subplot corresponds to which input-output channel and from a legend identifying the training versus target UAV consistently across all subplots.
Circularity Check
No circularity: the learning signal derivation is a control-design identity with explicit norm conditions; the algebraic gap at Eq. (11) and the self-citations are correctness or citation issues, not reductions by construction.
full rationale
The paper's central derivation is an algebraic rearrangement of the plant relation h=T{rd}+F{s} with the learning signal s defined in Eq. (7). The target error is expressed as a weighted sum of the training UAV errors, and the convergence conditions (12), (20), and (23) are explicit norm bounds on the coefficient operators in that sum. This is a control-design derivation, not a prediction fitted to data: the filters α_k and L_k are chosen from the model F, not estimated from the h_k, and the numerical studies simulate the resulting closed loop rather than claiming an independent empirical forecast. The citations to the authors' prior ILC design [23] and model-based learning [26] motivate the filter design and the LTI assumption, but the convergence condition is stated in the paper itself and does not depend on a self-citation for its mathematical content. There is a genuine correctness gap in the derivation of Eq. (11): the term T{rd}−Σ_k Λ_k^{-1}α_k T{Λ_k rd} is dropped, which is valid only if Σα_k=1 (or T{rd}=0); this is an unstated algebraic assumption that makes the convergence guarantee incomplete, but it is not a circular step because the final expression is not assumed as an input—it is derived, albeit incorrectly. Likewise, the approximations in Section 4 (||G||≫1 leading to F_k≈F) are modeling assumptions, not circular inputs. No pattern of self-definition, fitted-input-as-prediction, or author-imported uniqueness applies, so the circularity score is 0.
Assumptions & free parameters
assumptions (5)
- domain assumption The position control loop of the UAV is a linear time-invariant system, with attitude dynamics ignored.
- domain assumption The position dynamics and scaling matrices are diagonal/decoupled.
- domain assumption The open-loop gain is large, so T ≈ G^{-1} and F_k ≈ F.
- domain assumption Exact dynamics mapping M_k such that G = M_k G_k is known.
- ad hoc to paper Cancellation of the target's own error term, i.e., T{rd} - Σ α_k T{rd} = 0, is implicitly assumed.
Cite this review
Pith. "Pith review of A Preliminary Study on A Physical Model Oriented Learning Algorithm with Application to UAVs." pith.science (2026). https://pith.science/paper/DUI3URKC
@misc{pith2026190803478,
author = {Pith},
title = {Pith review of: A Preliminary Study on A Physical Model Oriented Learning Algorithm with Application to UAVs},
year = {2026},
howpublished = {\url{https://pith.science/paper/DUI3URKC}},
note = {Machine review of arXiv:1908.03478}
}
read the original abstract
This paper provides a preliminary study for an efficient learning algorithm by reasoning the error from first principle physics to generate learning signals in near real time. Motivated by iterative learning control (ILC), this learning algorithm is applied to the feedforward control loop of the unmanned aerial vehicles (UAVs), enabling the learning from errors made by other UAVs with different dynamics or flying in different scenarios. This learning framework improves the data utilization efficiency and learning reliability via analytically incorporating the physical model mapping, and enhances the flexibility of the model-based methodology with equipping it with the self-learning capability. Numerical studies are performed to validate the proposed learning algorithm.
Reference graph
Works this paper leans on
-
[23]
Design of arbitrary-order robust iterative learning control based on robust control theory,
M. Zheng, C. Wang, L. Sun, and M. Tomizuka, “Design of arbitrary-order robust iterative learning control based on robust control theory,” Mechatronics, vol. 47, pp. 67–76, 2017
work page 2017
-
[1]
Survey of unmanned aerial vehicles (uavs) for traffic monitoring,
K. Kanistras, G. Martins, M. J. Rutherford, and K. P. Valavanis, “Survey of unmanned aerial vehicles (uavs) for traffic monitoring,” in Handbook of unmanned aerial vehicles. Springer, 2015, pp. 2643–2666
work page 2015
-
[2]
Unmanned aerial vehicle scheduling problem for traffic monitoring,
M. Li, L. Zhen, S. Wang, W. Lv, and X. Qu, “Unmanned aerial vehicle scheduling problem for traffic monitoring,” Computers & Industrial Engineering, 2018
work page 2018
-
[3]
X. Liang, “Image-based post-disaster inspection of rein- forced concrete bridge systems using deep learning with bayesian optimization,” vol. 34, no. 5. Wiley Online Library, 2019, pp. 415–430
work page 2019
-
[4]
S. O. Sajedi and X. Liang, “A convolutional cost-sensitive crack localization algorithm for automated and reliable rc bridge inspection,” New York City, NY , August 26-27, 2019
work page 2019
-
[5]
Simulation- based data-driven damage detection for highway bridge systems,
X. Liang, K. Mosalam, and S. Muin, “Simulation- based data-driven damage detection for highway bridge systems,” in The 11th National Conference on Earthquake Engineering (11NCEE) , Los Angeles, CA, June 25-29, 2018
work page 2018
-
[6]
Intensity-based feature selection for near real-time damage diagnosis of building structures,
S. O. Sajedi and X. Liang, “Intensity-based feature selection for near real-time damage diagnosis of building structures,” New York City, NY , September 4-6, 2019
work page 2019
-
[7]
Cooperative control of uavs for search and coverage,
A. Ahmadzadeh, G. Buchman, P. Cheng, A. Jadbabaie, J. Keller, V . Kumar, and G. Pappas, “Cooperative control of uavs for search and coverage,” inProceedings of the AUVSI conference on unmanned systems, vol. 2, 2006
work page 2006
Show all 27 references
-
[8]
A uav search and rescue scenario with human body detection and geolocalization,
P. Doherty and P. Rudol, “A uav search and rescue scenario with human body detection and geolocalization,” in Australasian Joint Conference on Artificial Intelligence. Springer, 2007, pp. 1–13
2007
-
[9]
Supporting wilderness search and rescue using a camera-equipped mini uav,
M. A. Goodrich, B. S. Morse, D. Gerhardt, J. L. Cooper, M. Quigley, J. A. Adams, and C. Humphrey, “Supporting wilderness search and rescue using a camera-equipped mini uav,” Journal of Field Robotics , vol. 25, no. 1-2, pp. 89– 110, 2008
2008
-
[10]
Imitation learning: A survey of learning methods,
A. Hussein, M. M. Gaber, E. Elyan, and C. Jayne, “Imitation learning: A survey of learning methods,” ACM Computing Surveys (CSUR), vol. 50, no. 2, p. 21, 2017
2017
-
[11]
Controller design for quadrotor uavs using reinforcement learning,
H. Bou-Ammar, H. V oos, and W. Ertel, “Controller design for quadrotor uavs using reinforcement learning,” in 2010 IEEE International Conference on Control Applications , Sept 2010, pp. 2130–2135
2010
-
[12]
Learning deep control policies for autonomous aerial vehicles with mpc-guided policy search,
T. Zhang, G. Kahn, S. Levine, and P. Abbeel, “Learning deep control policies for autonomous aerial vehicles with mpc-guided policy search,” in Robotics and Automation (ICRA), 2016 IEEE International Conference on . IEEE, 2016, pp. 528–535
2016
-
[13]
Inverse reinforcement learning control for trajectory tracking of a multirotor uav,
S. Choi, S. Kim, and H. J. Kim, “Inverse reinforcement learning control for trajectory tracking of a multirotor uav,” International Journal of Control, Automation and Systems, vol. 15, no. 4, pp. 1826–1834, 2017
2017
-
[14]
Cellular- connected uavs over 5g: Deep reinforcement learning for interference management,
U. Challita, W. Saad, and C. Bettstetter, “Cellular- connected uavs over 5g: Deep reinforcement learning for interference management,” arXiv preprint arXiv:1801.05500, 2018
2018 arXiv
-
[15]
Survey of model- based reinforcement learning: Applications on robotics,
A. S. Polydoros and L. Nalpantidis, “Survey of model- based reinforcement learning: Applications on robotics,” Journal of Intelligent & Robotic Systems, vol. 86, no. 2, pp. 153–173, 2017
2017
-
[16]
Learning control in robotics,
S. Schaal and C. G. Atkeson, “Learning control in robotics,”IEEE Robotics & Automation Magazine, vol. 17, no. 2, pp. 20–29, 2010
2010
-
[17]
Minimum snap trajectory generation and control for quadrotors,
D. Mellinger and V . Kumar, “Minimum snap trajectory generation and control for quadrotors,” in Robotics and Automation (ICRA), 2011 IEEE International Conference on. IEEE, 2011, pp. 2520–2525
2011
-
[18]
H-infinity based disturbance observer design for non-minimum phase systems with application to uav attitude control,
X. Lyu, M. Zheng, and F. Zhang, “H-infinity based disturbance observer design for non-minimum phase systems with application to uav attitude control,” in 2018 American Control Conference, 2018
2018
-
[19]
A disturbance observer approach with online q-filter tuning for position control of quadcopters,
S. Mishra and W. Zhang, “A disturbance observer approach with online q-filter tuning for position control of quadcopters,” in American Control Conference (ACC),
-
[20]
Feedforward control design for a four-rotor uav using direct and indirect methods,
T. Gruning, A. Rauh, and H. Aschemann, “Feedforward control design for a four-rotor uav using direct and indirect methods,” in Methods and Models in Automation and Robotics (MMAR), 2012 17th International Conference on. IEEE, 2012, pp. 439–444
2012
-
[21]
Optimization-based iterative learning for precise quadro- copter trajectory tracking,
A. P. Schoellig, F. L. Mueller, and R. DAndrea, “Optimization-based iterative learning for precise quadro- copter trajectory tracking,” Autonomous Robots , vol. 33, no. 1-2, pp. 103–127, 2012
2012
-
[22]
An iterative learning scheme for high performance, periodic quadrocopter trajectories,
M. Hehn and R. D’Andrea, “An iterative learning scheme for high performance, periodic quadrocopter trajectories,” in Control Conference (ECC), 2013 European . IEEE, 2013, pp. 1799–1804
2013
-
[24]
A systematic design framework for iterative learning control with current feedback,
M. Zheng, F. Zhang, and X. Liang, “A systematic design framework for iterative learning control with current feedback,” IFAC Journal of Systems and Control , vol. 5, pp. 1–10, 2018
2018
-
[25]
Robust iterative learning control for vibration suppression of industrial robot manipulators,
C. Wang, M. Zheng, Z. Wang, C. Peng, and M. Tomizuka, “Robust iterative learning control for vibration suppression of industrial robot manipulators,” Journal of Dynamic Systems, Measurement, and Control , vol. 140, no. 1, p. 011003, 2018
2018
-
[26]
A scalable model- based learning algorithm with application to uavs,
X. Liang, M. Zheng, and F. Zhang, “A scalable model- based learning algorithm with application to uavs,” IEEE Control Systems Letters, 2018
2018
-
[2017]
3593–3598
IEEE, 2017, pp. 3593–3598
2017
Reviewed August 14, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.