REVIEW 4 major objections 5 minor 17 references
Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training
T0 review · 4 major / 5 minor · reviewed 2026-08-01 · deepseek-v4-flash
Pith's one-line read In compact unified models, prediction and planning compete for the same weights; the paper shows that training them on disjoint parameter regions and then sparsely merging the top 1% of each task's changes resolves the conflict and roughly
desk verdict Solid, well-documented empirical method for compact prediction/planning; the 'skill conflict' story needs a random-mask control before I'd fully buy it. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The load-bearing objects are the task vector τ_t = Θ_t − Θ_0, the binary activation mask M_t^(K) that selects top-K coordinates by magnitude, and the alternating DPT loop that grows disjoint masks from unassigned parameters. The merge formula Θ_merged = Θ_0 + M_pred^(K%) ⊙ τ_pred + M_plan^(K%) ⊙ τ_plan is the single operation that does the work: disjoint masks guarantee spatial separation of core skills, while the 1% sparsity filters out low-magnitude adjacent-feature coupling that would otherwise cause cross-task interference. The paper also uses the Overlap(K) metric (coordinate-wise AND of the two masks) as the diagnostic and the controlled-overlap experiment as the causal test.
What would settle it
Replace the top-K gradient selection in Algorithm 1 with random selection of the same mask sizes on JRDB; if the random-mask DPT still delivers the reported ADE/collision gains, then magnitude saliency is not the cause — and if the controlled-overlap Table 5 trend disappears under random masks, Skill Conflict is not the mechanism.
Extended reading notes
Core claim
The paper's central discovery is a mechanism, not just a method: when prediction and planning are trained in a compact shared encoder, the top-magnitude parameter regions that each task needs overlap heavily (8% overlap at 10% utilization, 39% at 50%), and this overlap is causally tied to degraded joint performance. DPT prevents the overlap by construction: during the first half of fine-tuning, the algorithm alternately selects the top-K unassigned parameters by gradient magnitude, assigns them exclusively to one task via a binary mask, and updates only those; in the second half the masks freeze and each task consolidates. Sparse Merging then combines the two models as Θ_merged = Θ_0 + M_pre
Load-bearing premise
The load-bearing premise is that a task's 'core skill' is captured by the parameters with the largest gradient magnitudes during alternating training, so that freezing 99% of the model in sparse merging discards only irrelevant weights; if a task's information is broadly distributed or lives in low-magnitude co-adapting coordinates, the disjoint-top-K recipe would throw away needed capability.
Editorial extensions
If this is right
- DPT is orthogonal to the merging rule: adding it to Task Arithmetic, Ties Merging, and T-Switch consistently improves both planning and prediction on JRDB and JTA, so merging methods designed for large models can be rescued for compact models by changing how material models are trained.
- Sparse merging is not a detail: K=1–2% consistently beats dense merging (K=100%) and moderate sparsity, implying that in compact encoders each task's transferable skill lives in a narrow coordinate set.
- Because the merged model is a single network with no added inference branches, it keeps edge compatibility: roughly 6.4M parameters, 10.4 ms latency, 24.6 MB model size, and 1.96 MB inference memory on an RTX 3090.
- An optional joint-reasoning fine-tuning stage on the unassigned parameter regions recovers the benefit of unified reasoning (ADE 0.3640, collision 0.0074) without sacrificing the disjoint skill separation.
- The same recipe transfers beyond social navigation: applying DPT and sparse merging to an end-to-end autonomous driving model improved closed-loop and open-loop planning/perception metrics on Bench2Drive.
Reading between the lines
- If the magnitude-saliency premise is right, a testable extension follows: DPT should combine cleanly with post-training compression — pruning or quantizing the merged model's low-magnitude coordinates should cost little, because the skill was already concentrated in the top 1%.
- The overlap diagnostic could be used as a cheap predictor before committing to DPT: compute the two top-K masks from a standard fine-tuned pair; if Overlap(K) is high, switching to disjoint training should help, and the expected gain should scale with the measured overlap.
- The paper's framing suggests Skill Conflict is a general resource-constrained multi-task phenomenon, not just prediction-vs-planning: their own three-way split of prediction shows conflicts within a single task; one could extend DPT to more tasks, with the caveat that the 'sweet spot' tradeoff between specialization and capacity-sharing will need a principled allocation rule.
- Because the merge formula is a simple arithmetic identity on masks and task vectors, it is architecture-agnostic; one could transfer it to other compact multi-task models (e.g., embedded vision-language-action policies) provided the top-K gradient premise holds there.
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper addresses the problem of jointly performing motion prediction and motion planning in compact, shared-encoder models for social robot navigation. It identifies a phenomenon called "Skill Conflict": when the top-magnitude parameter regions used by the two tasks overlap, joint performance degrades. It provides empirical evidence for this via mask-ratio sweeps (Fig. 2), parameter-overlap visualizations (Fig. 3), and a forced-overlap experiment (Supp. Tab. 5). As a remedy, the paper proposes Disjoint Parameter Training (DPT), which trains each task on disjoint, progressively grown top-gradient-magnitude masks (Algorithm 1), followed by Sparse Merging, which keeps only the top 1% of each task vector by magnitude (Eq. 10). The paper claims large improvements over existing unified models and merging baselines on JRDB and JTA (e.g., planning ADE 0.8048→0.4044 vs. DIPP, collision rate 0.0167→0.0091), with a further joint-reasoning stage improving to 0.3640 ADE and 0.0074 collision rate. The central claim is that the gains come from preserving each task's "core skill" in a narrow set of high-magnitude parameters while suppressing cross-task interference.
Significance. If the mechanism is valid, the paper makes a practically relevant contribution: it gives one of the first systematic studies of parameter-level interference in compact unified prediction-planning models and proposes a training/merging recipe that could improve edge-deployable robot navigation. The empirical work is unusually thorough: replicate the overlap phenomenon on DTPP, provide seed and schedule sensitivity analyses, extend DPT to HiP-AD/E2E-AD, and report inference cost (10.4 ms, 6.44M params), which supports the resource-constrained motivation. The main weakness is that the causal interpretation is not yet fully isolated from the magnitude-saliency proxy shared by the diagnostic, the causal experiment, and the remedy. This is a correctness-risk concern rather than a circularity in the performance claims, because the final metrics are external and the forced-overlap experiment gives some causal grounding. The requested additional controls would determine whether the mechanism is specifically "core-skill preservation" as opposed to a more generic sparsity/regularization effect.
major comments (4)
- [Sec. 3.4–3.5, Supp. Sec. 6.4 (Tab. 5)] The mechanistic interpretation is not validated independently of the magnitude-based selection. Algorithm 1 selects top-K coordinates by |gradient|, Eq. (10) keeps top-K task-vector entries by magnitude, and Supp. Tab. 5 forces overlap only among masks that were themselves chosen by gradient magnitude. This does not test whether magnitude identifies task-critical parameters. The observed gains could stem from generic sparse-mask regularization, from disjointness, or from DPT-specific hyperparameters rather than from preserving 'core' coordinates. Please add a random-mask control: run DPT with randomly selected masks of the same size and schedule, and merge random 1% subsets of task vectors. If magnitude selection is load-bearing, these controls should be clearly worse on the same metrics. This should also be applied to the diagnostic, since the overlap metric (Eq. 9) and the remedy share
- [Sec. 3.5, Table 3] The text states that Sparse Merging 'consistently outperforms dense merging (K=100%) and moderately sparse configurations (e.g., K=10%)', but Table 3 stops at K=40, so the dense-merging comparison is missing. Because sparsity is the second half of the remedy, please report K=100% (and ideally intermediate values such as 60–80%) under the same DPT settings. Also, the accompanying claim that K=2 is 'best overall across all metrics' is inaccurate: in Table 3, K=1 has a lower collision rate (0.0091 vs. 0.0096), so the sentence should be rephrased to reflect the small non-monotonicity.
- [Sec. 4.2, Table 1] The interpretation of the upper rows of Table 1 is unclear. The text says Plan/Pred Finetune 'performance remains largely unchanged even with DPT', but the table shows large swings in the cross-task metrics, e.g., Plan Finetune has prediction ADE 1.9825 while Plan Finetune + DPT has 0.7368, and Pred Finetune planning ADE changes from 0.8889 to 0.8469. It is not stated whether these rows are single-task fine-tuned models evaluated with both heads, merged models, or something else. Please specify exactly which parameters are trained and what is evaluated, since this affects the claim that DPT preserves each task's inherent capability and the interpretation of DPT's compatibility with other merging methods.
- [Sec. 4.2 (Effect of Adding Joint Reasoning)] The joint-reasoning stage is used to obtain the best numbers in Table 4 (DPT + SM + JR), but its description is only two sentences: a fine-tuning stage with a joint task loss on 'parameter regions that remain inactive after DPT and Sparse Merging'. The loss definition, learning rate, number of epochs, whether masks are frozen, and which specific parameter regions are updated are not given either in the main text or in the supplementary implementation details. Please provide these details, since this stage is part of the headline result.
minor comments (5)
- [Algorithm 1, Eq. (8)–(10)] The symbol K is overloaded: in Algorithm 1 it denotes the per-step mask size, while in Eq. (8)–(10) it denotes the Sparse Merging mask ratio. This creates confusion when both are discussed in the same section. Use distinct notation (e.g., K_dpt and K_sm).
- [Figure captions] Several figure captions contain internal version/date strings that should be removed: Fig. 4 'Final Ver_251114_1853', Fig. 6 '251113 22:01', and Supp. Fig. 1 '2511191603'.
- [Sec. 4.1, Table 4] The comparison against DIPP and DTPP does not state whether these baselines were re-trained under the same data splits and training protocol or taken from official checkpoints. Without this, differences in preprocessing or training budget may confound the architecture comparison.
- [Eq. (9)] The quantity D is defined as the number of parameters activated by at least one task, which is itself a function of K. This notation is easy to confuse with dataset size or embedding dimension; rename it (e.g., N_union) and state the dependence on K explicitly.
- [Sec. 4.2, Table 1] Minor wording issue: 'the fact that their performance remains largely unchanged even with DPT' does not match the large cross-task improvements in the table. Even if the intended meaning is 'single-task capability is preserved', the sentence should be rewritten to avoid the contradiction.
Circularity Check
No significant circularity: the shared top-K magnitude assumption is a validation gap, not a constructional equivalence, and headline results are externally benchmarked.
full rationale
After walking the derivation chain, I find no step where a claimed prediction or explanation reduces by construction to an input. The Skill Conflict diagnostic (Eq. 9) measures coordinate-wise overlap of top-K magnitude masks, and Sparse Merging (Eq. 10) selects the same top-K coordinates, so the diagnosis and remedy share the magnitude-saliency assumption. But sharing an assumption is not circular equivalence: the forced-overlap experiment (Supp. Sec. 6.4, Tab. 5) manipulates overlap while holding training settings fixed and observes benchmark performance changes, and all headline numbers (Tab. 1, Tab. 4) are measured on JRDB/JTA, not derived from Eq. 9 or Eq. 10. The strongest concern, that no random-mask control validates gradient magnitude as task-critical, is an internal validation gap about the saliency proxy, not a constructional equivalence; the paper's explicit scope limitations (Supp. Sec. 6.2, Sec. 10) acknowledge capacity/settings limits rather than conceal a fitted-parameter-as-prediction step. No load-bearing self-citation or imported uniqueness theorem appears: references to the authors' prior work (refs. 26, 27, 40) are contextual. Score 0.
Assumptions & free parameters
free parameters (5)
- Sparse Merging mask ratio K =
1% (swept 1-40%; best around 1-2%)
- DPT allocation ratio (plan:pred) =
50:50 (swept 90:10 to 10:90)
- DPT mask growth:frozen schedule =
1:1 (swept 1:3, 1:1, 3:1)
- DPT learning rates per task =
planner 5e-6, predictor 2e-6 (JRDB); both 1e-5 (JTA)
- Collision cost hyperparameters λ_col, τ, ε =
not reported
assumptions (5)
- domain assumption Task vectors τ_t = Θ_t - Θ_0 additively encode task-specific skills in compact transformers.
- ad hoc to paper Top-K gradient/task-vector magnitude selects the task-critical parameters.
- domain assumption A single game-theoretically pretrained Θ0 retains both task capabilities and serves as a common initialization.
- ad hoc to paper Sparse merging with K≈1-2% preserves each task's core skill while suppressing interference.
- domain assumption Offline JRDB/JTA metrics measured against ground-truth future trajectories are valid proxies for safe crowd navigation.
invented entities (1)
-
Skill Conflict
Cite this review
Pith. "Pith review of Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training." pith.science (2026). https://pith.science/paper/P56HPZOS
@misc{pith2026260719971,
author = {Pith},
title = {Pith review of: Unified Prediction and Planning via Conflict-Aware Disjoint Parameter Training},
year = {2026},
howpublished = {\url{https://pith.science/paper/P56HPZOS}},
note = {Machine review of arXiv:2607.19971}
}
abstract
Accurate motion prediction of surrounding agents and safe motion planning are two closely coupled key tasks for social robot navigation in crowded environments. Deploying these systems on resource-constrained edge devices necessitates compact, unified models that can perform both tasks simultaneously. However, within these compact shared encoders, recent unified models often overlook severe representational conflicts that arise from the distinct objectives of predicting neighbor behaviors versus ego-centric safety planning. To address this issue, we first identify the Skill Conflict$\unicode{x2014}$a phenomenon where overlapping parameter assignments cause distinct tasks to compete for the same weights, preventing the model from fully specializing in individual skills. To resolve this, we propose a novel model-merging-based framework, Disjoint Parameter Training (DPT). DPT mitigates performance degradation caused by Skill Conflict through distributed parameter learning, which separates the key parameter regions of each task while preserving their core capabilities prior to merging. In addition, we observe that sparse merging, which selectively integrates only the most influential parameters for each task rather than combining all task-specific parameters, yields optimal performance by preventing interference among adjacent features and concentrating representational capacity. DPT can be applied in parallel with a variety of merging methods. Evaluated on standard crowd navigation benchmarks (JRDB and JTA), our framework demonstrates superior performance, validating its versatility and effectiveness for safe, resource-efficient robot navigation.
Figures
Figures from the paper (10 more)
Reference graph
Works this paper leans on
-
[1]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Hu, Y., Yang, J., Chen, L., Li, K., Sima, C., Zhu, X., Chai, S., Du, S., Lin, T., Wang, W., et al.: Planning-oriented autonomous driving. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 17853– 17862 (2023)
2023
-
[2]
In: 2024 IEEE International Conference on Robotics and Automation (ICRA)
Huang, Z., Karkus, P., Ivanovic, B., Chen, Y., Pavone, M., Lv, C.: DTPP: Differ- entiable joint conditional prediction and cost evaluation for tree policy planning in autonomous driving. In: 2024 IEEE International Conference on Robotics and Automation (ICRA). pp. 6806–6812. IEEE (2024)
2024
-
[3]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Huang, Z., Liu, H., Lv, C.: GameFormer: Game-theoretic modeling and learning of transformer-based interactive prediction and planning for autonomous driving. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 3903–3913 (2023)
2023
-
[4]
Advances in Neural Information Processing Systems37, 819–844 (2024)
Jia, X., Yang, Z., Li, Q., Zhang, Z., Yan, J.: Bench2Drive: Towards multi-ability benchmarking of closed-loop end-to-end autonomous driving. Advances in Neural Information Processing Systems37, 819–844 (2024)
2024
-
[5]
In: The Thirteenth International Conference on Learning Representations (2025)
Jia, X., You, J., Zhang, Z., Yan, J.: DriveTransformer: Unified transformer for scal- able end-to-end autonomous driving. In: The Thirteenth International Conference on Learning Representations (2025)
2025
-
[6]
In: Proceedings of the IEEE/CVF International Conference on Computer Vi- sion
Jiang,B.,Chen,S.,Xu,Q.,Liao,B.,Chen,J.,Zhou,H.,Zhang,Q.,Liu,W.,Huang, C., Wang, X.: VAD: Vectorized scene representation for efficient autonomous driv- ing. In: Proceedings of the IEEE/CVF International Conference on Computer Vi- sion. pp. 8340–8350 (2023)
2023
-
[7]
In: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
Kedia, K., Dan, P., Choudhury, S.: A game-theoretic framework for joint fore- casting and planning. In: 2023 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). pp. 6773–6778. IEEE (2023)
2023
-
[8]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision
Lee, G., Jeong, W., Park, D., Jeong, J., Yoon, K.J.: Interaction-merged motion planning: Effectively leveraging diverse motion datasets for robust planning. In: Proceedings of the IEEE/CVF International Conference on Computer Vision. pp. 28610–28621 (2025)
2025
Show all 17 references
-
[9]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Liao, B., Chen, S., Yin, H., Jiang, B., Wang, C., Yan, S., Zhang, X., Li, X., Zhang, Y., Zhang, Q., et al.: DiffusionDrive: Truncated diffusion model for end-to-end autonomous driving. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 1...
2025
-
[10]
Advances in Neural Information Processing Systems34, 18878–18890 (2021)
Liu, B., Liu, X., Jin, X., Stone, P., Liu, Q.: Conflict-averse gradient descent for multi-task learning. Advances in Neural Information Processing Systems34, 18878–18890 (2021)
2021
-
[11]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Qi, B., Li, F., Wang, Z., Gao, J., Li, D., Ye, P., Zhou, B.: Less is more: Effi- cient model merging with binary task switch. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 15265–15274 (2025) 38 Seo et al
2025
-
[12]
In: The Twelfth International Conference on Learning Representations (2024)
Saadatnejad, S., Gao, Y., Messaoud, K., Alahi, A.: Social-Transmotion: Prompt- able human trajectory prediction. In: The Twelfth International Conference on Learning Representations (2024)
2024
-
[13]
In: 2025 IEEE International Conference on Robotics and Automation (ICRA)
Sun, W., Lin, X., Shi, Y., Zhang, C., Wu, H., Zheng, S.: SparseDrive: End-to-end autonomous driving via sparse scene representation. In: 2025 IEEE International Conference on Robotics and Automation (ICRA). pp. 8795–8801. IEEE (2025)
2025
-
[14]
In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)
Tang, Y., Xu, Z., Meng, Z., Cheng, E.: HiP-AD: Hierarchical and multi-granularity planning with deformable attention for autonomous driving in a single decoder. In: Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV). pp. 25605–25615 (October 2025)
2025
-
[15]
In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Weng, X., Ivanovic, B., Wang, Y., Wang, Y., Pavone, M.: PARA-Drive: Parallelized architecture for real-time autonomous driving. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. pp. 15449–15458 (2024)
2024
-
[16]
Advances in Neural Information Processing Systems36, 7093–7115 (2023)
Yadav, P., Tam, D., Choshen, L., Raffel, C.A., Bansal, M.: TIES-Merging: Resolv- ing interference when merging models. Advances in Neural Information Processing Systems36, 7093–7115 (2023)
2023
-
[17]
Advances in Neural Information Processing Systems33, 5824–5836 (2020)
Yu, T., Kumar, S., Gupta, A., Levine, S., Hausman, K., Finn, C.: Gradient surgery for multi-task learning. Advances in Neural Information Processing Systems33, 5824–5836 (2020)
2020
Reviewed August 1, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.