REVIEW 4 major objections 5 minor 92 references
Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations
T0 review · 4 major / 5 minor · reviewed 2026-08-11 · deepseek-v4-flash
Pith's one-line read This paper claims that pedestrian trajectories can be forecast as the superposition of a linear base and two cause-specific vibrations, with social influence read from the spectral similarity between observed trajectories.
desk verdict A solid, clearly specified trajectory prediction paper whose headline claim—decoupling self vs. social randomness—is not actually enforced by the architecture; worth reviewing but needs major claim revisions. read the letter →
The pith
A machine-rendered reading of the paper's core claim, the machinery that carries it, and where it could break.
The reading
What carries the argument
The machinery is a vibration decomposition of trajectories. A linear least-squares fit provides equilibrium points, called the linear base; two noise-conditioned Transformer networks, working in the discrete Haar transform domain, produce a self-bias and a social (resonance) bias; the prediction is their sum. The specifically named object is the resonance feature $f^{i \leftarrow j} = N_{r2}(\mathrm{Flatten}(f^i_r \odot f^j_r))$, an element-wise product of the ego's and a neighbor's spectral embeddings, gathered into an angle-partitioned resonance matrix. This product is the mechanism that turns 'similar spectrum' into 'social influence.'
What would settle it
Take a real ego-neighbor pair, keep both current positions fixed, and replace the neighbor's observed path with a straight-line version that has the same endpoints but no spectral structure. If the predicted trajectory changes materially, spectral shape is doing causal work; if it does not change, only position matters and the resonance mechanism is not the driver of social prediction.
Extended reading notes
Core claim
The core discovery, on the paper's own terms, is that trajectory randomness can be forecast as the superposition of independent vibrations whose states are set by sampled noise variables: $\hat{Y}^i = \hat{Y}^i_l + \Delta\hat{Y}^i_s + \Delta\hat{Y}^i_r$. The self-bias $\Delta\hat{Y}^i_s$ is generated by comparing the observed trajectory with its linear least-squares fit in the frequency domain and decoding a Transformer feature conditioned on noise $z_s$; the re-bias $\Delta\hat{Y}^i_r$ is generated by a second Transformer that ingests a resonance matrix built from element-wise products of the ego's and each neighbor's spectral embeddings, together with angle-based position partitions. The paper argues that this structure separates self-randomness from social-randomness, that the resonance features cluster neighbors into behaviorally meaningful groups without manual annotation, and that visualized biases show the two vibrations growing in nearly orthogonal directions. On the strength of these components, the Resonance model reports state-of-the-art or competitive ADE/FDE numbers across the tested datasets.
Load-bearing premise
The load-bearing premise is that social influence between two agents can be measured by comparing the shapes of their observed paths in the frequency domain, specifically by multiplying their frequency representations together.
Editorial extensions
If this is right
- Separating randomness by cause means a predictor can be tuned to over- or under-weight intention noise versus social noise, which is not possible with a single latent sampling.
- The resonance representation yields an interpretable social feature: each neighbor contributes a resonance energy, and the paper shows these energies cluster neighbors into groups consistent with real walking groups.
- The near-orthogonality of self- and social-biases gives a coordinate decomposition in which self-bias randomizes direction while re-bias randomizes speed along the motion, clarifying what kind of uncertainty each sampled prediction carries.
- The method transfers to vehicle trajectories with strong results, although the paper notes that the fixed linear base is less suited to fast-changing scenes such as NBA and nuScenes.
- Because the two Transformer branches are mirrored and additive, the architecture admits cheap ablated versions that retain reasonable performance while using roughly one third of the full model's inference time.
Reading between the lines
- If the spectral-similarity mechanism is right, then perturbing a neighbor's trajectory in the frequency domain is a principled way to generate counterfactual social situations for training safety-critical predictors; this is a testable extension the paper does not explore.
- The emergent near-orthogonality of the two biases suggests the network learns a coordinate system for 'intention versus interaction' that could be probed against human judgments of which motion aspects are intentional versus reactive.
- The finding that the fixed linear base hurts on NBA and nuScenes points toward a natural variant with a learned or scene-adaptive reference trajectory, which would generalize the vibration idea beyond near-linear pedestrian motion.
- The two-bias design also enables controlled interventions, such as holding the ego trajectory fixed while replacing a neighbor's path with its spectrally flattened version, to isolate whether spectral shape or position drives a particular social prediction.
Signed reviews
Editorial analysis
A structured set of objections, weighed in public.
Referee Report
Summary. The paper proposes Resonance (Re), a trajectory prediction model that represents an agent's future trajectory as the superposition of a linear base, a self-sourced bias, and a social/resonance-sourced bias (Eq. 1). The architecture uses spectral (Haar) transforms, two mirrored Transformer branches, and an angle-based resonance gathering mechanism (Eqs. 10–13) to compute the two biases. The authors claim that this decomposition separately simulates self/intention randomness and social randomness in an explainable way, and they support this with quantitative benchmarks on ETH-UCY, SDD, NBA, and nuScenes, plus ablations and visualizations. The model achieves strong or state-of-the-art results on several pedestrian benchmarks and is released with code.
Significance. If the claimed decomposition were rigorously established, the paper would make a valuable interpretability contribution to trajectory prediction: separating intention-driven from socially-driven randomness is a conceptually appealing and practically useful goal. The paper's strengths are its extensive quantitative comparisons, careful ablations (including interaction representations, waypoint counts, transforms, and angle partitions), efficiency analyses, and public code release. However, the central interpretability claims — that the two biases are causally decoupled, that self and social randomness are separately simulated, and that the two vibrations are nearly perpendicular — are supported mainly by post hoc visualizations. The appendix explicitly states that the perpendicular-vibration explanation is 'not strict proofs' and that the phenomenon fails on NBA and behaves differently on nuScenes. Because these claims are load-bearing for the paper's framing and abstract, they need either architectural enforcement, quantitative statistical validation, or a substantially weakened claim.
major comments (4)
- [§3, Eq. (13); §4, Eq. (15)] The claim that ΔY_r is 'social-sourced' is not enforced by the architecture. In Eq. (13), the re-bias branch receives Concat(Δf_e, F_i^R, z_r), where Δf_e is the ego's own differential spectrum also used in the self-bias branch (Eq. 7), and z_r is a free noise vector that remains active even when F_i^R is zero-padded because no neighbors exist. Nothing in the training loss (Eq. 15) prevents the model from allocating arbitrary randomness or ego-only information to the 'social' branch. The authors should provide a direct validation of the decomposition, for example by (a) measuring the change in ΔY_r when neighbors are removed while holding z_r fixed, (b) statistically testing dependence between the z_s and z_r branches, or (c) adding a regularization or architectural constraint that forces ΔY_r to vanish without neighbors and forces independence of the two noise channels.
- [§4.2, 'Discussions on Vibrations'; Appendix C.2] The paper's central interpretability observation — that self and social vibrations are 'almost vertical' — is explicitly stated in Appendix C.2 to be 'not strict proofs,' and the quantitative generality is weak: NBA samples show roughly 60-degree direction differences, and nuScenes shows the roles of the two biases switching (self-bias encodes velocity changes, re-bias encodes turning). Since the perpendicularity is presented in the main text as evidence of decoupling and independence, the authors should either provide statistical measurements (e.g., distributions of the angle θ_s+θ_r across test samples with confidence intervals) or downgrade this claim to an exploratory observation rather than a validated property of the model.
- [Table 4 and Table 11 (ablation rows a1–a0)] The ablation results show that adding the linear base consistently hurts performance on NBA (rows a7–a9 drop by up to 7.4%/17.7% ADE/FDE) and on nuScenes (up to 7.6%/12.9%). This contradicts the narrative that the linear least-squares fit is a neutral 'reference' or 'equilibrium' for the vibration decomposition in all scenarios. While the quantitative SOTA results are not undermined, the paper should either explain why the linear base is inappropriate on these datasets and what replaces it as the equilibrium point, or revise the claim that the decomposition is a universal physical analogy.
- [§3, Eq. (10)] The specific form of the resonance feature — an element-wise product of the ego and neighbor spectral embeddings — is a strong inductive assumption about how social interaction is computed, but the ablations in Table 8 only compare different gathering mechanisms (Social Pooling, GCN, SocialCircle, Resonance Gathering), not alternative pair-wise combination functions (e.g., concatenation, difference, or cross-attention). Since the resonance-like interaction model is one of the two main contributions, the paper should include an ablation that varies the combination function in Eq. (10) to support the claim that spectral similarity via multiplication is the right mechanism.
minor comments (5)
- [Table 11] The formatting of row a2 shows '✓ ✓×' with a missing space before the × symbol; this should be corrected for consistency with the other rows.
- [Table 8, row d2] The GCN row reports '0.240/0.272' for the first entry, which appears to be a typo or a misaligned value (the FDE is implausibly low compared to neighboring rows); please verify the reported numbers.
- [§2, Related Works and Abstract] The paper uses the term 'randomnesses' in a non-standard plural form; consider rephrasing to 'random components' or 'stochasticities' for clarity.
- [Fig. 2 caption and §1] The natural frequency f0 is mentioned in the resonance analogy but is never mapped to a concrete quantity in the model; define how the model's spectral features relate to a 'natural frequency' or remove the term to avoid confusion.
- [Appendix C.2] The 'two-player cooperative game' explanation is presented as intuition, not proof, but the manuscript does not clearly mark it as speculative; consider labeling it as an analogy to prevent readers from mistaking it for a theoretical result.
Circularity Check
No significant circularity: the superposition equation is a model definition, and all quantitative claims are externally benchmarked.
full rationale
The paper's quantitative results are evaluated on external datasets (ETH-UCY, SDD, NBA, nuScenes) under standard minADE/minFDE metrics, so the reported numbers are not fitted-then-renamed predictions. Equation (1), Y^i = Y^i_l + ΔY^i_s + ΔY^i_r, is an architectural definition of how the model composes its outputs, not a result derived from assumptions that already contain the target trajectories. The self-bias and resonance-bias are learned end-to-end from observed trajectories and noise variables, and their contributions are tested by ablations in Table 4 and Appendix E; the linear base is a least-squares reference, not a parameter fitted to future data. The angle-based resonance gathering is inspired by prior work by the same authors (SocialCircle), but the paper ablate against SocialCircle and other interaction representations, so the self-citation is not load-bearing. The interpretability claim about decoupled self vs. social randomness is weakly supported and even acknowledged by the authors as 'not strict proofs,' and it fails on NBA; however, that is a correctness or evidence concern, not a circularity in the derivation chain. No equation or prediction reduces to its own input by construction, and no fitted parameter is presented as a prediction.
Assumptions & free parameters
free parameters (4)
- Nθ (number of angular partitions) =
8 (default, equal to th)
- tway (number of waypoints for self-bias) =
4 when tf=12, 3 when tf=10
- Network hyperparameters (d=128, heads=8, layers Ts=4, Tr=2, lr=3e-4, batch size=1000, epochs=200) =
as listed
- K (number of samples for best-of-K evaluation) =
20 in main tables
assumptions (4)
- domain assumption Trajectory randomnesses can be regarded as vibrations around equilibrium points, with only a set of equilibrium points assumed.
- domain assumption Social interactions are associated with the spectral properties of agents' trajectories and can be modeled by comparing spectra (resonance).
- domain assumption Agents prefer to maintain their motion status in the short term, so a linear least-squares fit can serve as the equilibrium reference.
- standard math The discrete Haar transform provides a useful spectral representation of trajectories.
Cite this review
Pith. "Pith review of Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations." pith.science (2026). https://pith.science/paper/7YTXU5WS
@misc{pith2026241202447,
author = {Pith},
title = {Pith review of: Resonance: Learning to Predict Social-Aware Pedestrian Trajectories as Co-Vibrations},
year = {2026},
howpublished = {\url{https://pith.science/paper/7YTXU5WS}},
note = {Machine review of arXiv:2412.02447}
}
read the original abstract
Learning to forecast trajectories of intelligent agents has caught much more attention recently. However, it remains a challenge to accurately account for agents' intentions and social behaviors when forecasting, and in particular, to simulate the unique randomness within each of those components in an explainable and decoupled way. Inspired by vibration systems and their resonance properties, we propose the Resonance (short for Re) model to encode and forecast pedestrian trajectories in the form of ``co-vibrations''. It decomposes trajectory modifications and randomnesses into multiple vibration portions to simulate agents' reactions to each single cause, and forecasts trajectories as the superposition of these independent vibrations separately. Also, benefiting from such vibrations and their spectral properties, representations of social interactions can be learned by emulating the resonance phenomena, further enhancing its explainability. Experiments on multiple datasets have verified its usefulness both quantitatively and qualitatively.
Figures
Figures from the paper (15 more)
Reference graph
Works this paper leans on
-
[1]
So- cial lstm: Human trajectory prediction in crowded spaces
Alexandre Alahi, Kratarth Goel, Vignesh Ramanathan, Alexandre Robicquet, Li Fei-Fei, and Silvio Savarese. So- cial lstm: Human trajectory prediction in crowded spaces. In Proceedings of the IEEE conference on computer vision and pattern recognition, pages 961–971, 2016. 1, 2, 5, 13, 18
2016
-
[2]
Learning to predict human behavior in crowded scenes
Alexandre Alahi, Vignesh Ramanathan, Kratarth Goel, Alexandre Robicquet, Amir A Sadeghian, Li Fei-Fei, and Silvio Savarese. Learning to predict human behavior in crowded scenes. In Group and Crowd Behavior for Com- puter Vision, pages 183–207. Elsevier, 2017. 1
2017
-
[3]
Modelling shared space users via rule- based social force model
Bani Anvari, Michael GH Bell, Aruna Sivakumar, and Wash- ington Y Ochieng. Modelling shared space users via rule- based social force model. Transportation Research Part C: Emerging Technologies, 51:83–103, 2015. 2
2015
-
[4]
Can language beat numerical regression? language-based multimodal tra- jectory prediction
Inhwan Bae, Junoh Lee, and Hae-Gon Jeon. Can language beat numerical regression? language-based multimodal tra- jectory prediction. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 753–766, 2024. 2
2024
-
[5]
Singu- lartrajectory: Universal trajectory predictor using diffusion model
Inhwan Bae, Young-Jae Park, and Hae-Gon Jeon. Singu- lartrajectory: Universal trajectory predictor using diffusion model. arXiv preprint arXiv:2403.18452, 2024. 2
arXiv 2024
-
[6]
Holger Caesar, Varun Bankiti, Alex H. Lang, Sourabh V ora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Giancarlo Baldan, and Oscar Beijbom. nuscenes: A mul- timodal dataset for autonomous driving. arXiv preprint arXiv:1903.11027, 2019. 5, 19
arXiv 1903
-
[7]
nuscenes: A multi- modal dataset for autonomous driving
Holger Caesar, Varun Bankiti, Alex H Lang, Sourabh V ora, Venice Erin Liong, Qiang Xu, Anush Krishnan, Yu Pan, Gi- ancarlo Baldan, and Oscar Beijbom. nuscenes: A multi- modal dataset for autonomous driving. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pages 11621–11631, 2020. 5, 19
2020
-
[8]
Multipath: Multiple probabilistic anchor tra- jectory hypotheses for behavior prediction
Yuning Chai, Benjamin Sapp, Mayank Bansal, and Dragomir Anguelov. Multipath: Multiple probabilistic anchor tra- jectory hypotheses for behavior prediction. arXiv preprint arXiv:1910.05449, 2019. 1
arXiv 1910
Show all 92 references
-
[9]
Personalized trajectory prediction via distri- bution discrimination
Guangyi Chen, Junlong Li, Nuoxing Zhou, Liangliang Ren, and Jiwen Lu. Personalized trajectory prediction via distri- bution discrimination. In Proceedings of the IEEE/CVF In- ternational Conference on Computer Vision , pages 15580– 15589, 2021. 1, 2
2021
-
[10]
Scept: Scene-consistent, policy-based trajectory predictions for planning
Yuxiao Chen, Boris Ivanovic, and Marco Pavone. Scept: Scene-consistent, policy-based trajectory predictions for planning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 17103– 17112, 2022. 1
2022
-
[11]
Enhancing trajec- tory prediction through self-supervised waypoint distortion prediction
Pranav Singh Chib and Pravendra Singh. Enhancing trajec- tory prediction through self-supervised waypoint distortion prediction. In International Conference on Machine Learn- ing, pages 8403–8416. PMLR, 2024. 2
2024
-
[12]
Lg-traj: Llm guided pedestrian trajectory prediction
Pranav Singh Chib and Pravendra Singh. Lg-traj: Llm guided pedestrian trajectory prediction. arXiv preprint arXiv:2403.08032, 2024. 2, 5
2024 arXiv
-
[13]
Ms-tip: Imputation aware pedestrian trajectory prediction
Pranav Singh Chib, Achintya Nath, Paritosh Kabra, Ishu Gupta, and Pravendra Singh. Ms-tip: Imputation aware pedestrian trajectory prediction. In International Conference on Machine Learning, pages 8389–8402. PMLR, 2024. 5
2024
-
[14]
Dice: Diverse dif- fusion model with scoring for trajectory prediction
Younwoo Choi, Ray Coden Mercurius, Soheil Mohamad Al- izadeh Shabestary, and Amir Rasouli. Dice: Diverse dif- fusion model with scoring for trajectory prediction. In 2024 IEEE Intelligent Vehicles Symposium (IV), pages 3023–3029. IEEE, 2024. 20
2024
-
[15]
Complementary attention gated network for pedestrian trajectory prediction
Jinghai Duan, Le Wang, Chengjiang Long, Sanping Zhou, Fang Zheng, Liushuai Shi, and Gang Hua. Complementary attention gated network for pedestrian trajectory prediction. In Proceedings of the AAAI Conference on Artificial Intelli- gence, pages 542–550, 2022. 2
2022
-
[16]
Soft+ hardwired attention: An lstm frame- work for human trajectory prediction and abnormal event de- tection
Tharindu Fernando, Simon Denman, Sridha Sridharan, and Clinton Fookes. Soft+ hardwired attention: An lstm frame- work for human trajectory prediction and abnormal event de- tection. Neural networks, 108:466–478, 2018. 1
2018
-
[17]
Causal inter- vention for human trajectory prediction with cross attention mechanism
Chunjiang Ge, Shiji Song, and Gao Huang. Causal inter- vention for human trajectory prediction with cross attention mechanism. In Proceedings of the AAAI Conference on Ar- tificial Intelligence, pages 658–666, 2023. 2
2023
-
[18]
Investigating causal relations by econo- metric models and cross-spectral methods
Clive WJ Granger. Investigating causal relations by econo- metric models and cross-spectral methods. Econometrica: journal of the Econometric Society, pages 424–438, 1969. 1, 8, 17
1969
-
[19]
Social gan: Socially acceptable tra- jectories with generative adversarial networks
Agrim Gupta, Justin Johnson, Li Fei-Fei, Silvio Savarese, and Alexandre Alahi. Social gan: Socially acceptable tra- jectories with generative adversarial networks. In Proceed- ings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 2255–2264, 2018. 1, 2, 4, 5, 13
2018
-
[20]
Social force model for pedestrian dynamics
Dirk Helbing and Peter Molnar. Social force model for pedestrian dynamics. Physical review E, 51(5):4282, 1995. 2
1995
-
[21]
Stgat: Modeling spatial-temporal interactions for human trajectory prediction
Yingfan Huang, Huikun Bi, Zhaoxin Li, Tianlu Mao, and Zhaoqi Wang. Stgat: Modeling spatial-temporal interactions for human trajectory prediction. In Proceedings of the IEEE International Conference on Computer Vision, pages 6272– 6281, 2019. 2
2019
-
[22]
Lstm based trajectory prediction model for cyclist utilizing multiple interactions with environment
Zhi Huang, Jun Wang, Lei Pi, Xiaolin Song, and Lingfang Yang. Lstm based trajectory prediction model for cyclist utilizing multiple interactions with environment. Pattern Recognition, 112:107800, 2021. 2
2021
-
[23]
Structural-rnn: Deep learning on spatio-temporal graphs
Ashesh Jain, Amir R Zamir, Silvio Savarese, and Ashutosh Saxena. Structural-rnn: Deep learning on spatio-temporal graphs. In Proceedings of the ieee conference on computer vision and pattern recognition, pages 5308–5317, 2016. 2
2016
-
[24]
A style-based generator architecture for generative adversarial networks
Tero Karras, Samuli Laine, and Timo Aila. A style-based generator architecture for generative adversarial networks. In Proceedings of the IEEE/CVF conference on computer vi- sion and pattern recognition, pages 4401–4410, 2019. 2
2019
-
[25]
Prob- abilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network
ByeoungDo Kim, Chang Mook Kang, Jaekyum Kim, Se- ung Hi Lee, Chung Choo Chung, and Jun Won Choi. Prob- abilistic vehicle trajectory prediction over occupancy grid map via recurrent neural network. In 2017 IEEE 20th Inter- national Conference on Intelligent Transportation Syste...
2017
-
[26]
Semi-supervised classi- fication with graph convolutional networks
Thomas N Kipf and Max Welling. Semi-supervised classi- fication with graph convolutional networks. arXiv preprint arXiv:1609.02907, 2016. 18
2016 arXiv
-
[27]
Social- bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks
Vineet Kosaraju, Amir Sadeghian, Roberto Mart ´ın-Mart´ın, Ian Reid, Hamid Rezatofighi, and Silvio Savarese. Social- bigat: Multimodal trajectory forecasting using bicycle-gan and graph attention networks. In Advances in Neural Infor- mation Processing Systems, pages 137–146, ...
2019
-
[28]
Safety-compliant gener- ative adversarial networks for human trajectory forecasting
Parth Kothari and Alexandre Alahi. Safety-compliant gener- ative adversarial networks for human trajectory forecasting. IEEE Transactions on Intelligent Transportation Systems, 24 (4):4251–4261, 2023. 2
2023
-
[29]
Muse- vae: Multi-scale vae for environment-aware long term tra- jectory prediction
Mihee Lee, Samuel S Sohn, Seonghyeon Moon, Sejong Yoon, Mubbasir Kapadia, and Vladimir Pavlovic. Muse- vae: Multi-scale vae for environment-aware long term tra- jectory prediction. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 22...
2022
-
[30]
Desire: Distant future prediction in dynamic scenes with interacting agents
Namhoon Lee, Wongun Choi, Paul Vernaza, Christopher B Choy, Philip HS Torr, and Manmohan Chandraker. Desire: Distant future prediction in dynamic scenes with interacting agents. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 336–345, 2017. 1
2017
-
[31]
Crowds by example
Alon Lerner, Yiorgos Chrysanthou, and Dani Lischinski. Crowds by example. Computer Graphics Forum, 26(3):655– 664, 2007. 5
2007
-
[32]
Rain: Reinforced hybrid attention inference network for motion forecasting
Jiachen Li, Fan Yang, Hengbo Ma, Srikanth Malla, Masayoshi Tomizuka, and Chiho Choi. Rain: Reinforced hybrid attention inference network for motion forecasting. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 16096–16106, 2021. 2
2021
-
[33]
Graph- based spatial transformer with memory replay for multi- future pedestrian trajectory prediction
Lihuan Li, Maurice Pagnucco, and Yang Song. Graph- based spatial transformer with memory replay for multi- future pedestrian trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 2231–2241, 2022. 2
2022
-
[34]
Bcdiff: Bidirectional consistent diffusion for instantaneous trajectory prediction
Rongqing Li, Changsheng Li, Dongchun Ren, Guangyi Chen, Ye Yuan, and Guoren Wang. Bcdiff: Bidirectional consistent diffusion for instantaneous trajectory prediction. Advances in Neural Information Processing Systems , 36,
-
[35]
Spatial-temporal consistency network for low-latency trajec- tory forecasting
Shijie Li, Yanying Zhou, Jinhui Yi, and Juergen Gall. Spatial-temporal consistency network for low-latency trajec- tory forecasting. In Proceedings of the IEEE/CVF Interna- tional Conference on Computer Vision (ICCV), pages 1940– 1949, 2021. 13
1940
-
[36]
Peeking into the future: Predict- ing future person activities and locations in videos
Junwei Liang, Lu Jiang, Juan Carlos Niebles, Alexander G Hauptmann, and Li Fei-Fei. Peeking into the future: Predict- ing future person activities and locations in videos. In Pro- ceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pages 5725–5734, 2019. 1
2019
-
[37]
Simaug: Learning robust representations from simulation for trajec- tory prediction
Junwei Liang, Lu Jiang, and Alexander Hauptmann. Simaug: Learning robust representations from simulation for trajec- tory prediction. In Proceedings of the European conference on computer vision (ECCV), 2020. 5
2020
-
[38]
Progressive pretext task learning for human tra- jectory prediction
Xiaotong Lin, Tianming Liang, Jianhuang Lai, and Jian- Fang Hu. Progressive pretext task learning for human tra- jectory prediction. In European Conference on Computer Vision, pages 197–214. Springer, 2024. 5
2024
-
[39]
Nba player movements
Kostya Linou, Dzmitryi Linou, and Martijn de Boer. Nba player movements. https://github.com/linouk23/NBA- Player-Movements, 2016. 5
2016
-
[40]
Avgcn: Trajectory prediction using graph convolutional net- works guided by human attention
Congcong Liu, Yuying Chen, Ming Liu, and Bertram E Shi. Avgcn: Trajectory prediction using graph convolutional net- works guided by human attention. In 2021 IEEE Inter- national Conference on Robotics and Automation (ICRA) , pages 14234–14240. IEEE, 2021. 2
2021
-
[41]
Uncertainty-aware pedestrian trajectory pre- diction via distributional diffusion
Yao Liu, Zesheng Ye, Rui Wang, Binghao Li, Quan Z Sheng, and Lina Yao. Uncertainty-aware pedestrian trajectory pre- diction via distributional diffusion. Knowledge-Based Sys- tems, page 111862, 2024. 1, 2, 5
2024
-
[42]
People tracking with human motion predictions from social forces
Matthias Luber, Johannes A Stork, Gian Diego Tipaldi, and Kai O Arras. People tracking with human motion predictions from social forces. In2010 IEEE international conference on robotics and automation, pages 464–469. IEEE, 2010. 2
2010
-
[43]
Skgacn: social knowledge-guided graph attention convolutional network for human trajectory prediction
Kai Lv and Liang Yuan. Skgacn: social knowledge-guided graph attention convolutional network for human trajectory prediction. IEEE Transactions on Instrumentation and Mea- surement, 2023. 1
2023
-
[44]
Trafficpredict: Trajec- tory prediction for heterogeneous traffic-agents
Yuexin Ma, Xinge Zhu, Sibo Zhang, Ruigang Yang, Wen- ping Wang, and Dinesh Manocha. Trafficpredict: Trajec- tory prediction for heterogeneous traffic-agents. In Proceed- ings of the AAAI Conference on Artificial Intelligence, pages 6120–6127, 2019. 13
2019
-
[45]
Fast inference and update of probabilistic density estimation on trajectory pre- diction
Takahiro Maeda and Norimichi Ukita. Fast inference and update of probabilistic density estimation on trajectory pre- diction. In Proceedings of the IEEE/CVF International Con- ference on Computer Vision, pages 9795–9805, 2023. 5
2023
-
[46]
You mostly walk alone: Analyzing fea- ture attribution in trajectory prediction
Osama Makansi, Julius V on K¨ugelgen, Francesco Locatello, Peter Gehler, Dominik Janzing, Thomas Brox, and Bern- hard Sch ¨olkopf. You mostly walk alone: Analyzing fea- ture attribution in trajectory prediction. arXiv preprint arXiv:2110.05304, 2021. 14
-
[47]
It is not the journey but the destination: Endpoint conditioned trajectory prediction
Karttikeya Mangalam, Harshayu Girase, Shreyas Agarwal, Kuan-Hui Lee, Ehsan Adeli, Jitendra Malik, and Adrien Gaidon. It is not the journey but the destination: Endpoint conditioned trajectory prediction. In European Conference on Computer Vision, pages 759–776, 2020. 1, 2, 5
2020
-
[48]
From goals, waypoints & paths to long term hu- man trajectory forecasting
Karttikeya Mangalam, Yang An, Harshayu Girase, and Jiten- dra Malik. From goals, waypoints & paths to long term hu- man trajectory forecasting. In Proceedings of the IEEE/CVF International Conference on Computer Vision, pages 15233– 15242, 2021. 1, 2, 4, 5, 18, 20
2021
-
[49]
History repeats itself: Human motion prediction via motion atten- tion
Wei Mao, Miaomiao Liu, and Mathieu Salzmann. History repeats itself: Human motion prediction via motion atten- tion. In European Conference on Computer Vision , pages 474–489. Springer, 2020. 2
2020
-
[50]
Leapfrog diffusion model for stochastic trajec- tory prediction
Weibo Mao, Chenxin Xu, Qi Zhu, Siheng Chen, and Yan- feng Wang. Leapfrog diffusion model for stochastic trajec- tory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition , pages 5517– 5526, 2023. 2, 5
2023
-
[51]
Smemo: social memory for trajec- tory forecasting
Francesco Marchetti, Federico Becattini, Lorenzo Seidenari, and Alberto Del Bimbo. Smemo: social memory for trajec- tory forecasting. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024. 1, 5
2024
-
[52]
Ab- normal crowd behavior detection using social force model
Ramin Mehran, Alexis Oyama, and Mubarak Shah. Ab- normal crowd behavior detection using social force model. In 2009 IEEE Conference on Computer Vision and Pattern Recognition, pages 935–942. IEEE, 2009. 2
2009
-
[53]
Social-stgcnn: A social spatio-temporal graph convolutional neural network for human trajectory prediction
Abduallah Mohamed, Kun Qian, Mohamed Elhoseiny, and Christian Claudel. Social-stgcnn: A social spatio-temporal graph convolutional neural network for human trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 14424–...
2020
-
[54]
Variational autoencoder-based vehicle trajectory prediction with an interpretable latent space
Marion Neumeier, Michael Botsch, Andreas Tollk ¨uhn, and Thomas Berberich. Variational autoencoder-based vehicle trajectory prediction with an interpretable latent space. In 2021 IEEE International Intelligent Transportation Systems Conference (ITSC), pages 820–827. IEEE, 2021. 2
2021
-
[55]
T4p: Test-time training of tra- jectory prediction via masked autoencoder and actor-specific token memory
Daehee Park, Jaeseok Jeong, Sung-Hoon Yoon, Jaewoo Jeong, and Kuk-Jin Yoon. T4p: Test-time training of tra- jectory prediction via masked autoencoder and actor-specific token memory. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15...
2024
-
[56]
You’ll never walk alone: Modeling social be- havior for multi-target tracking
Stefano Pellegrini, Andreas Ess, Konrad Schindler, and Luc Van Gool. You’ll never walk alone: Modeling social be- havior for multi-target tracking. In 2009 IEEE 12th Inter- national Conference on Computer Vision , pages 261–268. IEEE, 2009. 1, 2, 5
2009
-
[57]
What truly matters in trajectory pre- diction for autonomous driving? Advances in Neural Infor- mation Processing Systems, 36, 2024
Tran Phong, Haoran Wu, Cunjun Yu, Panpan Cai, Sifa Zheng, and David Hsu. What truly matters in trajectory pre- diction for autonomous driving? Advances in Neural Infor- mation Processing Systems, 36, 2024. 1
2024
-
[58]
Holistic lstm for pedestrian trajectory prediction
Ruijie Quan, Linchao Zhu, Yu Wu, and Yi Yang. Holistic lstm for pedestrian trajectory prediction. IEEE transactions on image processing, 30:3229–3239, 2021. 2
2021
-
[59]
Goal-directed pedestrian prediction
Eike Rehder and Horst Kloeden. Goal-directed pedestrian prediction. In Proceedings of the IEEE International Con- ference on Computer Vision Workshops, pages 50–58, 2015. 2
2015
-
[60]
Pedestrian prediction by planning using deep neu- ral networks
Eike Rehder, Florian Wirth, Martin Lauer, and Christoph Stiller. Pedestrian prediction by planning using deep neu- ral networks. In 2018 IEEE International Conference on Robotics and Automation (ICRA) , pages 5903–5908. IEEE,
2018
-
[61]
Learning social etiquette: Human tra- jectory understanding in crowded scenes
Alexandre Robicquet, Amir Sadeghian, Alexandre Alahi, and Silvio Savarese. Learning social etiquette: Human tra- jectory understanding in crowded scenes. In European con- ference on computer vision, pages 549–565. Springer, 2016. 5
2016
-
[62]
Human trajectory prediction and gen- eration using lstm models and gans
Luca Rossi, Marina Paolanti, Roberto Pierdicca, and Emanuele Frontoni. Human trajectory prediction and gen- eration using lstm models and gans. Pattern Recognition, 120:108136, 2021. 1, 2
2021
-
[63]
Pedestrian 3d bounding box prediction
Saeed Saadatnejad, Yi Zhou Ju, and Alexandre Alahi. Pedestrian 3d bounding box prediction. arXiv preprint arXiv:2206.14195, 2022. 19
2022 arXiv
-
[64]
Sophie: An attentive gan for predicting paths compliant to social and physical constraints
Amir Sadeghian, Vineet Kosaraju, Ali Sadeghian, Noriaki Hirose, Hamid Rezatofighi, and Silvio Savarese. Sophie: An attentive gan for predicting paths compliant to social and physical constraints. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition ...
2019
-
[65]
Artist: Autoregressive trajectory inpainting and scoring for tracking
Fatemeh Saleh, Sadegh Aliakbarian, Mathieu Salzmann, and Stephen Gould. Artist: Autoregressive trajectory inpainting and scoring for tracking. arXiv preprint arXiv:2004.07482,
2004 arXiv
-
[66]
Trajectron++: Dynamically-feasible trajec- tory forecasting with heterogeneous data
Tim Salzmann, Boris Ivanovic, Punarjay Chakravarty, and Marco Pavone. Trajectron++: Dynamically-feasible trajec- tory forecasting with heterogeneous data. In Proceedings of the European conference on computer vision (ECCV), pages 683–700. Springer, 2020. 5, 20
2020
-
[67]
Introvert: Human trajectory prediction via conditional 3d attention
Nasim Shafiee, Taskin Padir, and Ehsan Elhamifar. Introvert: Human trajectory prediction via conditional 3d attention. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 16815–16825, 2021. 2
2021
-
[68]
Representing multimodal behaviors with mean location for pedestrian tra- jectory prediction
Liushuai Shi, Le Wang, Chengjiang Long, Sanping Zhou, Wei Tang, Nanning Zheng, and Gang Hua. Representing multimodal behaviors with mean location for pedestrian tra- jectory prediction. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. 5
2023
-
[69]
Pedestrian trajectory prediction based on deep convolutional lstm network
Xiao Song, Kai Chen, Xu Li, Jinghan Sun, Baocun Hou, Yong Cui, Baochang Zhang, Gang Xiong, and Zilie Wang. Pedestrian trajectory prediction based on deep convolutional lstm network. IEEE Transactions on Intelligent Transporta- tion Systems, 22(6):3285–3302, 2021. 2
2021
-
[70]
A unified environmental network for pedestrian trajec- tory prediction
Yuchao Su, Yuanman Li, Wei Wang, Jiantao Zhou, and Xia Li. A unified environmental network for pedestrian trajec- tory prediction. In Proceedings of the AAAI Conference on Artificial Intelligence, pages 4970–4978, 2024. 5
2024
-
[71]
Goal-driven long- term trajectory prediction
Hung Tran, Vuong Le, and Truyen Tran. Goal-driven long- term trajectory prediction. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision , pages 796–805, 2021. 2
2021
-
[72]
Attention is all you need
Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszko- reit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. In Advances in neural information processing systems, pages 5998–6008, 2017. 3
2017
-
[73]
Social attention: Modeling attention in human crowds
Anirudh Vemula, Katharina Muelling, and Jean Oh. Social attention: Modeling attention in human crowds. In 2018 IEEE international Conference on Robotics and Automation (ICRA), pages 1–7. IEEE, 2018. 2
2018
-
[74]
Ltp: Lane-based trajectory prediction for autonomous driving
Jingke Wang, Tengju Ye, Ziqing Gu, and Junbo Chen. Ltp: Lane-based trajectory prediction for autonomous driving. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition, pages 17134–17142, 2022. 20
2022
-
[75]
View vertically: A hierarchical network for trajectory prediction via fourier spectrums
Conghao Wong, Beihao Xia, Ziming Hong, Qinmu Peng, Wei Yuan, Qiong Cao, Yibo Yang, and Xinge You. View vertically: A hierarchical network for trajectory prediction via fourier spectrums. In European Conference on Computer Vision, pages 682–700. Springer, 2022. 2, 5, 18
2022
-
[76]
Msn: multi-style network for trajectory predic- tion
Conghao Wong, Beihao Xia, Qinmu Peng, Wei Yuan, and Xinge You. Msn: multi-style network for trajectory predic- tion. IEEE Transactions on Intelligent Transportation Sys- tems, 24:9751 – 9766, 2023. 1, 2
2023
-
[77]
Socialcircle: Learning the angle-based social in- teraction representation for pedestrian trajectory prediction
Conghao Wong, Beihao Xia, Ziqian Zou, Yulong Wang, and Xinge You. Socialcircle: Learning the angle-based social in- teraction representation for pedestrian trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 19005–...
2024
-
[78]
Socialcircle+: Learning the angle-based conditioned interac- tion representation for pedestrian trajectory prediction.arXiv preprint arXiv:2409.14984, 2024
Conghao Wong, Beihao Xia, Ziqian Zou, and Xinge You. Socialcircle+: Learning the angle-based conditioned interac- tion representation for pedestrian trajectory prediction.arXiv preprint arXiv:2409.14984, 2024. 4, 5, 6, 13, 21
2024 arXiv
-
[79]
Another vertical view: A hierarchical net- work for heterogeneous trajectory prediction via spectrums
Beihao Xia, Conghao Wong, Duanquan Xu, Qinmu Peng, and Xinge You. Another vertical view: A hierarchical net- work for heterogeneous trajectory prediction via spectrums. arXiv preprint arXiv:2304.05106, 2023. 5, 13, 18, 20
2023 arXiv
-
[80]
Pedestrian trajectory prediction based on social interactions learning with random weights
Jiajia Xie, Sheng Zhang, Beihao Xia, Zhu Xiao, Hongbo Jiang, Siwang Zhou, Zheng Qin, and Hongyang Chen. Pedestrian trajectory prediction based on social interactions learning with random weights. IEEE Transactions on Multi- media, 2024. 1
2024
-
[81]
Groupnet: Multiscale hypergraph neural net- works for trajectory prediction with relational reasoning
Chenxin Xu, Maosen Li, Zhenyang Ni, Ya Zhang, and Si- heng Chen. Groupnet: Multiscale hypergraph neural net- works for trajectory prediction with relational reasoning. In Proceedings of the IEEE/CVF Conference on Computer Vi- sion and Pattern Recognition (CVPR) , pages 6498–6507,
-
[82]
Remember intentions: Retrospective-memory-based trajec- tory prediction
Chenxin Xu, Weibo Mao, Wenjun Zhang, and Siheng Chen. Remember intentions: Retrospective-memory-based trajec- tory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 6488–6497, 2022. 5
2022
-
[83]
Eqmo- tion: Equivariant multi-agent motion prediction with invari- ant interaction reasoning
Chenxin Xu, Robby T Tan, Yuhong Tan, Siheng Chen, Yu Guang Wang, Xinchao Wang, and Yanfeng Wang. Eqmo- tion: Equivariant multi-agent motion prediction with invari- ant interaction reasoning. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition ,...
2023
-
[84]
So- cialvae: Human trajectory prediction using timewise latents
Pei Xu, Jean-Bernard Hayet, and Ioannis Karamouzas. So- cialvae: Human trajectory prediction using timewise latents. In European Conference on Computer Vision , pages 511– 528, 2022. 1, 2
2022
-
[85]
Adapting to length shift: Flexilength network for trajectory prediction
Yi Xu and Yun Fu. Adapting to length shift: Flexilength network for trajectory prediction. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 15226–15237, 2024. 20
2024
-
[86]
Sopermodel: Leveraging social perception for multi-agent trajectory pre- diction
Heming Yang, Yu Tian, Changyuan Tian, Hongfeng Yu, Wanxuan Lu, Chubo Deng, and Xian Sun. Sopermodel: Leveraging social perception for multi-agent trajectory pre- diction. IEEE Transactions on Geoscience and Remote Sens- ing, 2025. 20
2025
-
[87]
Spatio-temporal graph transformer networks for pedestrian trajectory prediction
Cunjun Yu, Xiao Ma, Jiawei Ren, Haiyu Zhao, and Shuai Yi. Spatio-temporal graph transformer networks for pedestrian trajectory prediction. In European Conference on Computer Vision, pages 507–523. Springer, 2020. 2
2020
-
[88]
Ye Yuan, Xinshuo Weng, Yanglan Ou, and Kris M. Kitani. Agentformer: Agent-aware transformers for socio-temporal multi-agent forecasting. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), pages 9813–9823, 2021. 2, 5, 20
2021
-
[89]
Human tra- jectory prediction via neural social physics
Jiangbei Yue, Dinesh Manocha, and He Wang. Human tra- jectory prediction via neural social physics. In European Conference on Computer Vision , pages 376–394. Springer,
-
[90]
Sr-lstm: State refinement for lstm towards pedestrian trajectory prediction
Pu Zhang, Wanli Ouyang, Pengfei Zhang, Jianru Xue, and Nanning Zheng. Sr-lstm: State refinement for lstm towards pedestrian trajectory prediction. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition , pages 12085–12094, 2019. 5
2019
-
[91]
Social-aware pedestrian trajectory predic- tion via states refinement lstm
Pu Zhang, Jianru Xue, Pengfei Zhang, Nanning Zheng, and Wanli Ouyang. Social-aware pedestrian trajectory predic- tion via states refinement lstm. IEEE transactions on pattern analysis and machine intelligence , 44(5):2742–2759, 2022. 2
2022
-
[92]
ADE” and “FDE
Zikang Zhou, Luyao Ye, Jianping Wang, Kui Wu, and Ke- jie Lu. Hivt: Hierarchical vector transformer for multi-agent motion prediction. In Proceedings of the IEEE/CVF Con- ference on Computer Vision and Pattern Recognition, pages 8823–8833, 2022. 2 Appendix A. Metrics and Other...
2024
Reviewed August 11, 2026 · model on record in the stance chip above.
Discussion (0). Continue with ORCID to comment.