Graph-DDL: A Goal-Directed Deep Learning Framework Integrating Spatial-Temporal Graph Neural Networks with Asymptotically Stable Dynamical Systems for Pedestrian Trajectory Prediction
DOI:
https://doi.org/10.54691/h1jyjh44Keywords:
Pedestrian Trajectory Prediction; Spatial-Temporal Graph Neural Network; Asymptotically Stable Dynamical Systems; Goal-Directed Learning; Dynamic Adjacency Matrix; Transformer; Social Force Model.Abstract
Pedestrian trajectory prediction plays a critically important role in autonomous driving and robot navigation. In recent years, deep learning models have achieved notable progress in this field; however, they often lack interpretability in their predictions, making it difficult to ground the results in physical laws or social norms. Recent studies have proposed a dynamics-based deep learning (DDL) framework that integrates asymptotically stable dynamical systems into Transformer models to address these issues. Nevertheless, Transformer architectures in federated crowd settings suffer from the limited capacity to capture complex spatial interaction information among pedestrians. To overcome this limitation, this paper presents a novel framework, Graph-DDL, which combines a Spatial-Temporal Graph Neural Network (ST-GNN) with asymptotically stable dynamical systems. We construct dynamic adjacency matrices that encode relative distance and relative velocity between pedestrians, replacing the conventional static interaction representations with physically grounded dynamic interaction graphs. Leveraging the inherent properties of the Transformer architecture, we redesign the spatial interaction mechanism to build a goal-directed Transformer backbone. Specifically, a novel coupling scheme is designed that integrates "relative distance" based proximity graphs with "relative velocity" based dynamic adjacency matrices, enabling realistic pedestrian collision avoidance and interaction behavior modeling. By incorporating asymptotic stability constraints, the ST-GNN outputs are guaranteed to produce stable, well-defined control trajectories. Experimental validation confirms that Graph-DDL maintains convergence assurance while yielding significant improvements in open-space crowd scene displacement and prediction accuracy, endowing the model with physical interpretability and social norm compliance.
Downloads
References
[1] A. Rudenko, L. Palmieri, M. Herman, K. M. Kitani, D. M. Gavrila, and K. O. Arras, "Human motion trajectory prediction: A survey," Int. J. Robot. Res., vol. 39, no. 8, pp. 895–935, 2020.
[2] S. Pellegrini, A. Ess, K. Schindler, and L. Van Gool, "You'll never walk alone: Modeling social behavior for multi-target tracking," in Proc. IEEE 12th Int. Conf. Comput. Vis. (ICCV), 2009, pp. 261–268.
[3] A. Lerner, Y. Chrysanthou, and D. Lischinski, "Crowds by example," Comput. Graph. Forum, vol. 26, no. 3, pp. 655–664, 2007.
[4] D. Helbing and P. Molnár, "Social force model for pedestrian dynamics," Phys. Rev. E, vol. 51, no. 5, pp. 4282–4286, 1995.
[5] R. Mehran, A. Oyama, and M. Shah, "Abnormal crowd behavior detection using social force model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2009, pp. 935–942.
[6] A. Alahi, K. Goel, V. Ramanathan, A. Robicquet, L. Fei-Fei, and S. Savarese, "Social LSTM: Human trajectory prediction in crowded spaces," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), 2016, pp. 961–971.
[7] C. Yu, X. Ma, J. Ren, H. Zhao, and S. Yi, "Spatio-temporal graph transformer networks for pedestrian trajectory prediction," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2020, pp. 507–523.
[8] A. Vaswani, N. Shazeer, N. Parmar, et al., "Attention is all you need," in Proc. Adv. Neural Inf. Process. Syst. (NeurIPS), 2017, pp. 5998–6008.
[9] A. Mohamed, K. Qian, M. Elhoseiny, and C. Claudel, "Social-STGCNN: A social spatio-temporal graph convolutional neural network for human trajectory prediction," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2020, pp. 14412–14420.
[10] T. Mangalam, H. Girase, S. Aber, and J. Malik, "It is not the journey but the destination: Endpoint conditioned trajectory prediction," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2020, pp. 759–776.
[11] C. Wang, Y. Wang, M. Xu, and D. J. Crandall, "SSDL: A stable and scalable deep learning framework for trajectory prediction," IEEE Trans. Intell. Transp. Syst., vol. 24, no. 4, pp. 3896–3908, 2023.
[12] A. Gupta, J. Johnson, L. Fei-Fei, S. Savarese, and A. Alahi, "Social GAN: Socially acceptable trajectories with generative adversarial networks," in Proc. IEEE/CVF Conf. Comput. Vis. Pattern Recognit. (CVPR), 2018, pp. 2255–2264.
[13] Y. Yuan and K. Kitani, "DLow: Diversifying latent flows for diverse human motion prediction," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2020, pp. 346–364.
[14] J. Salzmann, B. Ivanovic, P. Chakravarty, and M. Pavone, "Trajectron++: Dynamically-feasible trajectory forecasting with heterogeneous data," in Proc. Eur. Conf. Comput. Vis. (ECCV), 2020, pp. 683–700.
[15] Y. Shi, P. Tao, T. Fernando, et al., "Trajectory prediction with graph-based dual-frequency guidance," in Proc. AAAI Conf. Artif. Intell., 2023, pp. 11910-11918.
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Scientific Journal of Intelligent Systems Research

This work is licensed under a Creative Commons Attribution-NonCommercial 4.0 International License.




