Application of Markov Processes in Traffic Signal Control

Authors

  • Haopeng Deng
  • Fucheng Zheng
  • Lin Zhan

DOI:

https://doi.org/10.6919/ICJE.202411_10(11).0015

Keywords:

Markov Process; Markov Chain; Traffic Signal Control; Queuing Problem; Birth-Death Processes.

Abstract

This paper explores the application of Markov processes in traffic signal control systems, utilizing Markov chains to model vehicular queuing systems, thereby optimizing traffic signal control strategies and improving traffic flow efficiency. The paper first provides an overview of the theoretical foundation of Markov processes and subsequently models the vehicle queuing problem within the traffic signal control system as a birth-death process, establishing a queue model based on Markov chains. Through the steady-state analysis of the queuing system, the paper investigates the impact of signal timing adjustments on long-term system behavior. Experimental results reveal that the dynamic signal control strategy based on Markov processes can effectively adjust signal timing according to real-time traffic conditions, significantly mitigating vehicle queue lengths during peak periods. The findings provide theoretical support for intelligent traffic management and hold promise for broad applications.

Downloads

Download data is not yet available.

References

[1] Bovier A. Markov processes[J]. Lecture Notes Summer, 2012.

[2] Ibe O. Markov processes for stochastic modeling[M]. Newnes, 2013.

[3] Liang Y, Grønbæk C, Fariselli P, et al. Context dependency of nucleotide probabilities and variants in human DNA[J]. BMC genomics, 2022, 23(1): 87.

[4] Nishiyama T, Hasegawa Y. Upper bound for entropy production in Markov processes[J]. Physical Review E, 2023, 108(4): 044139.

[5] Barnes J A, Disney R L. Traffic processes in a class of finite Markovian queues[J]. Queueing Systems, 1990, 6: 311-326.

[6] Xu Y, Xi Y, Li D, et al. Traffic signal control based on Markov decision process[J]. IFAC-PapersOnLine, 2016, 49(3): 67-72.

[7] Xia Xinhai, Xu Lunhui. Urban Intersection Adaptive Traffic Signal Timing Decision with Markov Process Model Using Reinforcement Learning[J]. Highway Engineering, 2018, 43(01): 149-153+239.

[8] Karush J. On the chapman-kolmogorov equation[J]. The Annals of Mathematical Statistics, 1961, 32(4): 1333-1337.

[9] Bhaskaran B G. Almost sure comparison of birth and death processes with application to M/M/s queueing systems[J]. Queueing Systems, 1986, 1: 103-127.

Downloads

Published

2024-10-17

Issue

Section

Articles

How to Cite

Deng, Haopeng, Fucheng Zheng, and Lin Zhan. 2024. “Application of Markov Processes in Traffic Signal Control”. International Core Journal of Engineering 10 (11): 106-13. https://doi.org/10.6919/ICJE.202411_10(11).0015.