Research on Control Method of Expressway Off-Ramp Based on Q-Learning Algorithm and Extension Control

Xiao Ming Liu; Xiu Ying Wang

doi:10.4028/www.scientific.net/AMR.433-440.6033

Paper Titles

Study on Quasi-Orthogonal Space Time Block Code Based on Amplify-and-Forward Relay Networks
p.6014

Product-Image Classification with Support Vector Machine
p.6019

Simulation Research About Air Conditioning Load Calculation
p.6023

The Calculation of Earth Capacitance Based on Least Square Method
p.6028

Research on Control Method of Expressway Off-Ramp Based on Q-Learning Algorithm and Extension Control
p.6033

Study of Cascade Seven-Level Parallel Active Filter
p.6038

Real-Time Optimal Speed Coordination and Scheduling for High-Speed Trains Based on Model Predictive Control
p.6043

Dynamic Fast Database Mining Algorithm Based on Association Rules
p.6049

Low Wave Number Radar Image Energy Influence on Determining Current
p.6054

HomeAdvanced Materials ResearchAdvanced Materials Research Vols. 433-440Research on Control Method of Expressway Off-Ramp...

Research on Control Method of Expressway Off-Ramp Based on Q-Learning Algorithm and Extension Control

Abstract:

The movement characteristics of traffic flow nearby have the important influence on the main line. The control method of expressway off-ramp based on Q-learning and extension control is established by analyzing parameters of off-ramp and auxiliary road. First, the basic description of Q-learning algorithm and extension control is given and analyzed necessarily. Then reward function is gained through the extension control theory to judge the state of traffic light. Simulation results show that compared to the queue lengths of off-ramp and auxiliary road, control method based on Q-learning algorithm and extension control greatly reduced queue length of off-ramp, which demonstrates the feasibility of control strategies.

You might also be interested in these eBooks

View Preview

Info:

Periodical:

Advanced Materials Research (Volumes 433-440)

Pages:

6033-6037

DOI:

https://doi.org/10.4028/www.scientific.net/AMR.433-440.6033

Citation:

Cite this paper

Online since:

January 2012

Authors:

Xiao Ming Liu, Xiu Ying Wang

Keywords:

Extension Control, Off-Ramp, Q-Learning Algorithm, Reward Function

Export:

RIS, BibTeX

Price:

Permissions CCC:

Request Permissions

Permissions PLS:

Request Permissions

Сopyright:

Citation:

References

[1] Li Shuangshuang. Study on Optimization Methods of Auxiliary Road Controlling Parameters of Urban Expressway Off-ramp[D]. Jinlin: Master's thesis of Jilin University, 2007. 6.

Google Scholar

[2] Yuanzhang Liang, Li Honghai. Expressway exit side roads signal fuzzy tuning control [A] . 2008 Fourth China Intelligent Transport Annual Meeting Technology [C], (2008).

Google Scholar

[3] Chen Yang Zhou, Hui. Based on Q Learning Agent in a single intersection traffic control application [J]. Beijing: Highway and Transportation Research, 2007, 24 (05) : 117-120.

Google Scholar

[4] Zhang. Based on extension logic, intelligent control [D]. Nanjing: Nanjing University, 2002. 6.

Google Scholar

[5] Zhang Hui, Yang Chen Zhou, Yu-Zhen Yang, Shih-Wei Lee and so on. Based on Multi-gent coordination of regional traffic control [J]. Beijing: Computer and Communications, 2006, 2 (24) : 94-97.

Google Scholar