Paper Title:
Pricing Scheme Based Nash Q-Learning Flow Control for Multi-User Network
  Abstract

For the congestion problems with multi-user existing in high-speed networks, a pricing scheme based Nash Q-learning flow controller is proposed. It considers a network with a single service provider, and some non-cooperative users. The pricing scheme is introduced to the design of the reward function in the learning process of Q-learning. Because of the uncertainties and highly time-varying, it is not easy to accurately obtain the complete information for high-speed networks. The Nash Q-learning, which is independent of mathematic model, shows particular superiority. It obtains the Nash Q-values through trial-and-error and interaction with the environment to improve its behavior policy. By means of learning process, the proposed controller can learn to take the best actions to regulate source flow with the features of high quality of service. Simulation results show that the proposed controller can promote the performance of the networks and avoid the occurrence of congestion effectively.

  Info
Periodical
Key Engineering Materials (Volumes 467-469)
Edited by
Dehuai Zeng
Pages
847-852
DOI
10.4028/www.scientific.net/KEM.467-469.847
Citation
X. Li, H. B. Yu, "Pricing Scheme Based Nash Q-Learning Flow Control for Multi-User Network", Key Engineering Materials, Vols. 467-469, pp. 847-852, 2011
Online since
February 2011
Authors
Export
Price
$32.00
Share

In order to see related information, you need to Login.

In order to see related information, you need to Login.

Authors: Xiao Li, Xiao Hua Yang
Abstract:Considering the nonlinear and time-variable characteristics of the injection cylinder system of hydraulic injection molding machine (HIMM), a...
1117
Authors: Er Chao Li, Zhan Ming Li
Chapter 3: Mechatronics and Automation
Abstract:In order to realize precise contact tasks with an unknown environment, robotic force controllers have to adapt themselves to the unknown...
2117
Authors: Yong Feng Ju, Xiao Wei Wei
Chapter 7: Mechanical & Automation
Abstract:Short-traffic flow forecasting is an important part of ITS, and its accuracy and real-time is directly related to the effect of traffic...
969
Authors: Huan Xin Cheng, Peng Li
Chapter 8: Mechatronics and its Application
Abstract:A mathematical model of engine throttle as the controlled object is established and then the neural network algorithms and PID control are...
939
Authors: Aqeel S. Jaber, Abu Zaharin B. Ahmad, Ahmed N. Abdalla
Chapter 1: Optimization and Сomputational Techniques in Materials and Manufacturing
Abstract:One of the most important rules in electric power system operation and control is Load Frequency Controller (LFC). Many problems are subject...
80