Paper Title:
Discrete Action Dependant Heuristic Dynamic Programming in Control of a Wheeled Mobile Robot
  Abstract

In presented paper we propose a discrete tracking control algorithm for a two-wheeled mobile robot. The control algorithm consists of discrete Adaptive Critic Design (ACD) in Action Dependant Heuristic Dynamic Programming (ADHDP) configuration, PD controller and a supervisory term, derived from the Lyapunov stability theorem and based on the variable structure systems theory. Adaptive Critic Designs are a group of algorithms that use two independent structures for estimation of optimal value function from Bellman equation and estimation of optimal control law. ADHDP algorithm consists of Actor (ASE - Associate Search Element) that estimates the optimal control law and Critic (ACE - Adaptive Critic Element) that evaluates quality of control by estimation of the optimal value function from Bellman equation. Both structures are realized in a form of Neural Networks (NN). ADHDP algorithm does not require a plant model (the wheeled mobile robot (WMR) model) for ACE or ASE neural network weights update procedure (in contrast with other ACD configurations e.g. Heuristic Dynamic Programming or Dual Heuristic Programming that use the plant model). In presented control algorithm Actor-Critic structure is supported by PD controller and the supervisory term, that guarantee stable implementation of tracking in an initial adaptive critic neural networks learning phase, and robustness in a face of disturbances. Verification of proposed control algorithm was realized on the two-wheeled mobile robot Pioneer-2DX.

  Info
Periodical
Solid State Phenomena (Volume 164)
Edited by
Andrejus H. Marcinkevičius and Algirdas V.Valiulis
Pages
419-424
DOI
10.4028/www.scientific.net/SSP.164.419
Citation
Z. Hendzel, M. Szuster, "Discrete Action Dependant Heuristic Dynamic Programming in Control of a Wheeled Mobile Robot", Solid State Phenomena, Vol. 164, pp. 419-424, 2010
Online since
June 2010
Export
Price
$32.00
Share

In order to see related information, you need to Login.

In order to see related information, you need to Login.

Authors: Tian Pei Zhou, Wen Fang Huang
Abstract:In the process of recycling chemical product in coking object, ammonia and tar were indispensable both metallurgy and agriculture, so the...
1945
Authors: Jie Jin, Xi Kong, Lan Lan Zhao
Abstract:Using the Least Mean Square (LMS) algorithm, this paper simulates two smart antenna models under the same signal environment. By analyzing...
6
Authors: Jun Zhang, Kan Yu Zhang
Chapter 19: Modeling, Analysis, and Simulation of Manufacturing Processes II
Abstract:Good dynamic performance of a system have great significance in the traditional sense, furthermore,it is more important at the point of...
4768
Authors: Hui Qin Sun, Zhi Hong Xue, Ke Jun Sun, Su Zhi Wang, Yun Du
Chapter 2: Manufacturing Technology
Abstract:BP neural network is currently the most widely used of neural network models in practical application in transformer fault diagnosis. BP...
789
Authors: Jian Xue Chen, Shui Yu
Chapter 4: Mechatronics and Automation Manufacturing Systems, Control Technologies
Abstract:Combining ant colony optimization (ACO) algorithm with back-propagation (BP) algorithm, the ACO-BP algorithm is proposed to optimize shift...
553