Soft-Reward Based Reinforcement Learning by Spiking Neural Networks

Article Preview

Abstract:

In this paper, we propose algorithm based reinforcement learning for spiking neural networks. The algorithm simulates biological adaptability and uses the soft-reward from environment to modulate the synaptic weight, which combines spike-timing-dependent plasticity (STDP), winner-take-all mechanism. The algorithm is tested to classify a number of standard benchmark dataset. The obtained results show the effectiveness of the proposed algorithm.

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 219-220)

Pages:

770-773

Citation:

Online since:

March 2011

Authors:

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2011 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] S. Thorpe, A. Delorme, R. Vanrullen, Spike based strategies for rapid processing., Neural Networks, 14(6-7), pp.715-726, (2001).

DOI: 10.1016/s0893-6080(01)00083-1

Google Scholar

[2] W. Maass, Networks of spiking neurons: the third generation of neural network models., Neural network, 10(9), pp.1659-1671, (1997).

DOI: 10.1016/s0893-6080(97)00011-7

Google Scholar

[3] W. Maass, Computation with spiking neuron., in Maass, W &Bishop, C.M.(ends.) Pulsed neural networks, MIT-Press, (1999).

Google Scholar

[4] Peter Dayan and L.F. Abbott Theoretical Neuroscience: Computational and Mathematical Modeling of Neural Systems., MIT-press (2001).

Google Scholar

[5] W. Gerster and W.M. Kistler Spiking neuron models: single neurons, populations, plasticity. Cambridge University Press, Cambridge (2002).

Google Scholar

[6] Bohte, S.M, Han La Poutre, and Kok, J.N, Unsupervised clustering with spiking neurons by sparse temporal coding and multiplayer RBF networks., IEEE Transactions on neural networks, vol.13 No.2, pp.426-435, (2002).

DOI: 10.1109/72.991428

Google Scholar

[7] Bohte, S.M and Kok, J.N, Han La Poutre Error-backprogation in temporally encoded networks of spiking neurons., Neurocomputing 48, pp.17-37, (2002).

DOI: 10.1016/s0925-2312(01)00658-0

Google Scholar