Quantum-Behaved Particle Swarm Optimization Using Q-Learning

Abstract:

Quantum-behaved particle swarm optimization (QPSO) has shown excellent performance in solving optimization problems which inspired by analysis from particle swarm optimization (PSO) and quantum mechanics. In QPSO, the only parameter contraction-expansion coefficient β is vital to the performance of algorithm. This paper employs Q-Learning strategy and presents a novel parameter control method to improve QPSO performance. Then the empirical studies on a suite of well-known benchmark functions are to be performed to test performance. Finally, a further performance comparison between the proposed algorithm and other parameter control methods of QPSO are listed and the simulation results show the efficiency of the proposed QPSO with novel adaptive strategies.

• Periodical: Applied Mechanics and Materials (Volumes 556-562)
• Pages: 3965-3971
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.556-562.3965
• Online since: May 2014
• Authors: Xin Yi Sheng*, Jun Sun, Wen Bo Xu
• Keywords: Parameter Control, PSO, Q-Learning, QPSO

References

[1] J. Kennedy and R.C. Eberhart. Particle swarm optimization, Proceedings of IEEE International Conference on Neural Networks, pp.1942-1948, (1995).

[2] Y. Shi and R.C. Eberhart. A modified particle swarm optimizer,. Proceedings of IEEE International Conference on Evolutionary Computation, p.69–73, (1998).

DOI: 10.1109/icec.1998.699146

[3] M. Clerc. The swarm and the queen: Towards a deterministic and adaptive particle swarm optimization,. Proceedings of Congress on Evolutionary Computation, p.1951–1957, (1999).

DOI: 10.1109/cec.1999.785513

[4] J. Sun , B. Feng, and W. Xu. Particle swarm optimization with particles having quantum behavior,. Proceedings of Congress on Evolutionary Computation, p.326–331, (2004).

DOI: 10.1109/cec.2004.1330875

[5] J. Sun , B. Feng, and W. Xu. A global search strategy of quantum-behaved particle swarm optimization,. Proceedings of IEEE Conference on Cybernetics and Intelligent Systems, p.111–116, (2004).

DOI: 10.1109/iccis.2004.1460396

[6] D Zhou, J Sun, Choi-Hong Lai, Wenbo Xu, Xiaoguang Lee: An improved quantum-behaved particle swarm optimization and its application to medical image registration[J]. Int. J. Comput. Math. 2011, 88(6): 1208-1223.

DOI: 10.1080/00207160.2010.499934

[7] Jun Sun, Wei Fang, Xiaojun Wu, Zhenping Xie, Wenbo Xu: QoS multicast routing using a quantum-behaved particle swarm optimization algorithm[J]. Eng. Appl. of AI 24(1), 2011: 123-131.

DOI: 10.1016/j.engappai.2010.08.001

[8] J. Sun, W. Fang, X. Wu, P. Vasile, W. Xu. Quantum-behaved particle swarm optimization analysis of individual particle behavior and parameter selection,. Evolutionary computation, 20(3), 349-39, (2012).

DOI: 10.1162/evco_a_00049

[9] J. Sun, W. Xu, and J. Liu. Parameter selection of quantum-behaved particle swarm optimization,. Advances in Natural Computation, pp.543-52, (2005).

DOI: 10.1007/11539902_66

[10] M. Xi, J. Sun, and W. Xu. An improved quantum-behaved particle swarm optimization algorithm with weighted mean best position,. Applied Mathematics and Computation, vol. 205(2), pp.751-9, (2008).

DOI: 10.1016/j.amc.2008.05.135

[11] W. Fang, J. Sun, and W. Xu. Improved quantum-behaved particle swarm optimization algorithm based on differential evolution operator and its application,. Journal of System Simulation, vol. 20(24), pp.6740-6744, (2008).

[12] W. Fang. Swarm intelligence and its application in the optimal design of digital filters, PHD thesis, (2008).

[13] Sutton R. S., Barto A. G., Reinforcement learning: An introduction[M]. Cambridge: MIT Press, (1998).