Nonlinear Inertia Weigh Particle Swarm Optimization Combines Simulated Annealing Algorithm and Application in Function and SVM Optimization

Abstract:

This paper proposes an improved particle swarm optimization algorithm (PSO) for the global and local equilibrium problem of searching ability. It improves the iterative way of inertia weight in PSO, using non-linear decreasing algorithm to balance, then PSO combines with simulated annealing (SA). Finally, the optimization test experiments are carried out for the typical functions with the algorithm (ULWPSO-SA), and compare with the basic PSO algorithm. Simulation experiments show that local search ability of algorithm, convergence speed, stability and accuracy have been significantly improved. In addition, the novel algorithm is used in the parameter optimization of support vector machines (ULWPSOSA-SVM), and the experimental results indicate that it gets a better classification performance compared with SVM and PSO-SVM.

• Periodical: Applied Mechanics and Materials (Volumes 130-134)
• Pages: 3467-3471
• DOI: https://doi.org/10.4028/www.scientific.net/AMM.130-134.3467
• Online since: October 2011
• Authors: Bin Jiao, Zhi Xiang Xu
• Keywords: Function Optimization, Inertia Weight, Parameter Optimization, Particle Swarm Optimization Algorithm (PSO), Simulated Annealing Algorithm

References

[1] Kennedy. J, Eberhart R.C. Particle swarm optimization [C]. Proc of IEEE International Conference on Neural Networks. USA: IEEE Press (1995).

[2] J. H Seo, C.H. Im, in: Multimodal Function Optimization Based on Particle Swarm Optimization[J]. IEEE Trans. On Magnetics (SO018-9464)( 2006).

DOI: 10.1109/tmag.2006.871568

[3] X.H. Shi, Y.C. Liang, H.P. Lee, in: An improved GA and a novel PSO-GA-based hybrid algorithm [J]．Imformation Processing Letters(S0020一0190)(2005).

DOI: 10.1016/j.ipl.2004.11.003

[4] E.H.L. Aarts, J.H.M. Korst, in: Simulated annealing and Boltzmann machines, John Wiley and Sons(1989).

[5] Shi. Y, Eberhart. R, in: A modified particle swarm optimizer[A], IEEE Int. Conf. on Evolutionary Computation [C], Piscataway, NJ, IEEE Service Center(1998).

DOI: 10.1109/icec.1998.699146

[6] EBEMART. R, SHI. Y, in: Particle swam optimizer developments applications and resources[C], Proceedings of the 2001 Congress on Evolutionary Computation. NJ USA: IEEE (2001).

[7] SHI. Y, EBEMART.R. C, in: Fuzzy adaptive particle swarm optimization[C], Proceedings of the IEEE International Conference on Evolutionary Computation. NJ USA: IEEE (2001).

[8] Krikpatrickn. S, in: Optimization by Simulated Annealing [J]. Science (1983).

[9] Vapnik.V. N, in: The nature of statistical learning theory [M]. Zhang Xuegong. Translate. BeiJing: Tsinghua University Press (2000).

[10] Information on www. ics. uci. edu/~mlearn/MLRepository. html.