The Adaptive Ensemble of OP-ELM Using Forward-Backward Selection

Article Preview

Abstract:

Extreme learning machine (ELM) as a neural network algorithm has shown its good performance in regression or classification applications, but it has a weak robustness. In this paper, a new approach called The Adaptive Ensemble Of OP-ELM using Forward-Backward Selection (AEOP-ELM) is presented, it consists of two significant steps, firstly, we use forward-Backward selection algorithm to select the inputs which will ensure the robustness of the output, then, we train several independent OP-ELM models, and we test them iteratively to find the adaptive weights which will improve the accuracy of the output. The experiments indicate the AEOP-ELM achieves a better robustness than the original ELM as well as a better accuracy.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

1666-1669

Citation:

Online since:

September 2013

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2013 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] G. Bebis and M. Georgiopoulos: Feed-forward neural networks, IEEE Potentials, Vol. 13(1994), pp.27-31.

DOI: 10.1109/45.329294

Google Scholar

[2] G. -B. Huang, Q. -Y. Zhu, and C. -K. Siew: Extreme learning machine: theory and applications, Neurocomputing, Vol. 70(2006), pp.489-501.

DOI: 10.1016/j.neucom.2005.12.126

Google Scholar

[3] G. -B. Huang, D. -H. Wang, and Y. Lan: Extreme learning machines: a survey, International Journal of Machine Learning and Cybernetics, Vol. 2(2011), pp.107-122.

Google Scholar

[4] Y. Miche, A. Sorjamaa, and P. Bas, et al.: OP-ELM: optimally pruned extreme learning machine, IEEE Transactions on Neural Networks, Vol. 21(2010), pp.158-162.

DOI: 10.1109/tnn.2009.2036259

Google Scholar

[5] Y. Miche, A. Sorjamaa, and A. Lendasse: OP-ELM: theory, experiments and a toolbox, Artificial Neural Networks-ICANN 2008, ed: Springer(2008), pp.145-154.

DOI: 10.1007/978-3-540-87536-9_16

Google Scholar

[6] T. Similä and J. Tikka: Multiresponse sparse regression with application to multidimensional scaling, "Artificial Neural Networks: Formal Models and Their Applications–ICANN 2005, ed: Springer(2005), pp.97-102.

DOI: 10.1007/11550907_16

Google Scholar

[7] L. K. Hansen and P. Salamon: Neural network ensembles, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 12(1990), pp.993-1001.

DOI: 10.1109/34.58871

Google Scholar

[8] M. van Heeswijk, Y. Miche, and T. Lindh-Knuutila, et al.: Adaptive ensemble models of extreme learning machines for time series prediction, Artificial Neural Networks–ICANN 2009, ed: Springer(2009), pp.305-314.

DOI: 10.1007/978-3-642-04277-5_31

Google Scholar