An Effective Method for Combining Kernels with Class Separability

Article Preview

Abstract:

We propose a simple but effective method to determine the kernel weights for convex combination of multiple kernels. The key property of the proposed method is that it adopts a class separability criterion as the evaluation function to measure the goodness of the individual kernel. Based on the principle of class separability, we assign a weight to each kernel that is proportional to the quality of the kernel. Experimental results on Image Segmentation data set show the proposed method can improve accuracy in comparison with that using a single kernel or uniformly-combined kernel.

You might also be interested in these eBooks

Info:

Periodical:

Pages:

2224-2227

Citation:

Online since:

November 2012

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2012 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] J. Shawe-Taylor and N. Cristianini. Kernel methods for pattern analysis. Cambridge University Press, Cambridge (2004).

Google Scholar

[2] V. Vapnik. The nature of Statistical Learning Theory. Springer-Verlag, New York (1995).

Google Scholar

[3] G.R.G. Lanckriet, N. Cristianini, P. Bartlett, L.E. Ghaoui, and M.I. Jordan. Learning the kernel matrix with semidefinite programming. Journal of Machine Learning Research 5 (2004): 27-72.

Google Scholar

[4] F.R. Bach, G.R.G. Lanckriet, and M.I. Jordan. Multiple kernel learning, conic duality, and the SMO algorithm. In: Proceedings of the 21st International Conference on Machine Learning (2004): 41-48.

DOI: 10.1145/1015330.1015424

Google Scholar

[5] M. Gönen and E. Alpayın. Multiple kernel learning algorithms. Journal of Machine Learning Research 12 (2011): 2211-2268.

Google Scholar

[6] A. Zien and C.S. Ong. Multiclass multiple kernel learning. In: Proceedings of the 24th International Conference on Machine Learning (2007): 1191–1198.

DOI: 10.1145/1273496.1273646

Google Scholar

[7] L. Wang. Feature selection with kernel class separability. IEEE Transactions on Pattern Analysis and Machine Intelligence 30 (9) (2008): 1534-1546.

DOI: 10.1109/tpami.2007.70799

Google Scholar

[8] A. Frank and A. Asuncion. UCI Machine Learning Repository. http://archive.ics.uci.edu/ml/, (2010).

Google Scholar