Energy Based Large Margin Classification of Gaussian Mixture Model

Abstract:

Large margin GMMs have many parallels to large margin nearest neighbors (LMNN), but with classes modeled by ellipsoids instead of each input data and its target neighbors by hyper-ellipsoid. Large margin GMMs naturally scales to large problems in multi-way classification. Based on large margin GMM classification, we develop a new classification method, i.e., energy based large margin classification of Gaussian mixture mode (ELM-GMM). Experiment shows that this new approach outperforms the large margin GMMs.

• Periodical: Advanced Materials Research (Volumes 271-273)
• Pages: 1601-1604
• DOI: https://doi.org/10.4028/www.scientific.net/AMR.271-273.1601
• Online since: July 2011
• Authors: Chuan Gang Zhao
• Keywords: Distance Metric Learning, Gaussian Mixture Model, Large Margin

References

[1] Kilian Q. Weinberger, Lawrence K: Saul. Distance MetricLlearning forLlarge Margin Nearest Neighbor Classification. Journal of Machine Learning Research 10(2009) 207-244.

[2] Guillaumin, M., Verbeek, J., Schmid, C.: IsThat You? Metric Learning Approaches for Face Identication. In: ICCV. (2009).

[3] L. Yang, R. Sukthankar, and S. C. H. Hoi: A Boosting Framework for Visuality Preserving Distance Metric Learning and its Application to Medical Image Retrieval. IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, Jan. (2010).

DOI: 10.1109/tpami.2008.273

[4] L. Yang and R. Jin: Distance Metric Learning: A Comprehensive Survey. Technical Report, Michigan State University, (2006).

[5] Xing, E., Ng, A., Jordan, M., Russell, S.: Distance Metric Learning, with Application to Clustering with Side-information. In: NIPS. (2004).

[6] S. Sun and Q. Chen: Kernel Regression with a Mahalanobis Metric for Short-term Traffic Flow Forecasting. Lecture Notes in Computer Science, 5326: 9–16, (2008).

DOI: 10.1007/978-3-540-88906-9_2

[7] Davis, J., Kulis, B., Jain, P., Sra, S., Dhillon, I.: Information-theoretic Metric Learning. In: ICML. (2007).

DOI: 10.1145/1273496.1273523

[8] Globerson, A., Roweis, S.: Metric Learning by Collapsing Classes. In: NIPS (2006).

[9] Sha, F., Saul, L.K.: Large Margin Gaussian Mixture Modeling for Phonetic Classification and Recognition. In: IEEE International Conference on Acoustics, Speech and Signal Processing. (2006) 265–268.

DOI: 10.1109/icassp.2006.1660008

[10] Manas A. Pathak, Bhiksha Raj: Large Margin Multiclass Gaussian Classification with Differential Privacy. In: ECML/PKDD(2010).

[11] Reda. Jourani, Khalid. Daoudi , Régine André-Obrecht, Driss Aboutajdine: Large Margin Gaussian Mixture Models for Speaker Identification. In: INTERSPEECH(2010).

DOI: 10.21437/interspeech.2010-144