Research on Bayesian Model Averaging for Lasso Based on Analysis of Scientific Materials

Article Preview

Abstract:

The Lasso (least absolute shrinkage and selection operator) estimates a vector of regression coefficients by minimizing the residual sum of squares subject to a constraint on the -norm of coefficient vector, which has been an attractive technique for regularization and variable selection. In this paper, we study the Bayesian Model Averaging(BMA) for Lasso, which accounts for the uncertainty about the best model to choose by averaging over multiple models. Experimental results on simulated data show that BMA has significant advantage over the model selection method based on Bayesian information criterion (BIC).

You might also be interested in these eBooks

Info:

Periodical:

Advanced Materials Research (Volumes 282-283)

Pages:

334-337

Citation:

Online since:

July 2011

Authors:

Export:

Price:

Permissions CCC:

Permissions PLS:

Сopyright:

© 2011 Trans Tech Publications Ltd. All Rights Reserved

Share:

Citation:

[1] Robert Tibshirant. Regression shrinkage and selection via the lasso. J. R. Statist. Soc. B, 58(1): 267–288, (1996).

Google Scholar

[2] H. Liu and J. Zhang. On the l1- lq regularized regression. Technical report, Technical Report arXiv: 0802. 1517 v1, Carnegie Mellon University, (2008).

Google Scholar

[3] T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. Springer, (2008).

Google Scholar

[4] Bradley Efron, Trevor Hastie, Iain Johnstone, and Robert Tibshirani. Least angle regression. Annals of Statistics, 32: 407–499, (2004).

DOI: 10.1214/009053604000000067

Google Scholar

[5] C. Fraley and T. Hesterberg. Least angle regression and LASSO for large datasets. Statistical Analysis and Data Mining, 1(4): 251–259, (2009).

DOI: 10.1002/sam.10021

Google Scholar

[6] H. Zou, T. Hastie, and R. Tibshirani. On the degrees of freedom, of the lasso. Annals of Statistics, 35(5): 2173–2192, (2007).

DOI: 10.1214/009053607000000127

Google Scholar

[7] C.M. Stein. Estimation of the mean of a multivariate normal distribution. The Annals of Statistics, 9(6): 1135–1151, (1981).

Google Scholar

[8] J.H. Friedman. Multivariate adaptive regression splines. The Annals of Statistics, 19(1): 1–67, 1991. �������������������������������������������������������������������������������������������������������������������������������.

Google Scholar