Model averaging based on Kullback-Leibler distance

Publication Type:
Journal Article
Statistica Sinica, 2015, 25 (4), pp. 1583 - 1598
Issue Date:
Full metadata record
© 2015, Institute of Statistical Science. All rights reserved. This paper proposes a model averaging method based on Kullback-Leibler distance under a homoscedastic normal error term. The resulting model average estimator is proved to be asymptotically optimal. When combining least squares estimators, the model average estimator is shown to have the same large sample properties as the Mallows model average (MMA) estimator developed by Hansen (2007). We show via simulations that, in terms of mean squared prediction error and mean squared parameter estimation error, the proposed model average estimator is more efficient than the MMA estimator and the estimator based on model selection using the corrected Akaike information criterion in small sample situations. A modified version of the new model average estimator is further suggested for the case of heteroscedastic random errors. The method is applied to a data set from the Hong Kong real estate market.
Please use this identifier to cite or link to this item: