cross-validation

A mixed-integer optimization approach to an exhaustive cross-validated model selection for regression

  • Dennis Kreber
    • Categories (Mixed) Integer Nonlinear Programming, Statistics Tags , , , ,

    We consider a linear regression model for which we assume that many of the observed regressors are irrelevant for the prediction. To avoid overfitting, we conduct a variable selection and only include the true predictors for the least square fitting. The best subset selection gained much interest in recent years for addressing this objective. For … Read more

    Best Subset Selection via Cross-validation Criterion

  • Ryuhei Miyashiro
  • Yuichi Takano
    • Categories Integer Programming, Statistics Tags , , , ,

    This paper is concerned with the cross-validation criterion for best subset selection in a linear regression model. In contrast with the use of statistical criteria (e.g., Mallows’ $C_p$, AIC, BIC, and various information criteria), the cross-validation only requires the mild assumptions, namely, samples are identically distributed, and training and validation samples are independent. For this … Read more