Probabilidad Clásica de Sobreajuste con Criterios de Información: Estimaciones con Series Macroeconómicas Chilenas
Keywords: Nonparametric modelling, information criteria, overfitting, out-of-sample analysis
AbstractThis paper provides, via Monte Carlo simulations, estimates of the classical probability of overfitting under an autoregressive environment (AR), using the information criteria (IC) of Akaike, Schwarz and Hannan-Quinn (AIC, BIC and HQ), calibrated with Chilean data of total inflation, core inflation, IMACEC, and monthly return of the nominal exchange rate Chilean peso- American dollar. This probability corresponds to the number of times when a candidate model has a strictly greater number of coefficients than the true model, divided by the total number of searches. The results indicate that the increased risk of overfitting is obtained with the AIC, followed by HQ and finally the BIC. The highest probability of overfitting is achieved with the AIC, reaching 32 and 30% with the exchange rate and IMACEC, respectively, followed by 25 and 22% for total and core inflation. Considering the three IC, it is more likely to obtain an overfitted model by just one coefficient. Also, it is more likely that the overfitting does not exceed 10 coefficients. These results are important as quantifying the extent to which these variables are subject to overfitting risk when represented by AR models. The potential problems carried by overfitting includes: (i) the spurious regression, (ii) distor tthe estimation of impulse response function, and (iii) affect the predictive accuracy of the variable of interest. The latter problem is analyzed in detail.
How to Cite
Medel, C. A. (2015). Probabilidad Clásica de Sobreajuste con Criterios de Información: Estimaciones con Series Macroeconómicas Chilenas. Economic Analysis Review, 29(1), 57-72. Retrieved from https://www.rae-ear.org/index.php/rae/article/view/437
Upon submission of an article, authors are asked to indicate their agreement to abide by an open-access license. The license permits any user to download, print out, extract, archive, and distribute the article, so long as appropriate credit is given to the authors of the work. The license ensures that your article will be as widely available as possible and that your article can be included in any scientific archive. Please read about the Creative Commons Attribution License before submitting your paper.
Except where otherwise noted, content on this site is
licensed under a Creative Commons Attribution 3.0 License