Smooth Test of Density Forecast Evaluation with Independent and Serially Dependent Data

Publication Type

Conference Paper

Publication Date

6-2004

Abstract

Recently financial econometricians have shifted their attention from point and interval forecasts to density forecasts mainly to address the issue of the huge loss of information that results from depicting portfolio risk by a measure of dispersion alone. One of the major problems in this area has been the evaluation of the quality of different density forecasts. In this paper, we propose an analytical test for density forecast evaluation using Neyman (1937) smooth test procedure for both independent and serially dependent data. Apart from indicating the acceptance or rejection of the hypothesized model, this approach provides specific sources (such as the mean, variance, skewness and kurtosis or the location, scale and shape of the distribution or types of dependence) of departure, thereby helping in deciding possible modifications of the assumed forecast model. We also address the issue of where to split the sample into in-sample (estimation sample) and out-of-sample (testing sample) observations in order to evaluate the “goodness-of-fit†of the forecasting model both analytically, as well as through simulation exercises. Monte Carlo studies revealed that the proposed test has good size and power properties; finite sample properties of this test favorably compare with existing Goodness-of-Fit tests in statistics literature. We further investigate applications to value weighted S&P 500 returns that initially indicates that introduction of a conditional heteroscedasticity model significantly improve the model over one with constant conditional variance. The simplicity of the proposed test based on the classical score test will particularly appealling because it not only tests the assumed model but also directs to a better model if the assumed one is not valid.

Keywords

Score Test; Density Forecast Evaluation; Probability Integral Transform; Goodness-of-Fit test; Serially Dependent Data; Simulation methods

Discipline

Econometrics

Research Areas

Econometrics

Publication

North America Summer Meetings of the Econometric Society, Brown University, Rhode Island, USA (June 17-20); The Australasia meetings of the Econometric Society, Melbourne (July 7-9); The International Symposium on Forecasting in Sydney (July 4-7)

Comments

(Under Revision for JBES)

Additional URL

http://econpapers.repec.org/paper/ecmnasm04/319.htm

This document is currently not available here.

Share

COinS