An empirical investigation of bias and variance in time series forecasting: modeling considerations and error evaluation

Authors:
V. L. Berardi;G. P. Zhang
Affiliations:
Graduate Sch. of Manage., Kent State Univ., North Canton, OH, USA;-
Venue:
IEEE Transactions on Neural Networks
Year:
2003

Citing 0
Cited 4

A neural network ensemble method with jittered training data for time series forecasting

Information Sciences: an International Journal
An artificial neural network (p,d,q) model for timeseries forecasting

Expert Systems with Applications: An International Journal
A novel hybridization of artificial neural networks and ARIMA models for time series forecasting

Applied Soft Computing
Software reliability prediction model based on support vector regression with improved estimation of distribution algorithms

Applied Soft Computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

Bias and variance play an important role in understanding the fundamental issue of learning and generalization in neural network modeling. Several studies on bias and variance effects have been published in classification and regression related research of neural networks. However, little research has been done in this area for time-series modeling and forecasting. We consider modeling issues related to understanding error components given the common practices associated with neural-network time-series forecasting. We point out the key difference between classification and time-series problems in consideration of the bias-plus-variance decomposition. A Monte Carlo study on the role of bias and variance in neural networks time-series forecasting is conducted. We find that both input lag structure and hidden nodes are important in contributing to the overall forecasting performance. The results also suggest that overspecification of input nodes in neural network modeling does not impact the model bias, but has significant effect on the model variance. Methods such as neural ensembles that focus on reducing the model variance, therefore, can be valuable and effective in time-series forecasting modeling.