Please use this identifier to cite or link to this item:
Title: Minimum description length neural networks for time series prediction
Authors: Small, Michael
Tse, C. K. Michael
Subjects: Algorithms
Computer simulation
Data reduction
Information analysis
Iterative methods
Radial basis function networks
Real time systems
Time series analysis
Issue Date: Dec-2002
Publisher: American Physical Society
Source: Physical review E, statistical, nonlinear, and soft matter physics, Dec. 2002, v. 66, no. 6, 066701, p. 1-12.
Abstract: Artificial neural networks (ANN) are typically composed of a large number of nonlinear functions (neurons) each with several linear and nonlinear parameters that are fitted to data through a computationally intensive training process. Longer training results in a closer fit to the data, but excessive training will lead to overfitting. We propose an alternative scheme that has previously been described for radial basis functions (RBF). We show that fundamental differences between ANN and RBF make application of this scheme to ANN nontrivial. Under this scheme, the training process is replaced by an optimal fitting routine, and overfitting is avoided by controlling the number of neurons in the network. We show that for time series modeling and prediction, this procedure leads to small models (few neurons) that mimic the underlying dynamics of the system well and do not overfit the data. We apply this algorithm to several computational and real systems including chaotic differential equations, the annual sunspot count, and experimental data obtained from a chaotic laser. Our experiments indicate that the structural differences between ANN and RBF make ANN particularly well suited to modeling chaotic time series data.
Rights: Copyright 2002 by the American Physical Society
Type: Journal/Magazine Article
DOI: 10.1103/PhysRevE.66.066701
ISSN: 1063-651X
Appears in Collections:EIE Journal/Magazine Articles

Files in This Item:
File Description SizeFormat 
series-prediction_02.pdf150.57 kBAdobe PDFView/Open

All items in the PolyU Institutional Repository are protected by copyright, with all rights reserved, unless otherwise indicated. No item in the PolyU IR may be reproduced for commercial or resale purposes.