Non-flat Function Estimation Using Orthogonal Least Squares Regression with Multi-scale Wavelet Kernel

Authors:
Meng Zhang;Lihua Fu;Tingting He;Gaofeng Wang
Affiliations:
Department of Computer Science, Central China Normal University, 430079 Wuhan, P.R. China;School of Mathematics and Physics, Chinese University of Geosciences, 430074 Wuhan, P.R. China;Department of Computer Science, Central China Normal University, 430079 Wuhan, P.R. China;CJ Huang Information Technology Research Institute, Wuhan University, 430072 Wuhan, P.R. China
Venue:
ISNN '07 Proceedings of the 4th international symposium on Neural Networks: Advances in Neural Networks
Year:
2007

Citing 7
Cited 0

Ten lectures on wavelets

Ten lectures on wavelets
Least Squares Support Vector Machine Classifiers

Neural Processing Letters
Letters: Training sparse MS-SVR with an expectation-maximization algorithm

Neurocomputing
Kernel basis pursuit

ECML'05 Proceedings of the 16th European conference on Machine Learning
Wavelet support vector machine

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Experiments with repeating weighted boosting search for optimization signal processing applications

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Combined genetic algorithm optimization and regularized orthogonal least squares learning for radial basis function networks

IEEE Transactions on Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Estimating the non-flat function which comprises both the steep variations and the smooth variations is a hard problem. The existing kernel methods with a single common variance for all the regressors can not achieve satisfying results. In this paper, a novel multi-scale model is constructed to tackle the problem by orthogonal least squares regression (OLSR) with wavelet kernel. The scheme tunes the dilation and translation of each wavelet kernel regressor by incrementally minimizing the training mean square error using a guided random search algorithm. In order to prevent the possible over-fitting, a practical method to select termination threshold is used. The experimental results show that, for non-flat function estimation problem, OLSR outperforms traditional methods in terms of precision and sparseness. And OLSR with wavelet kernel has a faster convergence rate as compared to that with conventional Gaussian kernel.