A stochastic search on the line-based solution to discretized estimation

Authors:
Anis Yazidi;Ole-Christoffer Granmo;B. John Oommen
Affiliations:
Dept. of ICT, University of Agder, Grimstad, Norway;Dept. of ICT, University of Agder, Grimstad, Norway;School of Computer Science, Carleton University, Ottawa, Canada
Venue:
IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
Year:
2012

Citing 11
Cited 0

Detection of abrupt changes: theory and application

Detection of abrupt changes: theory and application
Stochastic learning-based weak estimation of multinomial random variables and its applications to pattern recognition in non-stationary environments

Pattern Recognition
Solving Stochastic Nonlinear Resource Allocation Problems Using a Hierarchy of Twofold Resource Allocation Automata

IEEE Transactions on Computers
Language detection and tracking in multilingual documents using weak estimators

SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
Anomaly Detection in Dynamic Systems Using Weak Estimators

ACM Transactions on Internet Technology (TOIT)
A novel approach to detection of intrusions in computer networks via adaptive sequential and batch-sequential change-point detection methods

IEEE Transactions on Signal Processing
Stochastic searching on the line and its applications to parameter learning in nonlinear optimization

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Continuous and discretized pursuit learning schemes: variousalgorithms and their comparison

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Generalized pursuit learning schemes: new families of continuous and discretized learning automata

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Stochastic Automata-Based Estimators for Adaptively Compressing Files With Nonstationary Distributions

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Learning Automata-Based Solutions to the Nonlinear Fractional Knapsack Problem With Applications to Optimal Resource Allocation

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Quantified Score

Hi-index	0.00

Visualization

Abstract

Recently, Oommen and Rueda [11] presented a strategy by which the parameters of a binomial/multinomial distribution can be estimated when the underlying distribution is nonstationary. The method has been referred to as the Stochastic Learning Weak Estimator (SLWE), and is based on the principles of continuous stochastic Learning Automata (LA). In this paper, we consider a new family of stochastic discretized weak estimators pertinent to tracking time-varying binomial distributions. As opposed to the SLWE, our proposed estimator is discretized, i.e., the estimate can assume only a finite number of values. It is well known in the field of LA that discretized schemes achieve faster convergence speed than their corresponding continuous counterparts. By virtue of discretization, our estimator realizes extremely fast adjustments of the running estimates by jumps, and it is thus able to robustly, and very quickly, track changes in the parameters of the distribution after a switch has occurred in the environment. The design principle of our strategy is based on a solution, pioneered by Oommen [7], for the Stochastic Search on the Line (SSL) problem. The SSL solution proposed in [7], assumes the existence of an Oracle which informs the LA whether to go "right" or "left". In our application domain, in order to achieve efficient estimation, we have to first infer (or rather simulate) such an Oracle. In order to overcome this difficulty, we rather intelligently construct an "Artificial Oracle" that suggests whether we are to increase the current estimate or to decrease it. The paper briefly reports conclusive experimental results that demonstrate the ability of the proposed estimator to cope with non-stationary environments with a high adaptation rate, and with an accuracy that depends on its resolution. The results which we present are, to the best of our knowledge, the first reported results that resolve the problem of discretized weak estimation using a SSL-based solution.