Stochastic learning-based weak estimation of multinomial random variables and its applications to pattern recognition in non-stationary environments

Authors:
B. John Oommen;Luis Rueda
Affiliations:
School of Computer Science, Carleton University, 1125 Colonel By Dr., Ottawa, ON, Canada, K1S 5B6;School of Computer Science, University of Windsor, 401 Sunset Avenue, Windsor, ON, Canada, N9B 3P4
Venue:
Pattern Recognition
Year:
2006

Citing 11
Cited 13

Absorbing and ergodic discretized two-action learning automata

IEEE Transactions on Systems, Man and Cybernetics
Learning automata: an introduction

Learning automata: an introduction
Statistical inference

Statistical inference
AI Game Programming Wisdom

AI Game Programming Wisdom
Learning Algorithms Theory and Applications

Learning Algorithms Theory and Applications
A New Approach to the Design of Reinforcement Schemes for Learning Automata: Stochastic Estimator Learning Algorithms

IEEE Transactions on Knowledge and Data Engineering
Hierarchical Discretized Pursuit Nonlinear Learning Automata with Rapid Convergence and High Accuracy

IEEE Transactions on Knowledge and Data Engineering
Pattern Classification (2nd Edition)

Pattern Classification (2nd Edition)
Pattern Recognition, Third Edition

Pattern Recognition, Third Edition
Finite time analysis of the pursuit algorithm for learning automata

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Continuous and discretized pursuit learning schemes: variousalgorithms and their comparison

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Multi-agent System Approach to React to Sudden Environmental Changes

MLDM '07 Proceedings of the 5th international conference on Machine Learning and Data Mining in Pattern Recognition
A Cascade Multiple Classifier System for Document Categorization

MCS '09 Proceedings of the 8th International Workshop on Multiple Classifier Systems
A Hierarchy of Twofold Resource Allocation Automata Supporting Optimal Sampling

IEA/AIE '09 Proceedings of the 22nd International Conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems: Next-Generation Applied Intelligence
Solving multiconstraint assignment problems using learning automata

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Optimal sampling for estimation with constrained resources using a learning automaton-based solution for the nonlinear fractional knapsack problem

Applied Intelligence
Language detection and tracking in multilingual documents using weak estimators

SSPR&SPR'10 Proceedings of the 2010 joint IAPR international conference on Structural, syntactic, and statistical pattern recognition
Anomaly Detection in Dynamic Systems Using Weak Estimators

ACM Transactions on Internet Technology (TOIT)
A User-Centric Approach for Personalized Service Provisioning in Pervasive Environments

Wireless Personal Communications: An International Journal
On utilizing stochastic learning weak estimators for training and classification of patterns with non-stationary distributions

KI'05 Proceedings of the 28th annual German conference on Advances in Artificial Intelligence
Tracking the preferences of users using weak estimators

AI'11 Proceedings of the 24th international conference on Advances in Artificial Intelligence
A stochastic search on the line-based solution to discretized estimation

IEA/AIE'12 Proceedings of the 25th international conference on Industrial Engineering and Other Applications of Applied Intelligent Systems: advanced research in applied artificial intelligence
A rank-one update method for least squares linear discriminant analysis with concept drift

Pattern Recognition
Just-in-time adaptive similarity component analysis in nonstationary environments

Journal of Intelligent & Fuzzy Systems: Applications in Engineering and Technology

Quantified Score

Hi-index	0.01

Visualization

Abstract

In this paper, we formally present a novel estimation method, referred to as the Stochastic Learning Weak Estimator (SLWE), which yields the estimate of the parameters of a binomial distribution, where the convergence of the estimate is weak, i.e. with regard to the first and second moments. The estimation is based on the principles of stochastic learning. The mean of the final estimate is independent of the scheme's learning coefficient, @l, and both the variance of the final distribution and the speed decrease with @l. Similar results are true for the multinomial case, except that the equations transform from being of a scalar type to be of a vector type. Amazingly enough, the speed of the latter only depends on the same parameter, @l, which turns out to be the only non-unity eigenvalue of the underlying stochastic matrix that determines the time-dependence of the estimates. An empirical analysis on synthetic data shows the advantages of the scheme for non-stationary distributions. The paper also briefly reports (without detailed explanation) conclusive results that demonstrate the superiority of SLWE in pattern-recognition-based data compression, where the underlying data distribution is non-stationary. Finally, and more importantly, the paper includes the results of two pattern recognition exercises, the first of which involves artificial data, and the second which involves the recognition of the types of data that are present in news reports of the Canadian Broadcasting Corporation (CBC). The superiority of the SLWE in both these cases is demonstrated.