A novel incremental linear discriminant analysis for multitask pattern recognition problems

Authors:
Masayuki Hisada;Seiichi Ozawa;Kau Zhang;Shaoning Pang;Nikola Kasabov
Affiliations:
Graduate School of Engineering, Kobe University, Kobe, Japan;Graduate School of Engineering, Kobe University, Kobe, Japan;Graduate School of Engineering, Kobe University, Kobe, Japan;Knowledge Engineering & Discover Research Institute, Auckland University of Technology, Auckland, New Zealand;Knowledge Engineering & Discover Research Institute, Auckland University of Technology, Auckland, New Zealand
Venue:
ICONIP'08 Proceedings of the 15th international conference on Advances in neuro-information processing - Volume Part I
Year:
2008

Citing 4
Cited 0

Multitask Learning

Machine Learning - Special issue on inductive transfer
Incremental Learning for Multitask Pattern Recognition Problems

ICMLA '08 Proceedings of the 2008 Seventh International Conference on Machine Learning and Applications
Incremental linear discriminant analysis for classification of data streams

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Face recognition using recursive Fisher linear discriminant

IEEE Transactions on Image Processing

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a new incremental linear discriminant analysis (ILDA) for multitask pattern recognition (MTPR) problems in which training samples of a specific recognition task are given one after another for a certain period of time and the task is switched to another related task in turn. The Pang et al.'s ILDA is extended such that a discriminant space of the current task is augmented with effective discriminant vectors that are selected from other related tasks based on the class separability. We call the selection and augmentation of such discriminant vectors knowledge transfer of feature subspaces. In the experiments, the proposed ILDA is evaluated for the four MTPR problems, each of which consists of three multi-class recognition tasks. The results demonstrate that the proposed ILDA outperforms the ILDA without the knowledge transfer with regard to both the class separability and recognition accuracy. From the experimental results, we confirm that the proposed knowledge transfer mechanism works well to construct effective discriminant feature spaces incrementally.