Curiosity driven incremental LDA agent active learning

  • Authors:
  • Shaoning Pang;Seiichi Ozawa;Nik Kasabov

  • Affiliations:
  • Knowledge Engineering & Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand;Graduate School of Engineering, Faculty of Engineering, Kobe University, Japan;Knowledge Engineering & Discovery Research Institute, Auckland University of Technology, Auckland, New Zealand

  • Venue:
  • IJCNN'09 Proceedings of the 2009 international joint conference on Neural Networks
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presented a novel active linear discriminant analysis (LDA) learning method in the form of curiositydriven incremental LDA (cILDA) and multiple cILDA agents cooperative learning (mcILDA). The curiosity in psychology here is modelled mathematically as a discriminability residue inbetween instance space and its corresponding eigenspace. As the learning proceeds, the curiosity of an individual agent updates over time by two incremental learning processes: One updates the characterization of eigenspace and another re-calculates the curiosity. In the multi-agent scenario, individual agent communicates and cooperates with each other at every learning stage to discover the discriminant characterization of the whole pattern. In the experiment, we described how the discriminative instances could be significantly selected based on the curiosity with, at most, minor sacrifices in learning rate and classification accuracy. The experimental results show that the proposed curiosity learning performs gracefully under different level of redundancy, and the proposed cILDA/mcILDA learning system is capable of learning less instances, but has more often an improved discrimination performance.