A resource-allocating network for function interpolation
Neural Computation
A Bayesian/Information Theoretic Model of Learning to Learn viaMultiple Task Sampling
Machine Learning - Special issue on inductive transfer
Machine Learning - Special issue on inductive transfer
Learning to learn
A survey of connectionist network reuse through transfer
Learning to learn
Evolving Connectionist Systems: Methods and Applications in Bioinformatics, Brain Study and Intelligent Machines
2005 Special issue: Incremental learning of feature space and classifier for face recognition
Neural Networks - 2005 Special issue: IJCNN 2005
A Multitask Learning Approach to Face Recognition Based on Neural Networks
IDEAL '08 Proceedings of the 9th International Conference on Intelligent Data Engineering and Automated Learning
A multitask learning model for online pattern recognition
IEEE Transactions on Neural Networks
Incremental linear discriminant analysis for classification of data streams
IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Incremental learning methods with retrieving of interfered patterns
IEEE Transactions on Neural Networks
Bias learning, knowledge sharing
IEEE Transactions on Neural Networks
A generalized growing and pruning RBF (GGAP-RBF) neural network for function approximation
IEEE Transactions on Neural Networks
Incremental Learning of Chunk Data for Online Pattern Classification Systems
IEEE Transactions on Neural Networks
| Hi-index | 0.00 |
In this paper, a novel type of radial basis function network is proposed for multitask pattern recognition. We assume that recognition tasks are switched sequentially without notice to a learner and they have relatedness to some extent. We further assume that training data are given to learn one by one and they are discarded after learning. To learn a recognition system incrementally in such a multitask environment, we propose Resource Allocating Network for Multi-Task Pattern Recognition (RAN-MTPR). There are five distinguished functions in RAN-MTPR: one-pass incremental learning, task change detection, task categorization, knowledge consolidation, and knowledge transfer. The first three functions enable RAN-MTPR not only to acquire and accumulate knowledge of tasks stably but also to allocate classes to appropriate tasks unless task labels are not explicitly given. The fourth function enables RAN-MTPR to recover the failure in task categorization by minimizing the conflict in class allocation to tasks. The fifth function, knowledge transfer from one task to another, is realized by sharing the internal representation of a hidden layer with different tasks and by transferring class information of the most related task to a new task. The experimental results show that the recognition performance of RAN-MTPR is enhanced by introducing the two types of knowledge transfer and the consolidation works well to reduce the failure in task change detection and task categorization if the RBF width is properly set.