A batch ensemble approach to active learning with model selection

Authors:
Masashi Sugiyama;Neil Rubens
Affiliations:
Department of Computer Science, Graduate School of Information Science and Engineering, Tokyo Institute of Technology, 2-12-1 O-okayama, Meguro-ku, Tokyo 152-8552, Japan;Department of Computer Science, Graduate School of Information Science and Engineering, Tokyo Institute of Technology, 2-12-1 O-okayama, Meguro-ku, Tokyo 152-8552, Japan
Venue:
Neural Networks
Year:
2008

Citing 9
Cited 4

Bayesian interpolation

Neural Computation
Information-based objective functions for active data selection

Neural Computation
Learning and evaluating classifiers under sample selection bias

ICML '04 Proceedings of the twenty-first international conference on Machine learning
Algebraic Analysis for Nonidentifiable Learning Machines

Neural Computation
Active Learning in Approximately Linear Regression Based on Conditional Expectation of Generalization Error

The Journal of Machine Learning Research
Covariate Shift Adaptation by Importance Weighted Cross Validation

The Journal of Machine Learning Research
Active learning with statistical models

Journal of Artificial Intelligence Research
Paper: Modeling by shortest data description

Automatica (Journal of IFAC)
Statistical active learning in multilayer perceptrons

IEEE Transactions on Neural Networks

Pool-based active learning in approximate linear regression

Machine Learning
Complexity bounds for batch active learning in classification

ECML PKDD'10 Proceedings of the 2010 European conference on Machine learning and knowledge discovery in databases: Part III
Active data collection for efficient estimation and comparison of nonlinear neural models

Neural Computation
Improving importance estimation in pool-based batch active learning for approximate linear regression

Neural Networks

Quantified Score

Hi-index	0.00

Visualization

Abstract

Optimally designing the location of training input points (active learning) and choosing the best model (model selection)-which have been extensively studied-are two important components of supervised learning. However, these two issues seem to have been investigated separately as two independent problems. If training input points and models are simultaneously optimized, the generalization performance would be further improved. In this paper, we propose a new approach called ensemble active learning for solving the problems of active learning and model selection at the same time. We demonstrate by numerical experiments that the proposed method compares favorably with alternative approaches such as iteratively performing active learning and model selection in a sequential manner.