Online Feature Selection with Streaming Features

Authors:
Xindong Wu;Kui Yu;Wei Ding;Hao Wang;Xingquan Zhu
Affiliations:
Hefei University of Technology, Hefei and University of Vermont, Burlington;Hefei University of Technology, Hefei;University of Massachusetts Boston, Boston;Hefei University of Technology, Hefei;University of Technology, Sydney
Venue:
IEEE Transactions on Pattern Analysis and Machine Intelligence
Year:
2013

Citing 0
Cited 2

Towards long-lead forecasting of extreme flood events: a data mining framework for precipitation cluster precursors identification

Proceedings of the 19th ACM SIGKDD international conference on Knowledge discovery and data mining
Online group feature selection

IJCAI'13 Proceedings of the Twenty-Third international joint conference on Artificial Intelligence

Quantified Score

Hi-index	0.14

Visualization

Abstract

We propose a new online feature selection framework for applications with streaming features where the knowledge of the full feature space is unknown in advance. We define streaming features as features that flow in one by one over time whereas the number of training examples remains fixed. This is in contrast with traditional online learning methods that only deal with sequentially added observations, with little attention being paid to streaming features. The critical challenges for Online Streaming Feature Selection (OSFS) include 1) the continuous growth of feature volumes over time, 2) a large feature space, possibly of unknown or infinite size, and 3) the unavailability of the entire feature set before learning starts. In the paper, we present a novel Online Streaming Feature Selection method to select strongly relevant and nonredundant features on the fly. An efficient Fast-OSFS algorithm is proposed to improve feature selection performance. The proposed algorithms are evaluated extensively on high-dimensional datasets and also with a real-world case study on impact crater detection. Experimental results demonstrate that the algorithms achieve better compactness and higher prediction accuracy than existing streaming feature selection algorithms.