Elements of information theory
Elements of information theory
A training algorithm for optimal margin classifiers
COLT '92 Proceedings of the fifth annual workshop on Computational learning theory
The nature of statistical learning theory
The nature of statistical learning theory
Machine Learning
Game theory, on-line prediction and boosting
COLT '96 Proceedings of the ninth annual conference on Computational learning theory
Wrappers for feature subset selection
Artificial Intelligence - Special issue on relevance
Joint Induction of Shape Features and Tree Classifiers
IEEE Transactions on Pattern Analysis and Machine Intelligence
Classification by pairwise coupling
NIPS '97 Proceedings of the 1997 conference on Advances in neural information processing systems 10
Proceedings of the 1998 conference on Advances in neural information processing systems II
An introduction to support Vector Machines: and other kernel-based learning methods
An introduction to support Vector Machines: and other kernel-based learning methods
International Journal of Computer Vision - Special issue on statistical and computational theories of vision: Part II
Filters, Wrappers and a Boosting-Based Hybrid for Feature Selection
ICML '01 Proceedings of the Eighteenth International Conference on Machine Learning
Fast Face Detection with Precise Pose Estimation
ICPR '02 Proceedings of the 16 th International Conference on Pattern Recognition (ICPR'02) Volume 1 - Volume 1
An introduction to variable and feature selection
The Journal of Machine Learning Research
Feature extraction by non parametric mutual information maximization
The Journal of Machine Learning Research
Object Recognition with Informative Features and Linear Classification
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
Collaborative filtering with the simple Bayesian classifier
PRICAI'00 Proceedings of the 6th Pacific Rim international conference on Artificial intelligence
Identifying Simple Discriminatory Gene Vectors with an Information Theory Approach
CSB '05 Proceedings of the 2005 IEEE Computational Systems Bioinformatics Conference
Enhancing border security: Mutual information analysis to identify suspect vehicles
Decision Support Systems
The Journal of Machine Learning Research
A Stochastic Algorithm for Feature Selection in Pattern Recognition
The Journal of Machine Learning Research
Analysis of breast feeding data using data mining methods
AusDM '06 Proceedings of the fifth Australasian conference on Data mining and analystics - Volume 61
Information theory for Gabor feature selection for face recognition
EURASIP Journal on Applied Signal Processing
Robust, low-cost, non-intrusive sensing and recognition of seated postures
Proceedings of the 20th annual ACM symposium on User interface software and technology
On the Design of Cascades of Boosted Ensembles for Face Detection
International Journal of Computer Vision
Learning to Locate Informative Features for Visual Identification
International Journal of Computer Vision
Mixed feature selection based on granulation and approximation
Knowledge-Based Systems
Distinctive and compact features
Image and Vision Computing
Class information predicts activation by object fragments in human object areas
Journal of Cognitive Neuroscience
Mining non-redundant high order correlations in binary data
Proceedings of the VLDB Endowment
Traffic flooding attack detection with SNMP MIB using SVM
Computer Communications
Feature Selection Using Mutual Information: An Experimental Study
PRICAI '08 Proceedings of the 10th Pacific Rim International Conference on Artificial Intelligence: Trends in Artificial Intelligence
Can feature information interaction help for information fusion in multimedia problems?
Multimedia Tools and Applications
Feature selection with dynamic mutual information
Pattern Recognition
Artificial Intelligence in Medicine
Searching for interacting features in subset selection
Intelligent Data Analysis
Evaluation Measures for Multi-class Subgroup Discovery
ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I
Searching for interacting features
IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Feature selection under a complexity constraint
IEEE Transactions on Multimedia - Special section on communities and media computing
An Information Theory framework for two-stage binary image operator design
Pattern Recognition Letters
Learning to classify by ongoing feature selection
Image and Vision Computing
Information theoretic feature extraction for audio-visual speech recognition
IEEE Transactions on Signal Processing
A theoretical approach to construct highly discriminative features with application in AdaBoost
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Conditional mutual information based feature selection for classification task
CIARP'07 Proceedings of the Congress on pattern recognition 12th Iberoamerican conference on Progress in pattern recognition, image analysis and applications
Ensemble gene selection for cancer classification
Pattern Recognition
Feature selection for Bayesian network classifiers using the MDL-FS score
International Journal of Approximate Reasoning
Selecting relevant visual features for speechreading
ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Expert Systems with Applications: An International Journal
Real-time large scale near-duplicate web video retrieval
Proceedings of the international conference on Multimedia
Improving incremental wrapper-based feature subset selection by using re-ranking
IEA/AIE'10 Proceedings of the 23rd international conference on Industrial engineering and other applications of applied intelligent systems - Volume Part I
Expert Systems with Applications: An International Journal
Mutual information-based feature selection for intrusion detection systems
Journal of Network and Computer Applications
Correntropy based feature selection using binary projection
Pattern Recognition
Prediction of essential genes by mining gene ontology semantics
ISBRA'11 Proceedings of the 7th international conference on Bioinformatics research and applications
Fast wrapper feature subset selection in high-dimensional datasets by means of filter re-ranking
Knowledge-Based Systems
Feature selection for interpatient supervised heart beat classification
Computational Intelligence and Neuroscience - Special issue on Selected Papers from the 4th International Conference on Bioinspired Systems and Cognitive Signal Processing
Feature selection using hierarchical feature clustering
Proceedings of the 20th ACM international conference on Information and knowledge management
Global feature subset selection on high-dimensional datasets using re-ranking-based EDAs
CAEPIA'11 Proceedings of the 14th international conference on Advances in artificial intelligence: spanish association for artificial intelligence
Automatic construction of static evaluation functions for computer game players
DS'06 Proceedings of the 9th international conference on Discovery Science
Towards optimal training of cascaded detectors
ECCV'06 Proceedings of the 9th European conference on Computer Vision - Volume Part I
Online feature selection using mutual information for real-time multi-view object tracking
AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Automatic feature selection for classification of health data
AI'05 Proceedings of the 18th Australian Joint conference on Advances in Artificial Intelligence
Feature subset selection with cumulate conditional mutual information minimization
Expert Systems with Applications: An International Journal
On the use of variable complementarity for feature selection in cancer classification
EuroGP'06 Proceedings of the 2006 international conference on Applications of Evolutionary Computing
Feature interaction in subspace clustering using the Choquet integral
Pattern Recognition
The Journal of Machine Learning Research
An information theoretic approach for feature selection
Security and Communication Networks
Selecting feature subset via constraint association rules
PAKDD'12 Proceedings of the 16th Pacific-Asia conference on Advances in Knowledge Discovery and Data Mining - Volume Part II
Nearest neighbor estimate of conditional mutual information in feature selection
Expert Systems with Applications: An International Journal
Graph classification: a diversified discriminative feature selection approach
Proceedings of the 21st ACM international conference on Information and knowledge management
Divergence-based feature selection for separate classes
Neurocomputing
Feature selection using dynamic weights for classification
Knowledge-Based Systems
Entropic selection of histogram features for efficient classification
SSPR'12/SPR'12 Proceedings of the 2012 Joint IAPR international conference on Structural, Syntactic, and Statistical Pattern Recognition
Algorithms for discovery of multiple Markov boundaries
The Journal of Machine Learning Research
Modeling plasma surface modification of textile fabrics using artificial neural networks
Engineering Applications of Artificial Intelligence
Mutual information-based method for selecting informative feature sets
Pattern Recognition
A threshold fuzzy entropy based feature selection for medical database classification
Computers in Biology and Medicine
Time-efficient estimation of conditional mutual information for variable selection in classification
Computational Statistics & Data Analysis
A survey on feature selection methods
Computers and Electrical Engineering
Classifying evolving data streams with partially labeled data
Intelligent Data Analysis
A novel feature subset selection algorithm based on association rule mining
Intelligent Data Analysis
| Hi-index | 0.01 |
We propose in this paper a very fast feature selection technique based on conditional mutual information. By picking features which maximize their mutual information with the class to predict conditional to any feature already picked, it ensures the selection of features which are both individually informative and two-by-two weakly dependant. We show that this feature selection method outperforms other classical algorithms, and that a naive Bayesian classifier built with features selected that way achieves error rates similar to those of state-of-the-art methods such as boosting or SVMs. The implementation we propose selects 50 features among 40,000, based on a training set of 500 examples in a tenth of a second on a standard 1Ghz PC.